GCP Data Engineer/Consultant Specialist

• Provide technical leadership and mentorship to engineering teams focused on development, deployment, and operations.
• Interface strategically with diverse stakeholders to translate business and customer requirements into technical solutions
• Drive the migration and re-engineering of on-premises services to cloud platforms (GCP/AWS)
• Develop Python and shell scripts to automate infrastructure operations and server management
• Design, develop, test, and deploy scalable data integration pipelines leveraging BigQuery and Cloud SQL
• Conduct comprehensive load and performance testing to ensure pipeline reliability and scalability
• Maintain best practices in documentation, configuration management, and operational procedures
• Collaborate using modern development tools (Git, JIRA, Confluence) and follow agile methodologies

To be successful in this role, you should meet the following requirements:

• 8-12 years of experience as a Lead Data Engineer/Developer with demonstrated expertise in cloud technologies (GCP)
• Expert proficiency in Python, DataFlow, Pub/Sub, and BigQuery
• Hands-on experience with distributed data processing frameworks (Hadoop, NiFi, Kafka)
• Deep knowledge of GCP ecosystem (GCS, BigQuery, Cloud Composer/Airflow, Cloud SQL, Pub/Sub/Kafka, Dataflow, Google Cloud SDK)
• Strong proficiency in Terraform and shell scripting for infrastructure as code
• Proven experience with at least one RDBMS (SQL Server, PostgreSQL, MySQL, or Oracle)
• GCP Data Engineer certification or equivalent cloud certification (preferred)
  • Strong communication and team collaboration skills in cross-functional environments