GCP Data Engineering

Design, develop, and maintain batch and real-time ETL/ELT pipelines on GCP
• Build and optimize data pipelines using Python
• Implement streaming solutions using Pub/Sub and Dataflow
• Develop and manage batch workflows using Cloud Composer
• Design and optimize data models and queries in BigQuery
• Work with large-scale, low-latency data stores such as Bigtable
• Ensure data quality, reliability, performance, and scalability
• Manage source code, reviews, and collaboration using GitHub
• Build and maintain CI/CD pipelines using GitHub Actions
• Collaborate with product, platform, and analytics teams in an Agile setu

Responsibilities

Strong hands-on experience with Google Cloud Platform (GCP)
• Proven expertise in batch and real-time data pipelines
• Strong programming experience in Python
• Hands-on experience with BigQuery, Bigtable, Pub/Sub, Dataflow, and Cloud 
Composer
• Solid understanding of data modeling, ETL/ELT, and distributed data systems
• Proficiency with GitHub and GitHub Actions–based CI/CD
• Experience working in Agile environments
• Strong knowledge of data security and access management