GCP Data Engineer

oraclecloud

Pune NM Years Exp Posted 12h ago

Job Description

  • Design, develop, and optimize ETL/ELT pipelines using GCP-native tools (Dataflow, Dataproc, Cloud Composer/Airflow)
  • Build and manage data warehousing solutions on BigQuery, including schema design, partitioning, and query optimization
  • Develop data ingestion frameworks from structured and unstructured sources (batch and streaming)
  • Implement data quality checks, monitoring, and alerting across pipelines
  • Collaborate with data architects to translate business requirements into technical designs
  • Work with Pub/Sub, Cloud Storage, and Cloud Functions to build event-driven data workflows
  • Support CI/CD practices for data pipeline deployments (Cloud Build, Terraform)
  • Ensure data security, access controls, and compliance with governance standards
  • Participate in code reviews, sprint planning, and technical documentation
  • Coordinate with onshore teams across time zones for delivery alignmen

Responsibilities

 

  • Design, develop, and optimize ETL/ELT pipelines using GCP-native tools (Dataflow, Dataproc, Cloud Composer/Airflow)
  • Build and manage data warehousing solutions on BigQuery, including schema design, partitioning, and query optimization
  • Develop data ingestion frameworks from structured and unstructured sources (batch and streaming)
  • Implement data quality checks, monitoring, and alerting across pipelines
  • Collaborate with data architects to translate business requirements into technical designs
  • Work with Pub/Sub, Cloud Storage, and Cloud Functions to build event-driven data workflows
  • Support CI/CD practices for data pipeline deployments (Cloud Build, Terraform)
  • Ensure data security, access controls, and compliance with governance standards
  • Participate in code reviews, sprint planning, and technical documentation
    • Coordinate with onshore teams across time zones for delivery alignment

Similar Openings for You