GCP Data Engineer v

vodafone

Hyderabad NM Years Exp Posted 6d ago

Design, develop and maintain ETL and ELT pipelines that ingest, transform and load large datasets from multiple sources into GCP data platforms.
Develop data solutions using BigQuery, Cloud Storage, Cloud Composer, Dataflow, Pub/Sub and Cloud Functions.
Optimise data pipelines to improve performance, reliability and scalability.
Develop and manage data models, schemas and storage solutions aligned with GCP good practices.
Build effective and scalable Python code and data-processing scripts.
Automate data workflows and scheduled processes using appropriate orchestration tools.Implement data validation, cleansing and quality controls to maintain data accuracy and integrity.
Monitor data pipelines, identify issues and support the timely delivery of data.Optimise BigQuery performance and manage storage and processing costs.
Develop and maintain Kafka streaming integrations using the Python SDK.Build and integrate back-end components that improve application responsiveness and performance.
Collaborate with data scientists, analysts and business stakeholders to define and deliver data requirements.
Coordinate with internal teams and external partners to support effective project delivery.
- Apply a detail-focused and solution-oriented approach while considering wider business objectives.v