GCP Data Engineer
vodafone
Job Description
- Engage with end users and business stakeholders to understand data requirements and contribute to ETL framework strategies.
- Design, build, and implement modern, scalable data solutions using Google Cloud Platform services.
- Automate manual processes to optimise data delivery, including orchestration workflows, logging, and alerting mechanisms.
- Analyse datasets to assess data quality, reusability, and integrity, and provide effective solutions to resolve data quality issues.
- Review reports and performance indicators to filter data and identify, troubleshoot, and correct code-related issues.
- Monitor daily data pipelines to ensure solution readiness, zero downtime, and rapid alerting in case of failures.
- Maintain and track audit tables to ensure consistency and reliability of data workflows.
- Perform reverse engineering of existing workflows to understand current functionality and support enhancements.
- Enhance and optimise existing GCP data pipelines to deliver stable, efficient, and scalable solutions.
- Collaborate with data science and machine learning teams, along with key stakeholders, to support business objectives.
- Identify and resolve data anomalies and pipeline-related issues within the GCP framework.