Data Engineer

vanguardjobs

Hyderabad 5 Years Exp Posted 1h ago

Job Description

  • Design, develop, and maintain scalable data pipelines and ETL processes using Databricks, Python, and SQL to support enterprise data needs.

  • Manage end-to-end data modeling in collaboration with business stakeholders, translating business requirements into scalable and efficient data models.

  • Build and optimize data ingestion, transformation, and processing workflows across multiple data sources and platforms.

  • Develop reusable and maintainable solutions using Python (Functional Programming and Object-Oriented Programming principles).

  • Deploy and manage data infrastructure and workflows using Terraform and cloud-native services.

  • Work with AWS and/or GCP environments to build scalable and secure data solutions, with adherence to cloud security best practices.

  • Partner with engineering teams and business stakeholders to deliver high-quality, trusted datasets that support reporting, analytics, and business initiatives.

  • Monitor, troubleshoot, and optimize data pipelines to ensure performance, reliability, and data integrity.

    • Contribute to the adoption of modern data engineering practices, automation, and platform enhancements within the organization.

Similar Openings for You