Data Engineer
vanguardjobs
Job Description
-
Design, develop, and maintain scalable data pipelines and ETL processes using Databricks, Python, and SQL to support enterprise data needs.
-
Manage end-to-end data modeling in collaboration with business stakeholders, translating business requirements into scalable and efficient data models.
-
Build and optimize data ingestion, transformation, and processing workflows across multiple data sources and platforms.
-
Develop reusable and maintainable solutions using Python (Functional Programming and Object-Oriented Programming principles).
-
Deploy and manage data infrastructure and workflows using Terraform and cloud-native services.
-
Work with AWS and/or GCP environments to build scalable and secure data solutions, with adherence to cloud security best practices.
-
Partner with engineering teams and business stakeholders to deliver high-quality, trusted datasets that support reporting, analytics, and business initiatives.
-
Monitor, troubleshoot, and optimize data pipelines to ensure performance, reliability, and data integrity.
-
Contribute to the adoption of modern data engineering practices, automation, and platform enhancements within the organization.
-