Senior Data Engineer

autalenthub

Navi Mumbai 7 Years Exp Posted 24d ago

Design, develop, and maintain scalable data pipelines for batch and real-time data processing.
Architect end-to-end ETL/ELT solutions for data ingestion, transformation, and consumption across enterprise systems.
Build and optimize cloud-native data platforms using AWS services such as S3, EMR, Redshift, Glue, Athena, and Airflow.
Define and implement enterprise data strategies, including data sourcing, data flow, storage, governance, and consumption frameworks.
Collaborate with Data Analytics, Business Intelligence, Product, and Technology teams to understand and fulfill data requirements.
Design and implement scalable data models supporting reporting, analytics, and business intelligence initiatives.
Monitor, troubleshoot, and support production data pipelines to ensure high availability and reliability.
Lead performance tuning initiatives for complex SQL queries, ETL jobs, and large-scale data processing workloads.
Ensure data quality, validation, governance, security, and compliance standards are adhered to.
Drive cloud cost optimization initiatives while maintaining performance and user experience.
Present technical architecture, solutions, and recommendations to business and technology stakeholders.
Mentor junior engineers and coordinate tasks across project teams.
- Prepare and maintain technical documentation, architecture diagrams, and operational runbooks.