Senior Data Engineer
fluttergroup
Job Description
KEY RESPONSIBILITIES:
- Design and implement scalable ETL processes and data pipelines that integrate with diverse data sources
- Build streaming and batch data processing solutions using Databricks on AWS and Spark
- Develop and optimize Lakehouse architectures ; work with big data access patterns to process large-scale datasets efficiently
- Drive automation and efficiency using CI/CD pipelines , IaC , and DevOps practices.
- Improve database performance, implement best practices for data governance, and enhance data security.