Data Engineer II
se
Job Description
-
- Build and maintain data pipelines using AWS, DBT,Python, Spark.
- Develop data transformations using dbt and Redshift.
- Implement and manage Lakehouse solutions using Apache Iceberg.
- Orchestrate workflows using Airflow.
- Work closely with business and technical teams to deliver data solutions.
What are the key skills we are looking for?
- Develop and maintain data pipelines using DBT, AWS Glue, Spark, and basic Python.
- Build and optimize data transformation workflows using dbt.
- Implement and manage Lakehouse solutions using Apache Iceberg and Redshift.
- Orchestrate and monitor workflows using Apache Airflow.
- Optimize SQL queries and data models for performance and scalability.
- Follow CI/CD and GitHub best practices for deployment and code management.
- Collaborate with business and technical teams to deliver data solutions.
- Ensure data quality, reliability, and operational excellence. Apache Iceberg and Lakehouse concepts Strong analytical and problem-solving skills.GitHub and CI/CD practices
- AWS Glue, S3, and Redshift
- Python, Spark, and PySpark
- dbt and SQL
- Apache Airflow