Data Engineer II

se

Bengalor NM Years Exp Posted 15d ago

Job Description

    • Build and maintain data pipelines using AWS, DBT,Python, Spark. 
    • Develop data transformations using dbt and Redshift. 
    • Implement and manage Lakehouse solutions using Apache Iceberg. 
    • Orchestrate workflows using Airflow. 
    • Work closely with business and technical teams to deliver data solutions. 

What are the key skills we are looking for?

 

  • Develop and maintain data pipelines using DBT, AWS Glue, Spark, and basic Python. 
  • Build and optimize data transformation workflows using dbt. 
  • Implement and manage Lakehouse solutions using Apache Iceberg and Redshift. 
  • Orchestrate and monitor workflows using Apache Airflow. 
  • Optimize SQL queries and data models for performance and scalability. 
  • Follow CI/CD and GitHub best practices for deployment and code management. 
  • Collaborate with business and technical teams to deliver data solutions. 
  • Ensure data quality, reliability, and operational excellence. Apache Iceberg and Lakehouse concepts Strong analytical and problem-solving skills.GitHub and CI/CD practices 
    • AWS Glue, S3, and Redshift 
    • Python, Spark, and PySpark 
    • dbt and SQL 
    • Apache Airflow 

Similar Openings for You