Data Engineer

aptean

Bengaluru 2 Years Exp Posted 1h ago

Job Description

  • 2-5 Year’s
  • Knowledge, Skills, Abilities & Competencies
  • Hands-on experience in designing and implementing data platforms, including data warehouses, lakehouse, and modern ETL/ELT pipelines.
  • Working knowledge of Microsoft Fabric (Pipelines, Dataflows Gen2, Notebooks, Lakehouse) is strongly preferred.
  • Proven ability to build, deploy, and troubleshoot highly reliable, distributed data pipelines integrating structured and unstructured data from various internal systems and external sources.
  • Working knowledge of the medallion architecture (bronze/silver/gold) and Delta Lake / OneLake concepts; prior project experience implementing this pattern is highly desirable.

 

Solid understanding of data lakehouse patterns and Delta Lake / OneLake concepts, with the ability to structure data models that are AI/ML-ready and support semantic modeling.

Solid understanding of SQL, relational and dimensional data modeling, query tuning, and basic performance optimization.

Familiarity with data quality concepts — null/duplicate/schema-drift checks, basic SCD handling, and validation rules in transformation pipelines.

Familiarity with Git, branching strategies, and CI/CD concepts in a data engineering context (Azure DevOps or GitHub Actions).

Strong communication and collaboration skills, with the ability to articulate complex data engineering solutions to both technical and non-technical stakeholders, and to lead cross-functional initiatives.

Similar Openings for You