Digital Senior Engineer

1. Data Engineering & Development

• Design, develop, and maintain ETL/ELT pipelines using Azure Data Factory (ADF).

   

• Develop data integration workflows using ADF and Microsoft Fabric Data Factory.

   

• Build and maintain Fabric Notebooks, Lakehouse, Data Warehouse, and Medallion Architecture solutions using PySpark and SQL.

   

• Analyze, transform, and integrate data from multiple sources.

   

• Develop and optimize complex SQL queries, stored procedures, and data models.

   

• Ensure data quality through validation, reconciliation, exception handling, governance, and security practices.

   

2. AI-Driven Engineering

• Leverage AI tools such as Claude, Claude Code, GitHub Copilot, and Fabric AI capabilities to improve productivity and accelerate software delivery.

   

• Apply AI-assisted coding, debugging, documentation, unit testing, and code optimization in day-to-day development.

   

• Utilize Generative AI to enhance data engineering workflows and automate repetitive development activities.

   

• Identify opportunities to integrate AI-assisted approaches into modern data engineering practices.

   

3. Collaboration & Delivery

• Collaborate with Solution Architects, Technical Leads, BI Developers, QA teams, Data Analysts, and business stakeholders.

   

• Participate in technical design, code reviews, troubleshooting, and production support.

   

• Translate business requirements into scalable cloud data solutions.

   

• Contribute to coding standards, reusable frameworks, and engineering best practices.

   

4. DevOps & Automation

• Implement CI/CD practices using Azure DevOps and/or GitHub.

   

• Automate deployment, testing, monitoring, and operational processes.

   

  • Follow Git best practices, DataOps principles, and documentation standards.