Sr. Software Engineer

yash

Pune 4 Years Exp Posted 1h ago

Fabric Pipeline Engineering: Design and develop production-grade ETL/ELT workflows using Fabric Data Factory, Dataflows Gen2, and Notebooks.
Data Lake Management: Implement and manage OneLake organization and Medallion architecture (Bronze/Silver/Gold) to ensure data quality and performance.
Advanced Spark Development: Write and optimize PySpark and Spark SQL code for high-volume data processing and transformation.
Semantic Modeling: Build and maintain Power BI semantic models (Direct Lake / Import) to support enterprise reporting requirements.
DevOps & Automation: Manage Fabric artifacts using Git integration and deployment pipelines (CI/CD) in Azure DevOps or GitHub.
Performance Optimization: Conduct performance tuning of Spark clusters and SQL queries to ensure cost-efficient capacity utilization in Fabric.
- Collaboration: Partner with Lead Engineers and Architects to implement data governance, security (RLS/OLS), and cataloging within Microsoft Purview.