Data Engineer

 Expected to be an SME, collaborate and manage the team to perform.
- Responsible for team decisions.
- Engage with multiple teams and contribute on key decisions.
- Provide solutions to problems for their immediate team and across multiple teams.
- Lead efforts to optimize data workflows and improve system performance.
- Mentor junior team members to foster skill development and knowledge sharing.
- Coordinate cross-functional initiatives to align data strategies with business goals.
-Build and operate scalable Lakehouse pipelines on Databricks/Azure. Own ELT/streaming, Delta Lake optimization, Unity Catalog governance, and CI/CD. Integrate ADLS/ADF/Synapse, and deliver high-quality data sets for BI/ML/GenAI.
-Must-haves: PySpark, SQL, Databricks (Delta, DLT/Workflows), Azure data services, Unity Catalog, CI/CD.
MLflow/Feature Store, Power BI, streaming/CDC, vector search/RAG, Terraform.



Professional & Technical Skills:
- Must To Have Skills: Proficiency in Microsoft Azure Databricks.
- Experience in designing and implementing scalable data pipelines and ETL processes.
- Strong knowledge of cloud-based data storage and processing solutions.
- Ability to troubleshoot and resolve complex data integration issues.
- Familiarity with data governance and data quality best practices.
- Skilled in performance tuning and optimization of data workflows.

Additional Information:
- The candidate should have minimum 7.5 years of experience in Microsoft Azure Databricks.
- This position is based at our Pune office.
- A 15 years full time education is required.