Data Engineer

- Expected to be an SME, collaborate and manage the team to perform.
- Responsible for team decisions.
- Engage with multiple teams and contribute on key decisions.
- Provide solutions to problems for their immediate team and across multiple teams.
- Lead the design and implementation of scalable data architectures to support business needs.
- Coordinate cross-functional efforts to optimize data workflows and improve system performance.
- Mentor junior team members to foster skill development and knowledge sharing.
strong hands-on expertise in Databricks, Python, PySpark, and SQL. The ideal candidate will have a proven track record of designing and building scalable, production-grade data pipelines and must have solid hands-on experience implementing Medallion Architecture across Bronze, Silver, and Gold layers.
- This role offers the opportunity to work with modern cloud platforms, contribute to enterprise data governance practices, and engage with emerging AI and GenAI technologies.
- Key Responsibilities
- Design, develop, and maintain scalable data pipelines using Databricks, PySpark, Python, and SQL. Build and manage ETL/ELT pipelines for batch and large-scale data processing. Implement and maintain Medallion Architecture as a core data structuring standard. Develop data transformation frameworks, optimize Spark workloads for performance and cost efficiency, and implement data quality checks and monitoring. Collaborate cross-functionally to translate business requirements into scalable solutions, troubleshoot production pipelines, and partner with data architects to deliver enterprise-grade data solutions.