Sr. Software Engineer
yash
Job Description
- Design, develop, and optimize scalable data pipelines using AWS and Databricks.
- Build and manage modern Lakehouse architectures leveraging Delta Lake, Iceberg and Unity Catalog.
- Implement data governance capabilities including data quality, data lineage, metadata management, and data security.
- Develop ETL/ELT solutions using Python, PySpark, and SQL.
- Design and deploy GenAI solutions, including RAG-based chatbots and AI agents.
- Implement Context Engineering and semantic search frameworks to improve AI outcomes.
- Collaborate with architects, data scientists, and business stakeholders to deliver enterprise data solutions.
- Ensure platform scalability, performance, reliability, and cost optimization.