Data Engineer

What You’ll Do

1. Design and own ETL/ELT pipelines (batch and streaming where required).
2. Drive Medallion architecture design (Bronze, Silver, Gold) with clear data contracts and quality checks.
3. Build scalable transformations using Spark/Databricks with performance tuning.
4. Implement data validation frameworks, monitoring, lineage, and observability.
5. Handle schema evolution, incremental loads, idempotency, and orchestration patterns.
6. Collaborate with content and application teams to define reliable data models.

Must Have

1. 4–6 years’ experience in Data Engineering / Backend Engineering.
2. Strong Python and advanced SQL skills.
3. Hands-on Spark/Databricks experience with performance optimization.
4. Deep understanding of Medallion architecture and production data systems.
5. Experience building reliable data pipelines with testing and monitoring. Practical understanding of LLMs, RAG systems, embeddings, vector search. Experience building and deploying REST APIs. Understanding of system design basics (scalability, reliability, trade-offs).