Software Engineer III - Data Engineering , ITC

• 5-7 years of experience in software development, with a strong foundation in distributed systems, cloud-native architectures, and data platforms.

• Experience with various stages of software development, including design, development, testing, and deployment. 

• Strong programming skills in Python, SQL etc. 

• Deep expertise with cloud platforms like AWS, Azure, or GCP.

• Hands-on experience with Databricks, Snowflake, AWS EMR, AWS RDS, Azure SQL, or GCP Cloud SQL, Apache Spark, Databricks Workflow and Apache Airflow.

• Strong understanding of Lakehouse architecture, Data Mesh principles, data governance frameworks, and modern data pipelines.

• Proven ability to deliver high-impact, API-first services at scale.

• Proficiency with tools like Terraform or AWS CloudFormation is critical for managing cloud infrastructure programmatically, ensuring consistency, and enabling automation.

• Strong problem-solving and analytical thinking skills.

• Experience in guiding and supporting junior engineers. 

• Excellent communication and collaboration skills.

• Good hands on experience in observability and Data quality

Skillset Preferred (Good to Have)

• Basic understanding of Machine Learning and Generative AI concepts

• Exposure to LLMs (Large Language Models) and their applications (data cataloging, data schematic layer, data enrichment, etc.)

• Familiarity with prompt engineering techniques and evaluation

• Experience or exposure to AI frameworks/libraries, Agentic AI such as LangChain, OpenAI APIs, or similar

• Understanding of RAG (Retrieval-Augmented Generation) patterns and vector databases is a plus

  • Awareness of AI guardrails, responsible AI, and data privacy considerations