Lead Data Engineer
kmart
Job Description
- AWS – S3, IAM, API Gateway, EKS, EC2, EMR, Lambda, Cloud formation etc.,
- SQL – snowflake or other cloud data warehouse solutions, Oracle, MS SQL server
- Python, Java, Scala
- Kafka, Kafka streams, KSQL DB, Kafka connect preferably confluent kafka
- Docker, Kubernetes, Jenkins, Airflow
- Power BI
Work Experience:
7- 10 years to total IT experience preferably in field of data engineering
- 5+ years’ experience with AWS services including Lambda,IAM,API gateway
- 4+ years’ experience in creating and deploying dockor containers on Kubernetes
- 4+ years’ experience in supporting development teams on Kubernetes best practices, troubleshooting, and performance optimization.
- 4+ years’ experience with CI/CD pipelines toll such as Jenkins and Github Actions
- 4+ years’ experience with Snowflake data warehousing and data lake solutions
- Strong programming skill in Python, Java or Scala
- 4+ years of experience in scripting and automation using languages such as Bash, Python, or GO
- 4+ years of experience with infrastructure-as-code tools such as Terraform, Ansible, or CloudFormation and containerization technologies (e.g., Docker, Kubernetes).
- Knowledge of Agile methodologies and software development lifecycle processes
- Basic understanding of AI / Agentic AI/ Gen AI