Lead Engineer Software

Design, develop, and implement scalable batch and real-time data pipelines usingSnowflake,Amazon Redshift, and AWS-native technologies 

Lead end-to-end data engineering initiatives including data ingestion, transformation (ETL/ELT), data quality, and data delivery across enterprise platforms 

Build andoptimizecloud-native data solutionsleveragingAWS services such asS3, Lambda, Glue, ECS, EMR, IAM, CloudWatch, and related services 

Develop andmaintainmodern ELT transformation frameworks usingdbt(Data Build Tool)for modular, testable, and scalable data modeling 

Implement and support real-time and CDC-based streaming architectures using tools such asKafka,STRIIM, and event-driven integration frameworks 

Design scalable semantic and vector-based data architectures usingVector Databasesto support AI/ML and Retrieval-Augmented Generation (RAG) use cases 

Collaborate with data architects, analysts, product owners, and business stakeholders to gather requirements and translate them into technical solutions 

Drive best practices in data modeling, governance, metadata management, lineage, and performance optimization 

Implement observability and monitoring solutions using tools such asDatadog, CloudWatch, and custom alerting frameworks to ensure platform reliability and operational excellence 

Lead code reviews,establishengineering standards, and champion CI/CD and DevOps practices for data platforms 

Troubleshoot and resolve complex production issues related to data pipelines, orchestration, and warehouse performance 

Mentor junior and mid-level engineers, fostering a culture of technical excellence and continuous learning 

Evaluate and adopt emerging technologies in cloud, AI/ML, and data engineering to drive innovation across the organization 

Enable AI/ML initiatives by building trusted, scalable, and high-quality datasets for advanced analytics and GenAI applications 

Partner with cross-functional teams to implement secure, compliant, andhighly availableenterprise data solutions