Principal Data Engineer

icims

Hyderabad 7 Years Exp Posted 15d ago

Lead a team of data engineers, providing technical direction, mentorship, and performance management
Design, develop, and maintain scalable data pipelines to collect, process, and store data from multiple sources
Build and optimise data infrastructure to support analytics, reporting, and AI/ML workloads at scale
Implement event sourcing and streaming architectures using platforms (e.g., Kafka, AWS Kinesis) for real-time data processing
Apply data governance, security principles, and compliance frameworks to ensure data quality and regulatory adherence
Collaborate with data scientists, software engineers, and product teams to deliver reliable data solutions
Troubleshoot and resolve data-related issues whilst maintaining data quality and integrity
Contribute to best practices, frameworks, and tools for data engineering excellence
Drive improvements in data engineering practices and data architecture
Mentor data engineers and provide technical leadership on projects

Qualifications

Bachelor's degree in Computer Science, Engineering, Data Science, or related field (or equivalent professional experience)
7+ years of experience building data pipelines and systems
Proficiency in Python; familiarity with Java
Strong SQL skills and experience with relational and non-relational databases (e.g., SQL Server, PostgreSQL, MySQL, MongoDB)
Expertise with cloud platforms (AWS preferred) and data storage services (e.g., S3, Redshift)
Expertise with streaming platforms (e.g., Kafka, AWS Kinesis) and event-driven architectures
Strong understanding of data modelling, warehousing, and schema design principles
Expertise with data transformation tools (e.g., dbt), BI platforms (e.g., Looker), and API development for data consumption
Knowledge of version control (Git), CI/CD pipelines, and security principles for data systems (encryption, IAM, compliance frameworks)
Expertise with user behaviour tracking platforms (e.g., Snowplow, Google Analytics) is a plus
Strong analytical and problem-solving skills with intellectual curiosity
Strong communication and collaboration skills across both technical and non-technical teams
- Demonstrated experience in mentoring engineers, leading technical projects, or driving architectural decisions