Lead Data Engineer
jobvite
Job Description
- Architect, design, and implement scalable data warehouse solutions across cloud and on-premises platforms (e.g., Postgres, Snowflake, Redshift).
- Define and enforce data modeling standards, including dimensional and normalized models.
- Build and optimize ETL/ELT pipelines for reliable data ingestion, transformation, and distribution.
- Integrate data from multiple sources including ERP, CRM, APIs, flat files, and streaming systems.
- Develop, deploy, and maintain secure, scalable, and high-performing data pipelines.
- Ensure data quality, integrity, lineage, and consistency across enterprise platforms.
- Support both batch and near real-time data processing needs.
- Optimize SQL queries, schemas, indexing, and partitioning strategies for performance improvements.
- Monitor and enhance data platform performance, scalability, and storage efficiency.
- Implement best practices for availability, backup, disaster recovery, and security
- Collaborate with DevOps and Infrastructure teams to ensure reliable deployment and monitoring.
- Partner with stakeholders to translate business requirements into scalable data solutions.
- Provide technical leadership and strategic direction for data architecture and platform modernization.
- Lead technical initiatives and mentor engineers on best practices and design standards.
- Identify and resolve architectural gaps and performance bottlenecks
- Stay current with emerging technologies and continuously improve the data ecosystem.
What You Bring:
- Bachelor’s degree in computer science, B.E./ B. Tech, computer engineering, or equivalent work experience in lieu of a degree is required
- 9+ years of experience in software or data engineering roles with increasing technical responsibility
- Expertise with at least one major data warehouse platform (e.g., Snowflake, Redshift, BigQuery, Postgres)
- Advanced SQL skills and hands-on experience building ETL/ELT pipelines
- Strong understanding of data modeling techniques (dimensional, normalized, analytical)
- Experience working within cloud-based ecosystems (preferably AWS)
- Experience with orchestration tools and version control systems (e.g., Git)
- Knowledge of data governance, security, and compliance best practices
- Experience enabling reporting solutions using BI tools (e.g., Power BI)
- Strong problem-solving and performance optimization skills
- Experience working in Agile environments and cross-functional teams
- Prior experience mentoring engineers or leading technical initiatives preferred
- Healthcare domain experience and familiarity with HL7 or FHIR preferred