Lead Engineer Data Streaming
empower
Job Description
- Design and implement scalable data platform solutions, including data streaming, CDC, data warehouses, data lakes, and ETL/ELT pipelines.
- Contribute to and help enforce platform standards, best practices, and design patterns for cloud-based data technologies.
- Build and support end-to-end data integration pipelines from source systems through Kafka/Striim (or similar) into analytical and operational platforms.
- Lead technical design discussions and contribute to architecture reviews for complex data solutions.
- Ensure high reliability and performance of data platforms through observability, monitoring, and proactive issue resolution.
- Act as a senior escalation point for troubleshooting production issues and optimizing system performance.
- Partner with platform engineering, security, and data governance teams to align implementations with enterprise standards.
- Promote an automation-first mindset by implementing CI/CD pipelines, infrastructure as code, and testing frameworks.
- Contribute to operational resilience through robust error handling, replay capabilities, and validation strategies.
- Evaluate and adopt new tools and technologies to continuously improve the data platform ecosystem.
- Mentor and guide engineers, fostering strong engineering practices and technical growth across the team.