Data Engineer
hypersonix
Job Description
- Design, develop, and maintain scalable data pipelines for batch and real-time data processing.
- Build and optimize ETL/ELT workflows to collect, transform, and load data from multiple sources.
- Develop and maintain data models, data warehouses, and data lakes.
- Ensure data quality, consistency, accuracy, and reliability across data pipelines.
- Optimize data processing workflows for performance, scalability, and cost efficiency.
- Work with large and complex datasets from multiple sources.
- Collaborate with Data Scientists and ML Engineers to prepare and deliver high-quality datasets for machine learning models.
- Develop data integrations with APIs, databases, cloud platforms, and third-party systems.
- Monitor data pipelines and troubleshoot data processing and infrastructure issues.
- Implement data validation, monitoring, and testing frameworks.
- Maintain clear documentation of data pipelines, data models, and technical processes.
- Follow best practices for data security, governance, and access control.
- Contribute to the design and evolution of Hypersonix's data platform and architecture.