Data Engineer
instinctools
Job Description
- Data Pipeline Development: (Senior) Implement data orchestration and workflow management solutions to automate and schedule data processing tasks; continue optimizing pipeline performance, resource utilization, scalability, and reliability.
- Data Modeling and Storage: (Senior) Design and implement data models and schemas to support both transactional and analytical use cases (Senior) evaluate and select appropriate data processing and storage solutions based on performance, scalability, and cost considerations.
- Data Integration and ETL: Own complex ETL architecture, ensuring data consistency, accuracy, and quality at scale.
- Data Governance and Security: (Senior) Establish and enforce data governance policies, standards, and best practices to ensure data integrity, privacy, and security.
- Monitoring and Maintenance: (Senior) Perform routine maintenance tasks such as backup and upgrades, and capacity planning; own resolution of complex pipeline/infrastructure issues.