Manager, Data Storage Platforms
vantive
Job Description
- Lead and mentor a team of data platform engineers
- Accountable for strategic planning and technical roadmap development for data platforms.
- Oversee the design, implementation, and maintenance of data engineering pipelines in a multi-cloud environment, including integrations with a variety of data sources (including structured, semi-structured, and unstructured data)
- Collaborate with the Domain Data Product Delivery teams and other stakeholders in Architecture, Data Integration, DevOps, and Data Governance to deliver data platform initiatives
- Ensure data engineering standards align with industry best practices for data governance, data quality, and data security.
- Monitor and optimize the performance of data pipelines, ensuring they meet SLAs for data availability and quality.
- Evaluate and recommend new data technologies and tools to improve data engineering processes and outcomes, in collaboration with the Domain Data Product Delivery teams.
- Effectively communicate and realize vision and strategy for the organization that aligns with the business and patient needs.
- Embrace and embed agile ways of working in support of a fail-fast-learn-fast culture and enabling continual improvement.
- Foster a collaborative work environment with strong working relationships within and across businesses and functions, and with strategic external partners.
- Manage datasets using Apache Hudi (version 0.11.x and higher), focusing on supporting near real-time data processing and incremental data loading utilizing cutting-edge features for more efficient data lake management and complex data transformation pipelines
- Implement the latest versions of Terraform (0.12.x and higher) to efficiently handle infrastructure changes and versioning with enhanced security and flexibility