Senior Specialist, Data Engineering
msd
Job Description
- Leads the design, construction, and maintenance of complex, scalable data pipeline architectures—ingesting, processing, and delivering high-quality data to stakeholders.
- Architects and optimize batch and real-time processing pipelines on Databricks and AWS, ensuring large-scale datasets are highly structured and ready for advanced analytics.
- Establishes, documents, and champions engineering standards, defining best practices to share and scale across the broader organization.
- Drives the technical delivery of high-impact data analytics initiatives, ensuring robust execution from ingestion to reporting.
- Develops deep, systemic knowledge of supported technologies; masters the architectural complexity and critical dependencies between multiple teams, Databricks platforms, and AWS cloud infrastructure.
- Collaborates intensively with peer platforms and technical leadership to evaluate, pilot, and implement modern data trends and methodologies within the corporate ecosystem.
- Translates strategic stakeholder business goals into technical architectures, designing robust solutions that directly unlock business value.
- Establishes and actively manages trust-based relationships with key business partners, product owners, and stakeholders.
- Monitors global data engineering market developments, identifying and prototyping next-generation pipeline patterns to increase performance and reduce operational costs.
- Fosters and builds a technical "community of practice", leveraging lessons learned from complex cloud analytics deployments to mentor junior engineers.
- Maintains accountability for team delivery, ensuring all engineered solutions meet rigorous quality standards, strict timelines, compliance regulations, and exceptional user experiences.
- Spearheads innovative experimentation, leading proof-of-concept development and defining quantitative, measurable success criteria for new technologies.
- Applies deep commercial domain expertise, with a specialized focus on designing data assets that support Salesforce CRM integrations and advanced commercial analytics.