Senior Data Specialist
caterpillar
Job Description
Design, develop, and maintain scalable data pipelines on AWS (batch and near‑real‑time).
Own data quality validation across pipelines, including
Data completeness, freshness, consistency, and accuracy checks
Schema validation and anomaly detection
Implement automated data quality checks, alerts, and monitoring for pipeline failures or data issues.
Collaborate with search and platform teams to ensure high‑quality indexed data for Coveo sources.
Contribute to CI/CD pipelines and follow enterprise SDLC and security standards.
Produce clear documentation for pipelines, data contracts, and quality rules.
Perform in-depth analysis of search-indexed datasets to identify data quality issues to improve relevance, accuracy, and overall search performance.