Senior Data Specialist

caterpillar

Bangalore NM Years Exp Posted 2d ago

Job Description

Design, develop, and maintain scalable data pipelines on AWS (batch and near‑real‑time).

Own data quality validation across pipelines, including

Data completeness, freshness, consistency, and accuracy checks

Schema validation and anomaly detection

Implement automated data quality checks, alerts, and monitoring for pipeline failures or data issues.

Collaborate with search and platform teams to ensure high‑quality indexed data for Coveo sources.

Contribute to CI/CD pipelines and follow enterprise SDLC and security standards.

Produce clear documentation for pipelines, data contracts, and quality rules.

Perform in-depth analysis of search-indexed datasets to identify data quality issues to improve relevance, accuracy, and overall search performance.

Similar Openings for You