Data Engineer
ciklum
Job Description
- Strengthens the remediation and matching layer of that pipeline, specifically automatic remediation
- D&B DataBlocks matching
- LLM-assisted remediation
- Supports the CMG redesign project
Requirements:
- Strong experience in PySpark, Python, and Databricks (Unity Catalog & Delta Lake)
- Hands-on experience with enterprise data pipelines, entity resolution/matching, and data remediation
- Experience integrating APIs into data engineering workflows
- Exposure to LLM-assisted data workflows or AI-enabled data engineering is a plus