Enable Data Integrations Engineer
globallogic
Job Description
- Reading and understanding customer requirements from Functional Design Documents (FDDs), including source systems, target schemas, and mapping instructions.
- Reconciling FDD requirements against actual source datasets from APIs, SFTP files, Snowflake tables, and other data sources.
- Translating reconciled requirements into production Databricks pipelines, including authoring configuration and data validation YAML files, and SQL, Python, and PySpark based mapping notebooks.
- Changes and fixes to existing customer pipelines and shared platform code.
- Root cause analysis and resolution of data discrepancies, pipeline failures, or validation issues.
- Clear in-code documentation and inline comments for complex or non-obvious transformation logic
- All work must adhere to Customer coding standards around formatting, structure, and inline documentation.