Data Engineer

1. Data Governance & Metadata Management
Implement enterprise data governance frameworks using Informatica EDC and AXON.
Configure data cataloguing, metadata harvesting, and automated lineage tracking.
Enable data discovery, data classification, and impact analysis across the data landscape.
Maintain business glossary, data policies, and governance workflows within AXON.
Support data stewardship processes and governance adoption across business units.
Integrate ETL pipelines with metadata and lineage tracking frameworks.

2. Data Quality & Compliance
Implement data validation, reconciliation, and cleansing frameworks within ETL pipelines.
Develop automated checks for:
o Null handling
o Duplicate detection
o Data format validations
Ensure data accuracy, completeness, and consistency across systems.
Enforce data governance policies and regulatory compliance requirements.


Professional & Technical Skills:
3. Production Support & Incident Management
Manage scheduling jobs
Perform root cause analysis (RCA) and implement preventive solutions.
Participate in on-call rotations and L1/L2 production support.
Ensure adherence to SLAs and operational compliance standards.

4. Stakeholder Management
Drive automation, operational efficiency, and engineering best practices.
Enforce coding standards, version control, and release management processes.

5. Must-Have Skills
Big Data & Hadoop Ecosystem
Hands-on experience with:
o Apache Hive
o Apache Spark
o Apache Impala
o Apache Sqoop
Experience working on Cloudera Data Platform