Data Engineer

 Data Pipeline - Develop and maintain scalable data pipelines and builds out new API integrations to 
support continuing increases in data volume and complexity 
• Data Integration - Connect offline and online data to continuously improve overall understanding of 
customer behavior and journeys for personalization. Data pre-processing including collecting, parsing, 
managing, analyzing and visualizing large sets of data 
• Data Quality Management - Cleanse the data and improve data quality and readiness for analysis. 
Drive standards, define and implement/improve data governance strategies and enforce best practices 
to scale data analysis across platforms
• Data Transformation - Processes data by cleansing data and transforming them to proper storage 
structure for the purpose of querying and analysis using ETL and ELT process 
• Data Enablement - Ensure data is accessible and useable to wider enterprise to enable a deeper and 
more timely understanding of operation.
Qualifications & Specifications:
• Masters /Bachelor’s degree in Engineering /Computer Science/ Math/ Statistics or equivalent.
• Strong programming skills in Python/Pyspark/SAS.
• Proven experience with large data sets and related technologies – Hadoop, Hive, Distributed 
computing systems, Spark optimization.
• Experience on cloud platforms (preferably Azure) and it's services Azure Data Factory (ADF), ADLS 
Storage, Azure DevOps. Hands-on experience on Databricks, Delta Lake, Workflows.
• Should have knowledge of DevOps process and tools like Docker, CI/CD, Kubernetes, Terraform, 
Octopus.
• Hands-on experience with SQL and data modeling to support the organization's data storage and 
analysis needs.

• Proficiency in enterprise data pipeline and ETL tools such as Ab Initio, Informatica, DataStage, or equivalent technologies

• Experience on any BI tool like Power BI (Good to have).
• Cloud migration experience (Good to have)
• Cloud and Data Engineering certification (Good to have)
• Working in an Agile environment

4-7 years of relevant work experience needed.

Experience with stakeholder management will be an added advantage.