Data Engineer – Digital Transformation
emagine
Job Description
-
Collect, store, process, and analyze large data sets.
-
Implement data solutions on Palantir Foundry or for specific AI solutions.
-
Collaborate with global teams across development, manufacturing, quality, sales, and purchasing.
-
Build large-scale batch and real-time data pipelines using frameworks like PySpark and Spark.
-
Ensure data quality and perform data problem analysis.
-
Develop, construct, test, and maintain data pipelines.
-
Document data and maintain definitions.
-
Contribute to functional analysis and user needs translation into structured data pipelines.
-
Prepare data for predictive modeling and develop associated processes.
-
Conduct feasibility studies for optimal technical solutions.
-
Utilize Agile and DevOps methodologies to deliver projects timely.
-
Share expertise and facilitate knowledge transfer within the team.
Key Requirements:
-
3-5 years of experience in data mining from various data sources.
-
Proven experience with data processing frameworks, particularly PySpark or Spark.
-
Strong understanding of data quality assurance and analysis.
-
Ability to develop and maintain data pipelines.
-
Fluency in English, both verbally and in writing.
-