Data Engineer – Digital Transformation

emagine

pune 3 Years Exp Posted 12d ago

Job Description

  • Collect, store, process, and analyze large data sets.

  • Implement data solutions on Palantir Foundry or for specific AI solutions.

  • Collaborate with global teams across development, manufacturing, quality, sales, and purchasing.

  • Build large-scale batch and real-time data pipelines using frameworks like PySpark and Spark.

  • Ensure data quality and perform data problem analysis.

  • Develop, construct, test, and maintain data pipelines.

  • Document data and maintain definitions.

  • Contribute to functional analysis and user needs translation into structured data pipelines.

  • Prepare data for predictive modeling and develop associated processes.

  • Conduct feasibility studies for optimal technical solutions.

  • Utilize Agile and DevOps methodologies to deliver projects timely.

  • Share expertise and facilitate knowledge transfer within the team.

Key Requirements:

  • 3-5 years of experience in data mining from various data sources.

  • Proven experience with data processing frameworks, particularly PySpark or Spark.

  • Strong understanding of data quality assurance and analysis.

  • Ability to develop and maintain data pipelines.

    • Fluency in English, both verbally and in writing.

Similar Openings for You