Lead Big Data Engineer

spglobal

Hyderabad 8 Years Exp Posted 12d ago

Job Description

  • Design and develop scalable data processing pipelines using distributed computing frameworks to handle large-scale enterprise datasets

  • Build and maintain ETL processes that extract, transform, and load data into strategic information products supporting organizational goals

  • Develop data-intensive applications and services using modern programming languages and cloud-based analytics platforms

  • Implement stream processing solutions using real-time data processing technologies to support business-critical operations

  • Collaborate with cross-functional teams to translate complex business requirements into robust technical solutions

  • Provide production support and troubleshooting for data systems, ensuring high availability and performance

 

 

What We're Looking For:

Basic Required Qualifications:

  • 8+ years of hands-on experience in technology application development and production support

  • 6+ years of experience developing data pipelines that extract, transform, and load data using programming languages such as Python, Scala, or Java

  • Minimum 3+ years of experience developing and supporting ETL processes using cloud-based analytics platforms (such as Databricks, Snowflake, or Azure Synapse)

  • Experience building data-intensive applications using modern programming technologies (including but not limited to C#, Java, Python, Scala, and SQL)

    • Proficiency with cloud computing environments (such as AWS, Azure, or Google Cloud Platform)

Similar Openings for You