Lead Big Data Engineer
spglobal
Job Description
-
Design and develop scalable data processing pipelines using distributed computing frameworks to handle large-scale enterprise datasets
-
Build and maintain ETL processes that extract, transform, and load data into strategic information products supporting organizational goals
-
Develop data-intensive applications and services using modern programming languages and cloud-based analytics platforms
-
Implement stream processing solutions using real-time data processing technologies to support business-critical operations
-
Collaborate with cross-functional teams to translate complex business requirements into robust technical solutions
-
Provide production support and troubleshooting for data systems, ensuring high availability and performance
What We're Looking For:
Basic Required Qualifications:
-
8+ years of hands-on experience in technology application development and production support
-
6+ years of experience developing data pipelines that extract, transform, and load data using programming languages such as Python, Scala, or Java
-
Minimum 3+ years of experience developing and supporting ETL processes using cloud-based analytics platforms (such as Databricks, Snowflake, or Azure Synapse)
-
Experience building data-intensive applications using modern programming technologies (including but not limited to C#, Java, Python, Scala, and SQL)
-
Proficiency with cloud computing environments (such as AWS, Azure, or Google Cloud Platform)
-