Senior Data Engineer
spglobal
Job Description
-
Architect and develop scalable Bigdata and cloud applications, harnessing a range of cloud services to create robust, high-performing solutions.
-
Design and implement advanced CI/CD pipelines, automating software delivery for fast, reliable deployments that keep us ahead of the curve.
-
Tackle complex challenges head-on, troubleshooting and resolving issues to ensure our products run flawlessly for clients.
-
Lead by example, providing technical guidance and mentoring to your team, driving innovation and embracing new processes.
-
Deliver top-tier code and detailed system design documents, setting the standard with technical walkthroughs that inspire excellence.
-
Bridge the gap between technical and non-technical stakeholders, turning complex requirements into elegant, actionable solutions.
-
Mentor junior developers, nurturing their growth and helping them build skills and careers under your leadership.
What We’re Looking For:
We’re seeking a passionate and experienced professional who brings:
-
5 -7 years of expertise in designing and building data-intensive solutions using distributed computing, with a proven track record of scalable architecture design.
-
4+ years of hands-on experience with Python, PySpark/Hadoop, and data/workflow orchestration tools, demonstrating technical versatility.
-
Proficiency in SQL, NoSQL, Apache Spark, Airflow, or similar tools, with deep experience operationalizing data pipelines for large-scale batch and stream processing.
-
Extensive experience deploying data engineering solutions in public cloud environments like GCP or AWS , leveraging cloud capabilities to their fullest potential.
-
A strong history of collaborating with business stakeholders and users to shape research directions and deliver robust, maintainable products.
-
A talent for rapid prototyping and iteration, delivering high-quality solutions under tight deadlines.
-
Exceptional communication and documentation skills, with the ability to explain complex ideas to both technical and non-technical audiences.
-
Good to have skills:
-
Strong knowledge of Gen AI tools (e.g., GitHub Copilot, ChatGPT, Claude, or Gemini) and their power to boost developer productivity.
-
Advanced programming skills in Java or Scala, supported by a portfolio of impactful projects
-
Expertise in containerization, scripting and CI/CD practices, ready to shine in a modern development ecosystem.