Senior Data Engineer

spglobal

Hyderabad 5 Years Exp Posted 44d ago

Job Description

  • Architect and develop scalable Bigdata and cloud applications, harnessing a range of cloud services to create robust, high-performing solutions. 

  • Design and implement advanced CI/CD pipelines, automating software delivery for fast, reliable deployments that keep us ahead of the curve. 

  • Tackle complex challenges head-on, troubleshooting and resolving issues to ensure our products run flawlessly for clients. 

  • Lead by example, providing technical guidance and mentoring to your team, driving innovation and embracing new processes. 

  • Deliver top-tier code and detailed system design documents, setting the standard with technical walkthroughs that inspire excellence. 

  • Bridge the gap between technical and non-technical stakeholders, turning complex requirements into elegant, actionable solutions. 

  • Mentor junior developers, nurturing their growth and helping them build skills and careers under your leadership. 


What We’re Looking For: 
We’re seeking a passionate and experienced professional who brings: 

  •  5 -7 years of expertise in designing and building data-intensive solutions using distributed computing, with a proven track record of scalable architecture design. 

  • 4+ years of hands-on experience with Python, PySpark/Hadoop, and data/workflow orchestration tools, demonstrating technical versatility. 

  • Proficiency in SQL, NoSQL, Apache Spark, Airflow, or similar tools, with deep experience operationalizing data pipelines for large-scale batch and stream processing. 

  • Extensive experience deploying data engineering solutions in public cloud environments like GCP  or AWS , leveraging cloud capabilities to their fullest potential. 

  • A strong history of collaborating with business stakeholders and users to shape research directions and deliver robust, maintainable products. 

  • A talent for rapid prototyping and iteration, delivering high-quality solutions under tight deadlines. 

  • Exceptional communication and documentation skills, with the ability to explain complex ideas to both technical and non-technical audiences. 

  • Good to have skills: 

  • Strong knowledge of Gen AI tools (e.g., GitHub Copilot, ChatGPT, Claude, or Gemini) and their power to boost developer productivity. 

  • Advanced programming skills in Java or Scala, supported by a portfolio of impactful projects 

  • Expertise in containerization, scripting and CI/CD practices, ready to shine in a modern development ecosystem.  

Similar Openings for You