Data Engineer

vanguardjobs

Hyderabad 8 Years Exp Posted 9h ago

Job Description

  • Design, develop and maintain scalable ETL/ELT pipelines for processing large and complex datasets.
  • Build, optimize and support data architectures, data models and storage solutions that enable efficient analytics and reporting.
  • Integrate data from internal systems, APIs and third-party platforms to create trusted and actionable datasets.
  • Develop and maintain solutions for both batch and real-time data processing.
  • Ensure data quality, consistency, reliability and availability across enterprise data platforms.
  • Collaborate with business stakeholders and technical teams to understand requirements and deliver data-driven solutions.
  • Translate business specifications into technical designs, code and scalable data solutions.
  • Leverage orchestration and workflow tools such as Apache Airflow or Prefect to automate and manage data pipelines.
  • Perform data validation, testing and troubleshooting to ensure accuracy and integrity of data assets.
  • Lead all phases of solution development, from design through implementation and production support.
  • Conduct code reviews and promote engineering best practices across the team.
  • Mentor and develop junior data engineers while contributing to technical standards and continuous improvement initiatives.
  • Support platform upgrades, software releases and production deployments.

Qualifications

  • Bachelor's degree in Computer Science, Information Technology, Computer Applications or a related discipline, or equivalent combination of education and experience.
  • Minimum 8 years of experience in data engineering, data analytics, programming, database administration or data management.
  • Hands-on experience designing and developing scalable data pipelines, ETL frameworks and data solutions.
  • Strong proficiency in SQL and relational database technologies such as PostgreSQL, MySQL, Oracle or SQL Server.
  • Strong programming skills in Python, Scala or Java.
  • Experience working with large-scale data processing technologies such as Apache Spark, Hadoop or Databricks.
  • Experience designing data models, schemas and database solutions that support analytical workloads.
    • Proven ability to collaborate effectively across cross-functional teams and communicate technical concepts to business stakeholders.

Similar Openings for You