Big Data Engineer

The purpose of this role is to interpret data and turn into information (reports, dashboards, interactive visualizations etc) which can offer ways to improve a business, thus affecting business decisions.

͏

Must Have:

• Strong design and coding skills using Big Data technologies such as Hadoop, Spark(Pyspark), Hive, and Airflow.
• Experience with at least one cloud platform or service, such as Azure or AWS.
• Data warehousing experience with expertise in at least one RDBMS, such as SQL Server or Oracle.
• Experience with any one ETL tool like Informatica, SSIS, Pentaho or Azure Data Factory.

Good to Have:

• Experience developing as part of Agile/Scrum team is preferred
• Nice to have reporting skills on PowerBI/Tableau/QlikView.
• Passionate about delivering zero defect code that meets or exceeds the proposed defect SLA and have high sense of accountability for quality and timelines on deliverables.

Essential Functions

• Work with product owners, business stakeholders and internal teams to understand business requirements and desired business outcomes.
• Assist in scoping and designing analytic data assets, implementing modelled attributes and contributing to brainstorming sessions.
• Build and maintain a robust data engineering process to develop and implement self-serve data and tools for Visa’s product management teams and data scientists.
• Find opportunities to create, automate and scale repeatable analyses or build self-service tools for business users.
• Execute data engineering projects ranging from small to large either individually or as part of a project team.

͏