Data Engineer

virtusa

pune 6 Years Exp Posted 1d ago

Job Description

Experience 6-10 yrs
•Experience in AWS services must like S3, Lambda , Pyspark, Airflow, Glue, Athena, Lake formation ,Step functions, Kinesis, Streaming Pipeline  etc.
•Experience in programming in Python, Functional Testing (FT) & Unit Testing (UT).
•Experience in programming in CI/CD concepts - Jenkins, SQL DB Script.
•Experience performing 2-3 data Migration projects (NOT DATA SCIENCE) on AWS platforms.

Nice to have
•Experience in a Big Data technologies (Terradata, Snowflake, Spark, Redshift, Kafka, etc.)
•Experience with data management process on AWS is a huge Plus
•Experience in implementing complex ETL transformations on AWS using Glue.
•Familiarity with relational database environment (Oracle, Teradata, etc.) leveraging databases, tables/views, stored procedures, agent jobs, etc.

 Experience in AWS services must like S3, Lambda , Pyspark,  Airflow, Glue, Athena, Lake formation ,Step functions etc.

Experience in programming in AWS and Python.

Should have expertise in performing data analysis (NOT DATA SCIENCE) on AWS platforms

Experience in Big Data technologies (Spark, Redshift, Kafka, etc.)

Experience in Big Data technologies (Spark, Redshift, Kafka, etc.)

Similar Openings for You