Data Engineer

Supports the build, maintenance and enhancements of data lake development; supports simple to medium complexity API, unstructured data parsing and streaming data ingestion
Excels in one more domain; understands pipelines and business metrics
Builds, tests and enhances data curation pipelines integration data from a wide variety of sources like DBMS, File systems and APIs for various KPIs and metrics development with high data quality and integrity
Handles data manipulation (extract, load, transform), data visualization, and administration of data and systems securely and in accordance with enterprise data governance standards
Maintains the health and monitoring of assigned analytic capabilities for a specific data engineering solution; ensures high availability of the platform; monitors workload demands; works with Infrastructure Engineering teams to maintain the data platform; serves as an SME of one or more application

Years of Experience 
2 years of experience in Data or BI Engineering, Data Warehousing/ETL, or Software Engineering
1 year of experience working on project(s) involving the implementation of solutions applying development life cycles (SDLC)

Education Qualification & Certifications 
Bachelor's Degree in Engineering /Computer Science, CIS, or related field (or equivalent work experience in a related field)

Skill Set Required 
Design and develop data-ingestion frameworks, real-time processing solutions, and data processing and transformation frameworks leveraging open source tools and data processing frameworks.
Hands-on on technologies such as Kafka, Apache Spark (SQL, Scala), airflow
Experience in GCP Cloud Composer, Big Query, DataProc
Offer system support as part of a support rotation with other team members