Senior Data Engineer

  4+ years’ experience with Big Data Technologies such as Apache Spark™, Cloud Native and Data Lakes, Databricks. 

·       Delivered ETL/ELT solutions including data extraction, transformation, cleansing, data integration and data management. 

·       Implemented batch ingestion pipelines. 

·       Strong Python skills - automate tasks, write unit test using frameworks like Nutter, Unittest, Pytest. 

·       Experience with version control systems, such as Git and CI/CD process. 

·       Strong knowledge of SQL, including complex queries and performance tuning 

·       Familiarity with data modeling, data warehousing, and data integration concepts and best practices. 

·       Documentation and white-boarding skills. 

·       Strong problem-solving skills. 

·       Proven ability to work with large cross functional teams with good communication skills.