Senior Data Engineer
thalesgroup
Job Description
- Expert in Pyspark, SQL ,knowledge on Databricks, cloud platforms,Stream processing
- Responsible for writing reusable, testable and efficient code - ensuring the application's performance, security and scalability.
- Good to have understanding about AI tools
- Dashboarding tool exposure : Databricks dashboarding , Tableau
- Mandatory experience working with delta live tables
- In addition, he/she will be working on data engineering problems and building data pipelines.
- Integration of data storage solutions (may include databases, key-value stores, blob stores, etc.)
- Strong unit test and debugging skills
- Familiarity with database technologies such as SQL and MYSQL.
- Experience with Git, JIRA, Confluence
- Support end to end testing
- Optimization Skills