Senior Data Engineer
divulgavagas
Job Description
- Hands on experience working on Databricks, creating data pipelines, transformation rules using Unity Catalog, PySpark, SparkSQL
- Hands on Databricks Devs – Deployments, CICD, Performance Management
- Hands on Databricks Infrastructure like creating resources (Catalogs, Volumes, Storage Account, Private end points)
- User permissions, access controls, Keyvalults etc.
- Handling release deployments, job controls, workflow management & organizing via automations
- Handling production incidents, triaging production issues, work with Databricks to open incident tickets/case and follow up to close the issue and ensure long term fixes
- Additional knowledge of other Databricks key features, like Genie, Apps, Models creations etc