Data/ETL Engineer
ascendion
Job Description
- Design, develop, and maintain scalable data pipelines using PySpark and Databricks.
- Build and optimize ETL/ELT workflows for processing large volumes of structured and unstructured data.
- Develop and manage data integration solutions using Azure Data Factory (ADF).
- Collaborate with data analysts, business stakeholders, and cross-functional teams to understand data requirements.
- Optimize Spark jobs for performance, scalability, and cost efficiency.
- Ensure data quality, governance, and security across data platforms.
- Troubleshoot and resolve data pipeline issues while ensuring high availability