Data Engineer
shine
Job Description
- - Develop and maintain scalable data pipelines using Azure Data Factory and Azure Databricks. - Utilize PySpark and Python for data processing and transformation tasks. - Collaborate with data analysts and business stakeholders to understand data requirements and deliver solutions that meet their needs. - Implement data storage solutions using Azure Data Lake Storage (ADLS) and ensure data integrity and security. - Create and optimize SQL queries for data retrieval and manipulation. - Develop reports and dashboards using Power BI and DAX to provide insights into business performance. - Monitor and troubleshoot data pipeline performance and resolve any issues that arise.