Data Engineer
crowe
Job Description
- Design, develop, and maintain data pipelines using Microsoft Azure data services such as Azure Data Factory Azure Data Lake, and Azure SQL Database.
- Build ETL/ELT processes to ingest, transform, validate, and load data from multiple structured and semi-structured sources.
- Develop and optimize SQL queries, stored procedures, views, and data models to support analytics and reporting needs.
- Support data warehouse and data lake implementations, including data integration, data cleansing, and data quality checks.
- Collaborate with business analysts, data analysts, and application teams to understand data requirements and deliver reusable data assets.
- Monitor data pipelines, troubleshoot failures, and implement performance improvements.
- Ensure data security, access controls, and compliance with organizational data governance standards.
- Create and maintain technical documentation for data flows, source-to-target mappings, data models, and operational procedures.
- Support Power BI datasets and reporting teams by preparing reliable and performance-optimized data layers.