DE-Cloud Platform Engineer-Azure-GDSN02
ey
Job Description
- Architect, implement, and manage CI/CD pipelines using Azure DevOps for data and analytics workloads.
- Build and maintain CI/CD pipelines across on-premises and multi-cloud platforms (Azure, AWS, GCP), ensuring consistent and secure delivery practices.
- Integrate DevSecOps practices, including automated testing, code quality, and vulnerability scanning (e.g., SonarQube, Checkmarx, Veracode, Fortify) within CI/CD pipelines.
- Develop automation scripts using Bash, Python, Groovy, PowerShell, and leverage CLI tools (Azure CLI, AWS CLI) for operational tasks.
- Maintain and optimize source control systems (Git, SVN), enforcing branching strategies and code quality standards.
- Innovate in building independent automation solutions.
- Automate data workflows leveraging Azure Data Lake, Databricks, and Microsoft Fabric for scalable, secure, and high-performance data solutions.
- Integrate and orchestrate data pipelines and analytics solutions using Microsoft Fabric (including Lakehouse, Data Engineering, and Real-Time Analytics workloads).
- Automate deployment and management of Databricks clusters, notebooks, and jobs.
- Support migration and modernization of legacy data platforms to Azure and Microsoft Fabric.
- Develop infrastructure as code (IaC) for Azure resources using Terraform, ARM Templates, or Bicep.
- Demonstrate working knowledge of cloud-native services in Azure, including PaaS, SaaS, and IaaS offerings.
- Ensure cloud security best practices are followed, with a strong understanding of identity, access management, and network security in cloud environments.
- Comprehensive understanding of how IT operations are managed.
- Implement data governance, security, and compliance best practices across Azure Data Lake, Databricks, and Fabric environments.
- Monitor, troubleshoot, and optimize data pipelines and platform performance using Azure Monitor, Log Analytics, and Fabric monitoring tools.
- Collaborate with data engineers, analysts, and business stakeholders to deliver end-to-end data solutions.