DE-Cloud Platform Engineer-Azure-GDSN02

• Architect, implement, and manage CI/CD pipelines using Azure DevOps for data and analytics workloads.
• Build and maintain CI/CD pipelines across on-premises and multi-cloud platforms (Azure, AWS, GCP), ensuring consistent and secure delivery practices.
• Integrate DevSecOps practices, including automated testing, code quality, and vulnerability scanning (e.g., SonarQube, Checkmarx, Veracode, Fortify) within CI/CD pipelines.
• Develop automation scripts using Bash, Python, Groovy, PowerShell, and leverage CLI tools (Azure CLI, AWS CLI) for operational tasks.
• Maintain and optimize source control systems (Git, SVN), enforcing branching strategies and code quality standards.
• Innovate in building independent automation solutions.
• Automate data workflows leveraging Azure Data Lake, Databricks, and Microsoft Fabric for scalable, secure, and high-performance data solutions.
• Integrate and orchestrate data pipelines and analytics solutions using Microsoft Fabric (including Lakehouse, Data Engineering, and Real-Time Analytics workloads).
• Automate deployment and management of Databricks clusters, notebooks, and jobs.
• Support migration and modernization of legacy data platforms to Azure and Microsoft Fabric.
• Develop infrastructure as code (IaC) for Azure resources using Terraform, ARM Templates, or Bicep.
• Demonstrate working knowledge of cloud-native services in Azure, including PaaS, SaaS, and IaaS offerings.
• Ensure cloud security best practices are followed, with a strong understanding of identity, access management, and network security in cloud environments.
• Comprehensive understanding of how IT operations are managed.
• Implement data governance, security, and compliance best practices across Azure Data Lake, Databricks, and Fabric environments.
• Monitor, troubleshoot, and optimize data pipelines and platform performance using Azure Monitor, Log Analytics, and Fabric monitoring tools.
• Collaborate with data engineers, analysts, and business stakeholders to deliver end-to-end data solutions.

Skills and attributes for success

• Strong hands-on experience with Azure DevOps for CI/CD automation, release management, and environment provisioning.
•  Deep expertise in Azure Data Lake, Databricks (including Spark, Delta Lake), and Microsoft Fabric (Lakehouse, Data Engineering, Real-Time Analytics).
• Proficiency in scripting languages: Python, PowerShell, Shell.
• Experience with infrastructure automation tools: Terraform, ARM Templates, Bicep.
• Knowledge of data governance, security, and compliance in cloud environments.
• Familiarity with monitoring and observability tools: Azure Monitor, Log Analytics, Fabric monitoring.
• Ability to design scalable, secure, and cost-effective data architectures.
• Capability to identify, communicate, and mitigate project risks.
• Capability to create sustainable systems and services through automation and continuous improvement.
• Ability to communicate effectively with customers and team members; strong analytical and problem-solving skills; flexibility to lead or support the team in day-to-day tasks.
• Capability to design, build, and implement DevOps solutions for projects of varying complexity.
• Capability to design and implement monitoring and observability with various monitoring tools.
• Capability to implement SRE (Site Reliability Engineering) practices to reduce toil, measure, and optimize systems for agreed reliability.
• Strong understanding of agile methodologies.
• Capability to deliver best practices around provisioning, operations, and management of multi-cloud environments.
• Capability to manage communication and deliverables from offshore teams.
• Capability to assist the team in debugging and troubleshooting scripts (imperative and declarative).
• Capability to identify software packages and solutions that meet client requirements, develop RFPs, and assist clients in evaluating proposals (business and technology fit, pricing, and support).
• Experience designing and developing AI-infused DevOps frameworks.

To qualify for the role, you must have

•   BE/B.Tech/MCA with a sound industry experience of 6 to 8 years
•   Cloud Computing knowledge in multi cloud environments with Azure as the main one.
•   DevOps – Setting up CI/CD pipeline using Azure DevOps.
•   Hands-on experience with Azure Data Lake, Databricks (including Spark, Delta Lake), and Microsoft Fabric (Lakehouse, Data Engineering, Real-Time Analytics).
•   Practical ex