Lead AI and Data Science Engineer II
deloitte
Job Description
AI & Data offers a full spectrum of solutions for designing, developing, and operating cutting-edge Data and AI platforms, products, insights, and services. Our offering helps clients innovate, and enhance their data, AI, and analytics capabilities, ensuring they can mature and scale effectively.
AI & Data professionals will work with our clients to:
- Design and modernize large-scale data and analytics platforms including data management, governance and the integration of structured and unstructured data to generate insights leveraging cloud, edge and AI/ML technologies, platforms and methodologies for storage, processing
- Leverage automation, cognitive and AI based solutions to manage data, predict scenarios and prescribe actions
- Drive operational efficiency by managing and upgrading their data ecosystems and application platforms, utilizing analytics expertise and providing As-a-Service models to ensure continuous insights and enhancements.
Location: Bengaluru/Hyderabad/Pune/Chennai
Qualifications
Required:
- 10+ years of experience in architecture, design, implementation, and/or support of highly distributed applications
- Hands on experience with Microsoft Azure and a strong understanding of Azure capabilities and limitations with demonstrated experience in end-to-end deployment of MS Azure BI solution(s)
- Experience in migrating physical or virtualized workloads to the cloud.
- Experience in defining highly available, DR solutions in Azure or any other cloud platform
- Experience in assessing applications for cloud adoption and define Cloud strategy for enterprise.
- Experience in using agile methodologies in implementing Azure solutions.
- Hands-on experience with Tools for system management, monitoring, automation, and agile development
- Experience in designing E2E ETL solutions and well versed with SQL, Data warehousing concepts
- Experience on implementing data lake with batch and streaming data using Unity Catalog and aware about governance across the same
- Design and develop robust, scalable solutions for collecting, analyzing large data sets, creating, and maintaining data pipelines, data structures and/or support of highly distributed applications
- Exposure to Microsoft Azure data platform, including Azure Data Factory (ADF),Azure Databricks, Azure Data Flow, Azure Cosmos DB, Azure Storage, Azure Synapse Analytics / erstwhile Azure Data Warehouse (SQLDW), Event Hubs, Stream Analytics, Data Lake Store, Data Lake Analytics, U-SQL, HDInsight, Azure Analysis Services, Azure Purview, Power Apps, Power BI and PowerShell Scripting
- Configure large database solutions in Azure using SQL Server / Azure SQL DWH / Synapse and optimize the existing or new solutions as and when needed for optimum performance.
- Build data lake from multiple data sources with ingestion, data governance and auditing capabilities
- Experience in any of Programming/Scripting languages - Bash, PySpark, Scala, Python, PowerShell, Ruby
- Experience in defining cloud strategy for enterprise for but not limited to migrating physical or virtualized workloads to the cloud.
- Intuitively identify a customer’s strategic business objectives and articulate the solution vision in both its business value context and a technical architecture that leverages Microsoft Azure.
- Lead architecture development focused on delivering strategic, value-driven, system designs
- Deliver solution architectures to execution teams, communicating their value, and ensuring implementation success
- Contribute to architecture and configuration management boards to ensure solutions are aligned with architecture and business objectives
- Define cloud architecture, design and implementation for hosting large, complex applications in Azure