Sr. Data Engineer

Principal Duties & Responsibilities:

1. Data platform engineering & modernization — Designs, builds, and supports scalable production pipelines using Microsoft Fabric (Data Factory, notebooks, Lakehouse, Warehouse), Spark/PySpark, SQL, and Python on a Bronze–Silver–Gold (medallion) architecture, and leads the migration of Azure Synapse, Data Factory, and SSIS workloads to Fabric while retiring duplication and technical debt.
2. Data modeling, analytics & AI enablement — Designs dimensional and relational models, reusable datasets, and Power BI semantic models (including Direct Lake) with consistent, business-owned definitions, and prepares governed, well-documented data assets that can safely ground Copilot Studio agents and other AI solutions on CCL’s Microsoft estate.
3. Finance & business data products — Partners with Finance, Revenue Operations, and GCC process and data analysts to translate requirements into certified data products, including turning Dynamics 365 Finance & Operations and project data into trusted reporting that reconciles what is sold, contracted, delivered, and invoiced.
4. Data quality, governance & security — Embeds automated testing, reconciliation, monitoring, and alerting into every pipeline; applies access, privacy, and security controls (row- and object-level security, Key Vault-managed secrets) to protect sensitive client and participant data; and maintains metadata, lineage, business rules, and ownership using Microsoft Purview.
5. DevOps, production support & operational excellence — Uses Git, peer reviews, CI/CD, and Fabric deployment pipelines across development, test, and production; maintains runbooks, alerting, and support documentation; monitors and cost-optimizes Fabric capacity; and leads root-cause analysis so production issues, especially during finance-critical cycles such as month-end close, do not recur.
   1. Technical leadership & global collaboration — Leads the technical design of complex data solutions as a senior individual contributor, establishes reusable engineering standards and design-review practices, mentors engineers and analysts in India, and communicates options, risks, and recommendations clearly to US and global stakeholders across time zones.