Jr. Software Platform Engineer

 Establish and maintain CI/CD pipeline development, deployment, and testing for data workflows using Azure DevOps or GitHub Actions.

• Implement Git-based source control practices for data engineering assets (ADF pipelines, Databricks notebooks/jobs, SQL scripts), including branching and release management across environments.

• Automate deployments with validation and rollback strategies and set up monitoring/alerting for pipeline and platform health.

• Build and maintain YAML-based pipelines and standardized build/deploy patterns (e.g., reusable templates, triggers, approvals).

• Ensure production deployments follow required change governance and audit-friendly release controls.

Data Engineering & ETL/ELT Pipelines (ADF + Databricks)

• Architect, build, and maintain ETL/ELT pipelines using Azure Data Factory and Azure Databricks (PySpark, SQL, Delta Lake).

• Optimize ingestion, transformation, and storage patterns for performance, scalability, reliability, and cost efficiency.

• Implement orchestration standards, error handling, retries, and operational guardrails to meet SLA/SLO expectations.