Data Engineer

Implement end-to-end ETL pipelines using AWS native services like Step Function, EventBridge, Glue (PySpark, SQL scripts), and Lambda for data extraction, transformation, and loading.
Use pre-created utility & for seamless migration, handling high-volume datasets with error handling and retry mechanisms.
Collaborate with the Solution Designer to test pipelines for performance, and deploy with help of devOps engineer.
Monitor and troubleshoot pipelines using CloudWatch, optimize for cost and process scalability, and document code for team handover.
Support data quality validation and incremental loads to maintain data integrity during the hydration process.
Engage with multiple teams and contribute on key decisions. Provide solutions to problems for their immediate team and across multiple teams.