Data Engineer 4
comcast
Job Description
- Developing data structures and pipelines to standardize and transform data, ensuring insights generation and reporting needs are met
- Ensuring data quality throughout ingestion, processing, and loading to target tables, maintaining high standards
- Creating ingestion frameworks for structured/unstructured data, implementing quality checks and reporting mechanisms
- Establishing methods for data consumption by end users and downstream applications, including database views and APIs
- Implementing data solutions on platforms like Kubernetes, Teradata, and Databricks, ensuring alignment with architectural standards
- Determining appropriate data storage on platforms based on privacy, access, and sensitivity requirements
- Understanding data lineage and transformation rules for efficient troubleshooting and impact analysis during changes
- Collaborating with management partners to optimize data sourcing and processing, enhancing data quality and process efficiency
- Mentoring junior data engineers, fostering skill development and knowledge sharing within the team
- Contributing to the creation and refinement of internal data engineering tools and frameworks to improve efficiency and scalability
- Consistent exercise of independent judgment and discretion in matters of significance.
- Regular, consistent and punctual attendance. Must be able to work nights and weekends, variable schedule(s) as necessary.
- Other duties and responsibilities as assigned.