Data Engineer

Data Analysis and Synthesis

• Conduct data profiling and analyze source systems to ensure data quality.
• Present clear insights and findings to colleagues to facilitate effective data usage.

Data Development Process

• Design, build, and test complex or large-scale data products.
• Collaborate with teams to deliver comprehensive data integration services.

Data Integration Design

• Select and implement appropriate technologies to create resilient, scalable, and future-proof data solutions and integration pipelines.

Data Modelling

• Develop relevant data models across various subject areas and articulate their purposes.
• Understand and apply industry-recognized data modeling patterns and standards.
• Compare and align different data models to ensure consistency.

Metadata Management

• Design and manage an effective metadata repository, and recommend changes to existing repositories.
• Familiarize yourself with various tools for managing metadata.
• Provide guidance and support to less experienced team members.

Problem Resolution

• Address issues in databases, data processes, and data products as they arise.
• Monitor services, identify trends, and initiate actions to resolve problems.
• Determine appropriate remedies and assist with their implementation and preventive measures.

Programming and Build

• Utilize established standards and tools to design, code, test, and document moderate-to-complex programs and scripts based on specifications.
• Collaborate with team members to review specifications and ensure alignment.

Technical Understanding

• Grasp core technical concepts related to data engineering and apply them with guidance.

Testing

• Review requirements and specifications, and define test conditions.
• Identify issues and risks associated with work, and analyze test activities and results.