Principal Data Engineer
globallogic
Job Description
Work with product, product engineering, data engineering, and data science peers to build and support our AdTech platform.
Build data-oriented solutions that are simple, scalable, reliable, secure, maintainable, and make a measurable impact.
Provide our teams with the data they need to build, sell, and manage our platform, and scale DS prototypes into production solutions. Develop, deliver and maintain batch and real-time data pipelines, analysis services, workflows and orchestrations, and create and manage the platforms and data infrastructure that hold, secure, cleanse and validate, govern, and manage our data.
Manage our data platform, incorporating services using Airflow, CloudSQL, BigQuery, Kafka, Dataproc, and Redis running on Kubernetes and GCP.
Support our Data Science teams with access to data, performing code reviews, aiding model evaluation and testing, deploying models, and supporting their execution.
Employ modern pragmatic engineering principles, practices, and tooling, including TDD/BDD/ATDD, XP, QA Engineering, Trunk Based Development, Continuous Delivery, automation, DevSecOps, and Site Reliability Engineering.
Contribute to driving ongoing improvements to our engineering principles, practices, and tooling. Provide support & mentorship to junior engineers.
Develop and maintain a contemporary understanding of AdTech developments, industry standards, partner and competitor platform developments, and commercial models, from an engineering perspective.