Data Engineer II/ Senior Data Engineer
cvent
Job Description
- Develop data services and pipelines to capture, cleanse, transform, and route data to destination systems like Snowflake, enabling near real-time processing of customer data.
- Implement and maintain data regulatory frameworks that removes customer data from underlying data stores based on standardized metadata and policies.
- Onboard Cvent products on data pipelines and frameworks including metadata configuration, validation, and integration with product teams.
- Investigate and remediate data pipeline and framework issues for missed tables, incorrect metadata, performance bottlenecks and drive preventive improvements.
- Work with other Cvent products and platform teams to ensure connectivity and compatibility between application services underlying data stores.
- Prepare technical design documents for major modules; identify design concerns, propose and compare approaches, review code, test, and implement solutions.
- Participate in process definition and implementation for service development, testing, releases, and version control; be actively involved in design, grooming, and requirement discussions.
- Provide on-call operational support for DataDev services.
- Implement and support observability (dashboards, alerts, logs, metrics) to monitor service health.
- Write and maintain runbooks, onboarding guides, and best practices and share knowledge with peers.
- Collaborate with analytics and business teams to support downstream reporting, BI, and compliance reporting needs.
- Actively participate in Agile ceremonies (standups, grooming, retros, PI planning) and deliver work items with clear estimates and status updates.
- Use approved AI tools to speed up tasks such as log analysis, impact analysis, documentation, and troubleshooting—while following Cvent’s data privacy and security guidelines.
- Apply basic prompting and validation habits: treat AI suggestions as proposals, validate against logs/code/docs, and avoid pasting sensitive production data into unapproved tools.
- Contribute feedback to improve how DataDev services can be augmented by AI in the future (for example: metadata validation helpers, runbook suggestion, failure summarization).