Quality Assurance Engineer

Build and maintain automated testing for AI voice and chat agents, from single conversational turns to full roleplay flows.

Test LLM output quality - correctness, consistency, structured output, language fidelity, prompt regression - using evaluation harnesses (LLM-as-judge, golden datasets, tolerance-based assertions for non-determinism).

Validate RAG pipelines: retrieval relevance, grounding/faithfulness, and answer quality.

Test voice pipelines: STT/TTS accuracy and real-time, low-latency behavior across languages.

Automate across UI/E2E, API, and AI output layers, and build CI/CD from scratch - lint, type-check, tests, evals, coverage gates, deployment checks.

Own release quality: regression strategy, catching breakages early, and clear go/no-go calls.

Cover database and load/performance testing; extend automation to desktop and mobile clients.

• Take over and extend existing QA automation, and strengthen shared frameworks, tooling, and QA processes/standards.