QA Engineer
ascendion
Job Description
- Multi-Device & Platform Validation: Execute and automate cross-device test strategies across Windows PC, Android tablet, and mobile platforms, profiling local OS background daemons, IPC communications, memory footprints, and state synchronization across paired hardware.
- Agentic & Non-Deterministic AI Evaluation: Implement automated evaluation suites to benchmark non-deterministic LLM/SLM behaviors, measuring tool-calling trajectory correctness, hallucination rates, context relevance, and drift across model versions and prompt iterations.
- Test Automation Engineering: Develop scalable, resilient, and non-flaky test automation harnesses for multimodal AI interactions (voice, text, vision, and system UI controls) without relying on brittle screen coordinate matching or exact string assertions.
- Non-Functional Testing Execution: Automate performance benchmarking (latency, NPU/CPU consumption, battery drain, thermal profiling under load), security validation (indirect prompt injection and data boundary defenses), accessibility (WCAG 2.1/2.2 compliance, dynamic ARIA live regions), and internationalization (bi-directional layout and multilingual semantic quality).
- CI/CD Integration & Shift-Left Gating: Integrate test suites into automated CI/CD pipelines, establishing statistical quality gates and defect telemetry to catch regressions before firmware drops or software release freezes.
- Cross-Functional Collaboration: Partner with Software Engineering, Product Managers (PM), and PMO to triage complex non-deterministic issues, define release readiness criteria, and track defects through structured root-cause analysis.