QA Engineer

We're building AI systems that change how industries work. As a QA Engineer, you'll own quality across product tracks, working closely with engineers and clients to make sure what we ship actually works. Responsibilities: - Own quality for an AI product track from requirements to release. - Test LLM features, RAG pipelines, and multi-agent workflows. - Build automated test suites to catch regressions in AI outputs. - Run adversarial tests to find failure modes before users do. - Work with engineers and clients to define what 'good' looks like. - Plug quality gates into CI/CD pipelines. - Track bugs to closure and flag risks clearly. Requirements: - Hands-on experience testing AI systems across real industries. - Understanding of how LLMs and multi-agent systems break and how to prevent it. - High ownership, fast feedback, and work that ships. - Clear path to Senior QA as we grow. - 2-3 years in QA or software testing, at least 1 year on AI/ML products. - Can write Python to automate tests and evaluate model outputs. - Have tested LLM prompts, outputs, hallucinations, and edge cases. - Know REST API testing, pytest, and basic CI/CD. - Think in failure modes and communicate findings clearly. - Bonus: exposure to vector DBs, RAG, or AI bias testing. - Tech Stack: Python pytest, REST APIs Postman GitHub Actions, LLM APIs LangChain Vector DBs, AWS Postgres Redis. Good to have: - DeepEval LLM evaluation framework (hallucination, relevancy, toxicity testing). - RAG evaluation framework specifically for RAG pipelines. Company Summary Tailored AI leverages cutting-edge AI technologies to provide bespoke solutions that drive innovation and efficiency across industries. Founded by alumni of IIT Bombay and IIM Ahmedabad, India's premier institutions for technology and management, we're committed to delivering excellence in AI-driven products and services. We're proud to be at the forefront of the AI revolution, empowering business leaders, small business owners, and entrepreneurs with AI solutions tailored to their unique needs. Our team consists of high-quality AI engineers and experts, ensuring that our clients receive the best possible solutions to their problems. We also have proprietary AI products aiding our services to ensure delivery at unmatched speeds. Our Services: - Generative AI: Sentiment analysis, translation, Intelligent content generation, chat, and voice bots. - Computer Vision: Document processing, image and video analysis, celebrity identification, content Moderation, Weapons Identification, QC. - Classical ML and Data Science: Predictive analytics, anomaly detection, recommendation algorithms, NLP. Haunted by the relentless surge in development costs hindering the creation of groundbreaking Tech Products, the visionary founders of Tailored AI embarked on a mission to tackle this formidable challenge head-on. Determined to empower global visionaries, they established Tailored AI with a singular purpose: to ensure that no dreamer's ambition to revolutionize the world would be derailed by the daunting question, 'Is this feasible? ' Driven by a fervent belief in the transformative power of innovation, Tailored AI's task force now operates tirelessly and with an unwavering dedication to transforming product ideas into high-impact Artificial Intelligence products quickly, and frugally.