Lead SDET (Playwright with AI/ML Testing)

Greetings from VEST Software   About VTEST  Founded in 2015 in Pune, VTEST ( www.vtestcorp.com ) is a pure-play Software Testing services firm based out of Pune, India registered in Atlanta, US and Melbourne, Australia and recognized with Great Place to Work & NASSCOM certified. VTEST works with clients across the globe and employs Manual and Automation Testers to implement best testing practices for all types of testing. Our testers work Remote or from VTEST and client offices across India and international locations. We are developing an engagement system to enhance salespeople's workflows with AI, addressing their needs from start to finish. Our extensive experience in both AI and sales uniquely positions us to tackle this challenge. If you're excited about shaping how AI agents are tested and trusted in real-world enterprise environments, we’d love to hear from you. Job Skills: Automation Testing - Playwright with AI/ML Testing     Work Mode:  Pune/Bangalore/Remote   Qualifications:  Any Graduate  (Yes, at VTEST we accept ANY Graduate irrespective of Specialization, College, University. If you can TEST then apply to VTEST)   Years of Experience:  6+ years  Joining Availability - Immediate Employment Type - Permanent (Full Time) What We’re Looking For Min 6+ years of experience in QA engineering or test automation. Proficiency in writing test scripts using  TypeScript or  JavaScript . Hands-on experience with frameworks like  Cypress ,  Playwright, Pytest ,  Karate , or similar. Experience testing APIs and backend services, and familiarity with CI/CD tools like GitHub Actions or CircleCI. Understanding of data validation and end-to-end workflow testing. Comfortable solving open-ended or ambiguous problems in fast-paced environments. Able to independently manage and prioritize work while driving outcomes. What You’ll Do Define and implement the QA strategy across manual and automated testing, focusing first on backend and AI agent workflows.. Build and maintain automated test suites using modern tools (e.g., Pytest, Karate, Cypress, Playwright). Own quality checkpoints in our CI/CD pipelines and prevent regressions pre-release. Validate AI/LLM-based features with a focus on consistency, hallucination detection, and prompt-based output correctness. Collaborate closely with ML, platform, and product teams to build testable, observable, and trustworthy systems. Actively participate in design reviews, story definitions, and bug triage discussions. AI Testing Experience – Required for Success Prior Experience with testing AI systems is  important and will significantly contribute to success in this role. Experience testing AI/ML systems, including modern LLM applications, conversational AI, or intelligent agent workflows. Familiarity with  prompt engineering ,  non-deterministic output validation , and  hallucination detection . Ability to design and execute evaluation strategies to validate output correctness, stability, and relevance. Exposure to tools like  LangChain ,  Temporal ,  Weaviate , or  Pinecone  is a bonus, but not required. Why Join US: Opportunity to work on cutting-edge technologies and innovative products. Collaborative and growth-oriented team culture. Flexible work setup and professional development support Website   www.vtestcorp.com LinkedIn   https://www.linkedin.com/company/vtest/ Facebook   https://www.facebook.com/vtestcorp Instagram   https://www.instagram.com/vtest_software/