Software Quality Engineer – Conversational AI / LLM Testing
Experience: 4-9 Years
Location : Noida / Kolkata
Domain : Airlines / Travel Technology
Job Summary
We are seeking a highly skilled Software Quality Engineer with hands-on experience in testing Conversational AI, LLM-based applications, chatbots, virtual assistants, and Agentic AI systems. The ideal candidate will have a strong automation and quality engineering background, deep understanding of how modern conversational systems operate, and solid experience within the Airline or Travel domain, particularly around Booking, Post-Booking, and Check-In workflows.
- 4+ years in software quality engineering, with demonstrable ownership of a product's quality
- Strong scripting ability in Python
- Hands-on experience testing LLM-based, NLP or conversational systems — chatbots, voice assistants, virtual agents, RAG or agentic applications.
- Practical understanding of how modern conversational AI works: prompting, context windows, function/tool calling, retrieval, and the characteristic ways these systems fail.
- Experience designing evaluation approaches for non-deterministic output — golden datasets, rubric or LLM-as-judge scoring, human review workflows, statistical rather than binary pass criteria.
- Strong Airline or travel domain knowledge (Booking, Post Booking & Check-In flows)
About Cognizant
Cognizant (Nasdaq: CTSH) is an AI Builder and technology services provider, bridging the gap between AI investment and enterprise value by building full-stack AI solutions for our clients. Our deep industry, process and engineering expertise enables us to build an organization’s unique context into technology systems that amplify human potential, drive tangible outcomes and keep global enterprises ahead in a fast-changing world. See how at cognizant.ai or @cognizant.
Additional employment information
Compensation information is accurate as of the date of this posting. Cognizant reserves the right to modify this information at any time, subject to applicable law.
Applicants may be required to attend interviews in person or by video conference. In addition, candidates may be required to present their current state or government issued ID during each interview.
Cognizant is an equal opportunity employer. Your application and candidacy will not be considered based on race, color, sex, religion, creed, sexual orientation, gender identity, national origin, disability, genetic information, pregnancy, veteran status or any other characteristic protected by federal, provincial or local laws.
