Software Quality Engineer – Conversational AI / LLM Testing
Experience: 4-9 Years
Location : Noida / Kolkata
Domain : Airlines / Travel Technology
Job Summary
We are seeking a highly skilled Software Quality Engineer with hands-on experience in testing Conversational AI, LLM-based applications, chatbots, virtual assistants, and Agentic AI systems. The ideal candidate will have a strong automation and quality engineering background, deep understanding of how modern conversational systems operate, and solid experience within the Airline or Travel domain, particularly around Booking, Post-Booking, and Check-In workflows.
- 4+ years in software quality engineering, with demonstrable ownership of a product's quality
- Strong scripting ability in Python
- Hands-on experience testing LLM-based, NLP or conversational systems — chatbots, voice assistants, virtual agents, RAG or agentic applications.
- Practical understanding of how modern conversational AI works: prompting, context windows, function/tool calling, retrieval, and the characteristic ways these systems fail.
- Experience designing evaluation approaches for non-deterministic output — golden datasets, rubric or LLM-as-judge scoring, human review workflows, statistical rather than binary pass criteria.
- Strong Airline or travel domain knowledge (Booking, Post Booking & Check-In flows)
About Cognizant
Cognizant (Nasdaq: CTSH) is an AI Builder and technology services provider, bridging the gap between AI investment and enterprise value by building full-stack AI solutions for our clients. Our deep industry, process and engineering expertise enables us to build an organization’s unique context into technology systems that amplify human potential, drive tangible outcomes and keep global enterprises ahead in a fast-changing world. See how at cognizant.ai or @cognizant.
Things to know before you apply
- Work authorization: Cognizant will only consider applicants for this position who are legally authorized to work in Canada without requiring employer sponsorship, now or at any time in the future.
- Accommodations: If you have a disability that requires reasonable accommodation to search for a job opening or submit an application, please email [email protected] with your request and contact information.
- AI in hiring: We use artificial intelligence (AI) tools to help us screen and assess applications more efficiently. Our team performs additional human review and ultimately decides who moves forward in our hiring process.
- Open position: Unless otherwise stated, this job posting is for an open position on our team.
- Language proficiency: We ask that all candidates have basic English proficiency for company-wide communications purposes. For roles based in Quebec, professional English proficiency is required, as you’ll deliver services to and collaborate with stakeholders outside the province who may not speak French.
- Inclusion: Cognizant is an equal opportunity employer. Your application and candidacy will not be considered based on race, color, sex, religion, creed, sexual orientation, gender identity, national origin, disability, genetic information, pregnancy, veteran status or any other characteristic protected by federal, provincial or local laws.











