We are looking for an experienced AI Assurance Quality Engineer to ensure the quality, reliability, and performance of AI-powered conversational systems, including chatbots, virtual assistants, RAG applications, and agentic AI solutions.
Key Requirements
✅ 4+ years of Software Quality Engineering experience
✅ Strong Python scripting skills with experience building test automation tools/frameworks
✅ Hands-on experience testing:
- LLM-based applications
- Conversational AI systems
- Chatbots & Virtual Assistants
- RAG and Agentic AI solutions
✅ Strong understanding of:
- Prompt Engineering
- Context Management
- Function/Tool Calling
- Retrieval Mechanisms
- AI Failure Modes & Quality Risks
✅ Experience evaluating non-deterministic AI outputs using:
- Golden Datasets
- Rubric-Based Assessments
- LLM-as-a-Judge Frameworks
- Human Review Workflows
- Statistical Quality Metrics
Mandatory Domain Experience
✈️ Strong Airline/Travel Industry expertise in:
- Amadeus Altéa, Sabre, or Navitaire
- PSS / Reservation Systems
- GDS & NDC
- IATA Fare Construction
- Fare Rules & Ancillaries
- IROPS
- Payments & Refunds
CogAE106
About Cognizant
Cognizant (Nasdaq: CTSH) is an AI Builder and technology services provider, bridging the gap between AI investment and enterprise value by building full-stack AI solutions for our clients. Our deep industry, process and engineering expertise enables us to build an organization’s unique context into technology systems that amplify human potential, drive tangible outcomes and keep global enterprises ahead in a fast-changing world. See how at cognizant.ai or @cognizant.
Things to know before you apply
- Work authorization: Cognizant will only consider applicants for this position who are legally authorized to work in Canada without requiring employer sponsorship, now or at any time in the future.
- Accommodations: If you have a disability that requires reasonable accommodation to search for a job opening or submit an application, please email [email protected] with your request and contact information.
- AI in hiring: We use artificial intelligence (AI) tools to help us screen and assess applications more efficiently. Our team performs additional human review and ultimately decides who moves forward in our hiring process.
- Open position: Unless otherwise stated, this job posting is for an open position on our team.
- Language proficiency: We ask that all candidates have basic English proficiency for company-wide communications purposes. For roles based in Quebec, professional English proficiency is required, as you’ll deliver services to and collaborate with stakeholders outside the province who may not speak French.
- Inclusion: Cognizant is an equal opportunity employer. Your application and candidacy will not be considered based on race, color, sex, religion, creed, sexual orientation, gender identity, national origin, disability, genetic information, pregnancy, veteran status or any other characteristic protected by federal, provincial or local laws.
