← Back to opportunities
💼
Innovative AI Quality Engineer Driving Evaluation Infrastructure Development
IDC • toronto, Canada
About the Role
Lead the charge in building next-gen AI systems as a Senior Quality Engineer. Design evaluation frameworks and ensure high-quality responses with a focus on automation and testing efficiency.
This role requires 6+ years of experience in software engineering, emphasizing testing infrastructure and ML evaluation. Shape evaluation standards while collaborating with product teams to translate quality criteria into measurable tests. Your contributions ensure that generative AI delivers accurate, relevant, and grounded responses in a groundbreaking technology environment.
Key Responsibilities:
• Design and build evaluation infrastructure for AI systems
• Create automated test suites for validating answer quality
• Develop systems for regression detection of quality issues
• Establish frameworks measuring response accuracy and citation correctness
• Monitor operational efficiency of AI execution processes
Requirements:
• 6+ years in software engineering with focus o...
This role requires 6+ years of experience in software engineering, emphasizing testing infrastructure and ML evaluation. Shape evaluation standards while collaborating with product teams to translate quality criteria into measurable tests. Your contributions ensure that generative AI delivers accurate, relevant, and grounded responses in a groundbreaking technology environment.
Key Responsibilities:
• Design and build evaluation infrastructure for AI systems
• Create automated test suites for validating answer quality
• Develop systems for regression detection of quality issues
• Establish frameworks measuring response accuracy and citation correctness
• Monitor operational efficiency of AI execution processes
Requirements:
• 6+ years in software engineering with focus o...
Ready to Join Through a Referral?
Apply now and get connected directly with the hiring team
Apply for this Position