Senior QA Engineer (Gen AI Platform)

CDM Smith is seeking a Senior Quality Engineer to join our Digital Capital team. As a Senior Quality Engineer, you will be responsible for designing and implementing quality assurance processes to test AI models, applications, and infrastructure. The ideal candidate is a detail-oriented professional with a strong background in software testing and automation, coupled with a solid understanding of machine learning concepts.

Requirements

• Develop, implement, and maintain test strategies for AI models, APIs, and user-facing applications.
• Create detailed test plans, test cases, and scripts to ensure comprehensive test coverage across the code base.
• Test the accuracy, robustness, and model drift of various large language models.
• Build and maintain automated testing frameworks for backend systems, APIs, and user interfaces.
• Implement automated pipelines for model validation and regression testing during deployments.
• Conduct load, stress, and performance testing to ensure application and AI models handle scaling efficiently.
• Identify, log, and track bugs using tools like Azure DevOps.
• Work closely with developers to troubleshoot and resolve issues.
• Ensure compliance with data privacy regulations and ethical AI guidelines.
• Maintain detailed documentation of testing processes, tools, and results.