Technical Test Services Evaluation Manager, AI Tester Accreditation Programme (AI TAP)

Job description

[What the role is] About Us AI Verify Foundation is an open-source initiative and a wholly owned subsidiary under the Infocomm Media Development Authority (IMDA), dedicated to advancing trustworthy AI. We develop and maintain open-source tools for evaluating LLM applications (Project Moonshot) and predictive ML models (AI Verify Toolkit). Our mission is to empower developers, data scientists, and organisations to build responsible, transparent, and reliable AI systems. The AI Verify Foundation's AI Tester Accreditation Programme (AI TAP) is the first programme of its kind in Asia, accrediting testing service firms that can technically assess AI systems for safety, reliability, and governance risks. Accredited firms are recognised by AI Verify Foundation as having possessed the technical competencies and operational readiness to evaluate AI systems against a defined scope to provide AI system developers, deployers, and end users with greater confidence in independently assessed AI. You will be part of a dynamic team driving the growth of Singapore's AI assurance ecosystem. In this role, you will lead the end-to-end accreditation process for AI testing service providers, evaluate their technical and operational capabilities, and work closely with industry stakeholders to shape emerging standards for AI technical testing. You will also engage with businesses seeking qualified AI assurance testers, connecting them with accredited firms and supporting the broader development of a trusted AI assurance marketplace. You will collaborate with local and international industry partners, government agencies, and internal teams to continuously refine the programme's assessment scope and standards, ensuring AI TAP remains credible, rigorous, and relevant in a rapidly evolving AI landscape. [What you will be working on] Lead and manage the full accreditation lifecycle for AI testing service providers, including application review, technical evaluation, accreditation decisions, and annual renewals. Evaluate applicant firms against defined accreditation criteria, covering technical testing competency. Assess firms' claimed AI testing services against established guidelines and frameworks (e.g., IMDA Starter Kit for Testing LLM-Based Applications for Safety and Reliability). Engage with industry stakeholders, testing service providers, and AI system developers and deployers to understand evolving needs and refine the programme's assessment scope and standards. Develop and maintain accreditation documentation, evaluation rubrics, and assessment guidelines to ensure consistency and rigour across all accreditation reviews. Monitor developments in AI testing methodologies, safety frameworks, and governance standards to ensure the programme remains current and credible. [What we are looking for] (A) Academic Bachelor's degree in Computer Science, Artificial Intelligence, Information Technology, Engineering, or a related field. Professional certifications in AI governance (e.g., AIGP: Artificial Intelligence Governance Professional) or GenAI / Agentic AI testing are advantageous. (B) Experience Minimum of 3-5 years of experience in GenAI / Agentic AI systems evaluation, technical testing, software quality assurance, or a related field. Strong working knowledge of AI system development lifecycles, including Generative AI and LLM-based applications, and associated safety and reliability considerations. Demonstrated experience in designing or managing accreditation, certification, or audit programmes is highly desirable. Familiarity with AI governance frameworks, responsible AI principles, and technical testing standards (e.g., IMDA AI testing guidelines, ISO/IEC AI standards). Experience engaging with senior stakeholders across industry, government, and technical communities. (C) Other Key Areas of Consideration Strong analytical and evaluative skills, with the ability to assess complex technical claims and make well-reasoned accreditation judgements. Excellent interpersonal and communication skills, with the ability to engage effectively with both technical experts and non-technical stakeholders (including C-suite executives and policy makers). Self-motivated and adaptable, with the ability to operate effectively in a nascent and evolving programme environment where standards and processes are still being shaped. Commercially aware, with an understanding of the AI testing services market and the business considerations of testing service providers. Plugged into the AI, tech, and assurance ecosystem in Singapore, with a genuine interest in advancing the responsible development and deployment of AI. Strong written and verbal communication skills, including the ability to produce clear, well-structured evaluation reports and programme documentation. Position will be commensurate with the candidate’s qualifications and experience. Please note that only shortlisted candidates will be notified. #LI-NA1