ISTQB Artificial Intelligence (AI) Tester

Become a certified AI tester! Learn a step-by-step approach to testing AI-based systems. The ISTQB Artificial Intelligence (AI) Tester certification extends understanding of quality engineering to AI and/or deep (machine) learning, most specifically testing AI-based systems and using AI in testing. The course syllabus concentrates on understanding the current state and expected trends of AI to design and execute test cases for AI-based systems

By the end of the course, you will be able to understand how AI can be used to support software testing. You will also be able to contribute to the test strategy for an AI-based system.

Target Audience:

ISTQB AI Tester is designed for:

  • Anyone involved in testing AI-based systems and/or AI for testing.
  • Testers, test analysts, data analysts, test engineers, test consultants, test managers, user acceptance testers, and software developers.
  • Anyone who wants a basic understanding of testing AI-based systems and/or AI for testing.
  • Project managers, quality managers, software development managers, business analysts, operations team members, IT directors, and management consultants working with an AI-based system.

Course Pre-requisites:

The candidate must hold the ISTQB Foundation certificate to undertake the ISTQB AI Tester course. A minimum of 12 months' testing experience is also recommended.

 

About Sue Atkins

As a self-confessed bug-magnet, quality advocate and risk nut, Sue Atkins has been active in the world of software testing and process improvement for over thirty years.

She has experience of software development from both the waterfall and Agile perspectives across a diverse range of sectors – from banking and telecoms to healthcare and retail.

Sue has a passion for training and loves to help others grow their skills in all dimensions of testing, quality and process improvement.  She has spoken at a number of conferences, is co-chair of the Scottish Testing Group and was a member of the programme committee for EuroSTAR 2022 – Europe’s largest Testing Conference.

 

  • Definitions of AI and AI effect, narrow, general and super AI, AI-based and conventional systems. AI technologies, AI development frameworks, hardware for AI-based systems, AI-as-a-Service, pretrained models, standards and regulations.
  • AI system flexibility, adaptability, autonomy, evolution, bias, ethics, side effects, transparency, and safety.
  • Forms of ML, workflow, forms of ML selection and factors involved, overfitting and underfitting.
  • data preparation, validation, quality issues and effects, labelling for learning.
  • AI performance metrics – limitations, selection, and benchmarking.
  • Neural networks and coverage measures.
  • AI-based systems specifications, test levels, test data, automation bias, documentation, concept drifts and test approaches.
  • Challenges in testing self learning and autonomous systems, including transparency, interpretability, and explainability. Test objective and acceptance criteria.
  • Test methods, techniques and selection for adversarial attacks, pairwise, back-to-back, A/B, metamorphic and experience-based testing.
  • Test environments for AI testing.
  • Using AI for defect analysis and prediction, test case generation and user interfaces.
  • Introduction to AI.
  • Quality characteristics for AI-based systems.
  • Machine Learning (ML) overview.
  • ML data.
  • ML functional performance metrics.
  • ML, neural networks, and testing.
  • Testing AI-based systems overview.
  • Testing AI-specific quality characteristics.
  • Methods and techniques for the testing of AI-based systems.
  • Test environments for AI-based systems.
  • Using AI to analyse reported defects and test case generation.
  • Using AI for the optimisation of regression test suites.
  • Using AI for defect prediction.
  • Using AI to test through the graphical user interface (GUI).

The exam is included in the course price. You will receive a voucher at the end of the course.

About the exam:

The Advanced Level Test Automation Engineer exam is comprised of 40 multiple choice questions, with a pass mark grade of 65% to be completed within 90 minutes. The examination is separate from the 3 day course and sat on a different day.

This course is conducted and delivered by our partner Planit.

Other relevant courses

ISTQB Foundation v4.0 Certificate
5. February
3 days
Classroom On Demand Virtual
IREB CPRE Foundation Level
24. February
3 days
Classroom Virtual
ISTQB Agile Tester
13. February
2 days
Classroom Virtual
ISTQB Advanced Level Test Manager
10. March
4 days
Classroom On Demand Virtual