Big Cyber Monday Sale Limited Time 70% Discount Offer - Ends in 0d 00h 00m 00s - Coupon code: 70special

ISTQB CT-AI ISTQB Certified Tester AI Testing Exam Exam Practice Test

Page: 1 / 12
Total 120 questions

ISTQB Certified Tester AI Testing Exam Questions and Answers

Testing Engine

  • Product Type: Testing Engine
$37.5  $124.99

PDF Study Guide

  • Product Type: PDF Study Guide
$33  $109.99
Question 1

Which of the following describes the AI effect?

Choose ONE option (1 out of 4)

Options:

A.

The changing perception of what constitutes AI

B.

The ability of AI to learn from data itself

C.

The fact that mankind can build intelligent machines

D.

The ability of AI to defeat a human, e.g., in chess

Question 2

Which statement about using AI to analyze reported defects is MOST correct?

Choose ONE option (1 out of 4)

Options:

A.

ML models trained with critical defect tickets can identify defects that cause serious consequences.

B.

ML models can support duplicate defect identification when checking defect criticality.

C.

ML models can identify categories for a reported defect during assignment.

D.

ML models identify developers who should handle a defect based on ticket content.

Question 3

Which statement regarding pairwise testing in an AI-based automotive lane-keeping assist system is correct?

Choose ONE option (1 out of 4)

Options:

A.

Pairwise testing reduces the test suite so much that it is typically feasible within the available time.

B.

Pairwise testing can reduce testing efforts otherwise very high due to the large number of parameters.

C.

Pairwise testing only uses parameters directly influenced by the driver, otherwise the number of test cases becomes too large.

D.

Pairwise testing is usually insufficient because most defects arise only from interactions of many parameters.

Question 4

Which challenge to testing self-learning systems puts you at risk of a data attack?

Choose ONE option (1 out of 4)

Options:

A.

Inadequate specification of the operating environment

B.

Complex test environment

C.

Insufficient testing time

D.

Unexpected changes

Question 5

Which machine learning approach is most suitable for predicting customer purchase probability?

Choose ONE option (1 out of 4)

Options:

A.

Supervised learning (regression)

B.

Supervised learning (classification)

C.

Unsupervised learning

D.

Reinforcement learning

Question 6

"Splendid Healthcare" has started developing a cancer detection system based on ML. The type of cancer they plan on detecting has 2% prevalence rate in the population of a particular geography. It is required that the model performs well for both normal and cancer patients.

Which ONE of the following combinations requires MAXIMIZATION?

SELECT ONE OPTION

Options:

A.

Maximize precision and accuracy

B.

Maximize accuracy and recall

C.

Maximize recall and precision

D.

Maximize specificity number of classes

Question 7

Which ONE of the following approaches to labelling requires the least time and effort?

SELECT ONE OPTION

Options:

A.

Outsourced

B.

Pre-labeled dataset

C.

Internal

D.

Al-Assisted

Question 8

Which ONE of the following tests is MOST likely to describe a useful test to help detect different kinds of biases in ML pipeline?

SELECT ONE OPTION

Options:

A.

Testing the distribution shift in the training data for inappropriate bias.

B.

Test the model during model evaluation for data bias.

C.

Testing the data pipeline for any sources for algorithmic bias.

D.

Check the input test data for potential sample bias.

Question 9

An image classification system is being trained for classifying faces of humans. The distribution of the data is 70% ethnicity A and 30% for ethnicities B, C and D. Based ONLY on the above information, which of the following options BEST describes the situation of this image classification system?

SELECT ONE OPTION

Options:

A.

This is an example of expert system bias.

B.

This is an example of sample bias.

C.

This is an example of hyperparameter bias.

D.

This is an example of algorithmic bias.

Question 10

Which assignment of AI techniques to testing support is BEST?

Choose ONE option (1 out of 4)

Options:

A.

Classification for the optimization of regression test cases

B.

Probabilistic methods for the prediction of system failures

C.

Fuzzy logic for the generation of test cases

D.

Computational optimization techniques for defect prediction

Question 11

Which ONE of the following characteristics is the least likely to cause safety related issues for an Al system?

SELECT ONE OPTION

Options:

A.

Non-determinism

B.

Robustness

C.

High complexity

D.

Self-learning

Question 12

Which of the following are the three activities in the data acquisition activities for data preparation?

Options:

A.

Cleaning, transforming, augmenting

B.

Feature selecting, feature growing, feature augmenting

C.

Identifying, gathering, labelling

D.

Building, approving, deploying

Question 13

A mobile app start-up company is implementing an AI-based chat assistant for e-commerce customers. In the process of planning the testing, the team realizes that the specifications are insufficient.

Which testing approach should be used to test this system?

Options:

A.

Exploratory testing

B.

Static analysis

C.

Equivalence partitioning

D.

State transition testing

Question 14

Which ONE of the following is the BEST option to optimize the regression test selection and prevent the regression suite from growing large?

SELECT ONE OPTION

Options:

A.

Identifying suitable tests by looking at the complexity of the test cases.

B.

Using of a random subset of tests.

C.

Automating test scripts using Al-based test automation tools.

D.

Using an Al-based tool to optimize the regression test suite by analyzing past test results

Question 15

Which ONE of the following models BEST describes a way to model defect prediction by looking at the history of bugs in modules by using code quality metrics of modules of historical versions as input?

SELECT ONE OPTION

Options:

A.

Identifying the relationship between developers and the modules developed by them.

B.

Search of similar code based on natural language processing.

C.

Clustering of similar code modules to predict based on similarity.

D.

Using a classification model to predict the presence of a defect by using code quality metrics as the input data.

Question 16

Which of the following is a dataset issue that can be resolved using pre-processing?

Options:

A.

Insufficient data

B.

Invalid data

C.

Wanted outliers

D.

Numbers stored as strings

Question 17

A local business has a mail pickup/delivery robot for their office. The robot currently uses a track to move between pickup/drop-off locations. When it arrives at a destination, the robot stops to allow a human to remove or deposit mail. The office has decided to upgrade the robot to include AI capabilities that allow the robot to perform its duties without a track, without running into obstacles, and without human intervention. The test team is creating a list of new and previously established test objectives and acceptance criteria to be used in the testing of the robot upgrade. Which of the following test objectives will test an AI quality characteristic for this system?

Options:

A.

The robot must evolve to optimize its routing

B.

The robot must recharge for no more than six hours a day

C.

The robot must record the time of each delivery which is compiled into a report

D.

The robot must complete 99.99% of its deliveries each day

Question 18

Which statement describes factors related to test data that make testing AI-based systems difficult?

Choose ONE option (1 out of 4)

Options:

A.

Using the same implementation for data acquisition by data scientists and testers prevents defect masking

B.

Creating and managing large amounts of test data can be difficult, especially when it needs to be representative

C.

The input data must always be the same over time, especially in real-world systems

D.

Artificially generated data requires legal approval and must be sanitized and encrypted

Question 19

Which statement regarding data preparation in the ML workflow is correct?

Choose ONE option (1 out of 4)

Options:

A.

A key challenge in data transformation is the removal or correction of erroneous data.

B.

Since data preparation is time-consuming, all steps should be automated.

C.

One challenge of data gathering is obtaining high-quality data from multiple sources.

D.

Sampling is so well researched that it is no longer considered risky.

Question 20

Which of the following technologies for implementing AI is considered to be a reasoning technique?

Choose ONE option (1 out of 4)

Options:

A.

Deductive classifiers

B.

Linear regression

C.

Random Forest

D.

Genetic algorithms

Question 21

Which of the following descriptions of quality aspects of a data set is correct?

Choose ONE option (1 out of 4)

Options:

A.

The quality aspect "Incomplete data" describes the fact that data is missing, e.g., for a certain time interval.

B.

The quality aspect "Data not preprocessed" describes the fact that the collected data was recorded incorrectly.

C.

The quality aspect "Irrelevant data" describes the fact that irrelevant data does not affect the ML model.

D.

The quality aspect "Unbalanced data" describes the fact that the data used should be as up-to-date as possible.

Question 22

Arihant Meditation is a startup using Al to aid people in deeper and better meditation based on analysis of various factors such as time and duration of the meditation, pulse and blood pressure, EEG patters etc. among others. Their model accuracy and other functional performance parameters have not yet reached their desired level.

Which ONE of the following factors is NOT a factor affecting the ML functional performance?

SELECT ONE OPTION

Options:

A.

The data pipeline

B.

The quality of the labeling

C.

Biased data

D.

The number of classes

Question 23

You are developing a “flower” ML model… Which of the following describes an objection that you can NEGLECT in your risk assessment?

Choose ONE option (1 out of 4)

Options:

A.

The possible inputs for the ‘leaf’ and ‘flower’ ML models are so different that reuse has few advantages over new development.

B.

The probability of misclassification of the ML model "flower" is higher when it is reused than when it is developed from scratch.

C.

The classification behavior of the "flower" ML model is more difficult to understand when it is reused compared to when it is developed from scratch.

D.

The possible outputs of the "leaf" and "flower" ML models are so different that reuse has few advantages over new development.

Question 24

In a conference on artificial intelligence (Al), a speaker made the statement, "The current implementation of Al using models which do NOT change by themselves is NOT true Al*. Based on your understanding of Al, is this above statement CORRECT or INCORRECT and why?

SELECT ONE OPTION

Options:

A.

This statement is incorrect. Current Al is true Al and there is no reason to believe that this fact will change over time.

B.

This statement is correct. In general, what is considered Al today may change over time.

C.

This statement is incorrect. What is considered Al today will continue to be Al even as technology evolves and changes.

D.

This statement is correct. In general, today the term Al is utilized incorrectly.

Question 25

An airline has created an ML model to project fuel requirements for future flights. The model imports weather data such as wind speeds and temperatures, calculates flight routes based on historical routings from air traffic control, and estimates loads from average passenger and baggage weights. The model performed within an acceptable standard for the airline throughout the summer but as winter set in, the load weights became less accurate. After some exploratory data analysis, it became apparent that luggage weights were higher in the winter than in summer.

Which of the following statements BEST describes the problem and how it could have been prevented?

Options:

A.

The model suffers from drift and therefore should be regularly tested to ensure that any occurrences of drift are detected soon enough for the problem to be mitigated

B.

The model suffers from drift and therefore the performance standard should be eased until a new model with more transparency can be developed

C.

The model suffers from corruption and therefore should be reloaded into the computer system being used, preferably with a method of version control to prevent further changes

D.

The model suffers from a lack of transparency and therefore should be regularly tested to ensure that any progressive errors are detected soon enough for the problem to be mitigated

Question 26

Which of the following statements about explainable AI is correct?

Choose ONE option (1 out of 4)

Options:

A.

Interpretability refers to how easily users can determine whether the result provided by the AI-based system is correct

B.

Explainability refers to how easily the algorithms and training data needed to create the model can be determined

C.

According to The Royal Society, one reason for explainable AI is to increase user confidence in the system

D.

According to The Royal Society, one reason for explainable AI is to eliminate the need for risk and vulnerability assessments

Question 27

Which of the following statements about ML functional performance metrics is correct?

Choose ONE option (1 out of 4)

Options:

A.

Metrics used to measure clustering include intra-cluster metrics that measure the proximity of a cluster's data points.

B.

The R-squared metric indicates how well the model distinguishes between different classes based on the ROC curve.

C.

The silhouette coefficient describes how well the regression model fits the dependent variables.

D.

The receiver operating characteristic curve shows, depending on parameters, how well the model distinguishes between different clusters.

Question 28

Which statement about the property of the test environment for an AI-based system is correct?

Choose ONE option (1 out of 4)

Options:

A.

The test environment for an autonomous AI system needs to perform both test design and execution autonomously.

B.

The test environment for an AI system may need to include tools that can explain the decisions of the test object.

C.

The test environment for a self-learning AI system needs to adapt to and learn from the test object.

D.

The test environment for an AI-based multi-agent system needs to act deterministically.

Question 29

Which of the following statements about reinforcement learning is correct?

Choose ONE option (1 out of 4)

Options:

A.

The agent creates a model of the environment from labeled data during training

B.

The approach is suitable when the application doesnotrequire interaction with the environment

C.

The agent’s training is based on a reward function that rewards successful attempts

D.

From experience, the agent learns theoptimal reward function

Question 30

A startup company has implemented a new facial recognition system for a banking application for mobile devices. The application is intended to learn at run-time on the device to determine if the user should be granted access. It also sends feedback over the Internet to the application developers. The application deployment resulted in continuous restarts of the mobile devices.

Which of the following is the most likely cause of the failure?

Options:

A.

The feedback requires a physical connection and cannot be sent over the Internet

B.

Mobile operating systems cannot process machine learning algorithms

C.

The size of the application is consuming too much of the phone's storage capacity

D.

The training, processing, and diagnostic generation are too computationally intensive for the mobile device hardware to handle

Question 31

A wildlife conservation group would like to use a neural network to classify images of different animals. The algorithm is going to be used on a social media platform to automatically pick out pictures of the chosen animal of the month. This month’s animal is set to be a wolf. The test team has already observed that the algorithm could classify a picture of a dog as being a wolf because of the similar characteristics between dogs and wolves. To handle such instances, the team is planning to train the model with additional images of wolves and dogs so that the model is able to better differentiate between the two.

What test method should you use to verify that the model has improved after the additional training?

Options:

A.

Metamorphic testing because the application domain is not clearly understood at this point

B.

Adversarial testing to verify that no incorrect images have been used in the training

C.

Pairwise testing using combinatorics to look at a long list of photo parameters

D.

Back-to-back testing using the version of the model before training and the new version of the model after being trained with additional images

Question 32

Which performance metric is BEST suited to assess the quality of trained models detecting fraudulent credit card transactions?

Choose ONE option (1 out of 4)

Options:

A.

Sensitivity

B.

Accuracy

C.

F1 value

D.

Question 33

Which ONE of the following types of coverage SHOULD be used if test cases need to cause each neuron to achieve both positive and negative activation values?

SELECT ONE OPTION

Options:

A.

Value coverage

B.

Threshold coverage

C.

Sign change coverage

D.

Neuron coverage

Question 34

Which of the following options is an example of the concept of overfitting?

Choose ONE option (1 out of 4)

Options:

A.

A model for predicting academic performance was trained with data from students at one university. The model shows low predictive accuracy when applied to other universities.

B.

A model for the recognition of dogs was trained predominantly with pictures of dogs in parks. On pictures with other animals in parks, dogs are also falsely recognized.

C.

A previously trained model for recognizing cars is adapted and extended so that it can also identify the make of the car beyond its original function.

D.

A model for predicting IT system failures delivers too many false-negative predictions because the failures cannot be adequately explained via the log files used for training.

Question 35

Max. Score: 2

Al-enabled medical devices are used nowadays for automating certain parts of the medical diagnostic processes. Since these are life-critical process the relevant authorities are considenng bringing about suitable certifications for these Al enabled medical devices. This certification may involve several facets of Al testing (I - V).

I.Autonomy

II.Maintainability

III.Safety

IV.Transparency

V.Side Effects

Which ONE of the following options contains the three MOST required aspects to be satisfied for the above scenario of certification of Al enabled medical devices?

SELECT ONE OPTION

Options:

A.

Aspects II, III and IV

B.

Aspects I, II, and III

C.

Aspects III, IV, and V

D.

Aspects I, IV, and V

Question 36

A neural network has been designed and created to assist day-traders improve efficiency when buying and selling commodities in a rapidly changing market. Suppose the test team executes a test on the neural network where each neuron is examined. For this network, the shortest path indicates a "buy" and it will only occur when the one-day predicted value of the commodity is greater than the spot price by 0.75%. The neurons are stimulated by entering commodity prices and testers verify that they activate only when the future value exceeds the spot price by at least 0.75%.

Which of the following statements BEST explains the type of coverage being tested on the neural network?

Options:

A.

Threshold coverage

B.

Neuron coverage

C.

Sign-change coverage

D.

Value-change coverage

Page: 1 / 12
Total 120 questions