Exam CT-AI Topic 9 Question 10 Discussion

Actual exam question for ISTQB's CT-AI exam
Question #: 10
Topic #: 9
A ML engineer is trying to determine the correctness of the new open-source implementation *X", of a supervised regression algorithm implementation. R-Square is one of the functional performance metrics used to determine the quality of the model.
Which ONE of the following would be an APPROPRIATE strategy to achieve this goal?
SELECT ONE OPTION

Suggested Answer: C Vote an answer

A . Add 10% of the rows randomly and create another model and compare the R-Square scores of both the models.
Adding more data to the training set can affect the R-Square score, but it does not directly verify the correctness of the implementation.
B . Train various models by changing the order of input features and verify that the R-Square score of these models vary significantly.
Changing the order of input features should not significantly affect the R-Square score if the implementation is correct, but this approach is more about testing model robustness rather than correctness of the implementation.
C . Compare the R-Square score of the model obtained using two different implementations that utilize two different programming languages while using the same algorithm and the same training and testing data.
This approach directly compares the performance of two implementations of the same algorithm. If both implementations produce similar R-Square scores on the same training and testing data, it suggests that the new implementation "X" is correct.
D . Drop 10% of the rows randomly and create another model and compare the R-Square scores of both the models.
Dropping data can lead to variations in the R-Square score but does not directly verify the correctness of the implementation.
Therefore, option C is the most appropriate strategy because it directly compares the performance of the new implementation "X" with another implementation using the same algorithm and datasets, which helps in verifying the correctness of the implementation.

by Leila at Apr 11, 2026, 03:21 AM

Comments

Chosen Answer:
This is a voting comment (?) , you can switch to a simple comment.
Switch to a voting comment New
Nick name: Submit Cancel
A voting comment increases the vote count for the chosen answer by one.

Upvoting a comment with a selected answer will also increase the vote count towards that answer by one. So if you see a comment that you already agree with, you can upvote it instead of posting a new comment.

0
0
0
10