Classical Test Theory Quiz

Which of the following statements is correct about item facility in Classical Test Theory?

• A) Item facility is the proportion of students who score above the mean on the entire test.

• B) Item facility refers to the difficulty level of a test item, measured by the proportion of correct responses.

• C) A low item facility means that most students answered the item correctly.

• D) Item facility is unrelated to the total test score of students.

An item with a high item discrimination index (e.g., 0.75) is likely to:

• A) Be too easy for the majority of test takers.

• B) Differentiates well between high and low scorers on the test.

• C) Have a very low point-biserial correlation.

• D) Be irrelevant to the total score.

The point-biserial correlation coefficient is commonly used to assess:

• A) The relationship between two categorical variables.

• B) The relationship between a continuous variable and a binary variable (e.g., correct vs. incorrect answers).

• C) The reliability of a test based on multiple raters.

• D) The correlation between two continuous variables in a regression model.

Which of the following is a limitation of using simple percentage agreement to measure inter-rater reliability?

• A) It adjusts for chance agreement.

• B) It is easy to calculate.

• C) It does not account for the possibility of agreement occurring by chance.

• D) It works well when there are more than two raters.

Cohen's kappa is preferred over simple percentage agreement because:

• A) It gives a value that is unaffected by the number of raters.

• B) It accounts for agreement occurring by chance.

• C) It measures the strength of the relationship between two continuous variables.

• D) It is easier to interpret than simple percentage agreement.

A Pearson correlation coefficient of +0.90 between two variables indicates:

• A) A very weak, negative relationship.

• B) A moderate, positive relationship.

• C) A very strong, positive linear relationship.

• D) No relationship between the two variables.

What is the definition of the "mean" in a dataset?

• a) The middle value when the numbers are arranged in order

• b) The difference between the highest and lowest values

• c) The average of all the numbers in the dataset

• d) The value that occurs most frequently

In a given dataset, if the mean is 10 and the median is 15, what does this suggest about the distribution?

• a) The distribution is symmetric

• b) The distribution is negatively skewed

• c) The distribution is positively skewed

• d) There is an error in the calculation

What does the standard deviation measure in a dataset?

• a) The total number of observations

• b) The spread of the data points around the mean

• c) The midpoint value of the dataset

• d) The range of the dataset

Which of the following best describes a normal distribution?

• a) Data is clustered around the mean with no outliers

• b) The frequencies of the values form a bell-shaped curve

• c) All values are equally likely to occur

• d) The mean is always greater than the median