GradeHub App - Item analysis

Item analysis

GradeHub provides a summary (i.e., Item Matrix) and a detailed Item Analysis to analyze your test questions.

  1. Select the course and exam you want to view reports for
  2. Select the Item Matrix tab for a summary or the Item Analysis tab for a deeper look into your exam questions.
    1. Both reports analyze an exam by Answer Key. If you have more than one test key, use the answer key dropdown to review results for a specific key.
  3. Item Matrix
    1. The Item Matrix is a convenient way to see the quality and difficulty of your exam.
    2. The bar charts display the five highest and lowest performing questions on your exam.
      1. Exam questions must have a point-biserial correlation >0.3 to be classified as "Highest performing questions."
      2. Lowest performing questions have a point-biserial correlation <0.3 
    3. The Item Matrix detailed chart shows item discrimination using point-biserial correlation (vertical axis) and item difficulty analysis (horizontal axis) of the test questions.
    4. The item discrimination uses point-biserial correlation to check how well the test questions serve to discriminate between students with higher and lower levels of knowledge. In other words, it checks whether test questions are valid
    5. The item difficulty analysis expresses the percentage of students who answered each test question correctly. Item difficulty ranges from 0.0 (no students answered correctly; the question may have been too difficult) to 1.0 (all students answered correctly; the question may have been too easy)
  4. Item Analysis

    1. This item analysis contains response frequencies with the correct answers in bold

    2. If a significant number of students got the question wrong, the response is shaded red. 

    3. To analyze an item's quality, the table includes the point-biserial correlation (rpb), Cronbach's alpha with delete, and upper / lower 27% for each item.

      1. Items with a low point-biserial correlation are highlighted.

      2. Items where removing a given question causes test reliability of the overall (i.e., Cronbach's alpha) exam to go up (i.e., Cronbach's alpha with delete) are in red text

 


Did this help answer your question?

thumbs up
thumbs down

Thanks for the feedback! 🙏🏽