Student Comparative Test

Overview

Twenty-five students (20 High School and 5 Middle School) participated in a survey that asked them to provide their preference between Flexi and Khanmigo responses. 

Purpose

The purpose of this study is to compare student attitudes and perceptions of the quality of Flexi responses to Khanmigo's responses.

Methodology

The students took a survey that displayed the Flexi answer and the Khanmigo answer to 12 questions (6 math and 6 science). The questions were randomly positioned as option 1 or option 2 with no identifying characteristics that would indicate which answer came from Flexi and which answer came from Khanmigo. Questions were chosen to reflect as many avenues for analysis as possible. Categories considered were field, imagery, process, and complexity.

Key Takeaways

  • Students showed a clear preference for answers with imagery preferred responses with imagery in 81% of opportunities.
  • For non-image-based questions, students preferred Flexi in 60.1% of opportunities.
  • Students did not have a strong preference between the two options they were given over the 12 questions.
  • Students didn’t like responses that were too long or too short; 200-300 characters seems like the ideal response range for minimizing cognitive load.
  • Students had stronger negative responses to receiving shorter and more direct answers in science vs. math.