In a user experiment, we tried out a novel data collection approach consisting of combining surveys with the think-aloud method. We coin the phrase “think-aloud survey method”, where participants think-aloud while completing a questionnaire.
We analyzed the transcripts and found that the think-aloud survey provides deeper insights into the reasoning behind the participants’ Likert scale choices and responses to open-ended questions, along with an enhanced understanding of the tasks and prompting the participants to explicate their choices. All resulting in more insights for design.
The think-aloud survey method further offers other insights into usability issues and encourages the participants to provide system
improvement proposals.
The think-aloud survey method is useful for researchers and practitioners applying a large number of usability evaluations and wanting to dig deeper into the motivations for choice.
Nielsen, L., Salminen, J., Jung, S.G., and Jansen, B. J. (2021) Think-Aloud Surveys – A Method for Eliciting Enhanced Insights During User Studies, INTERACT 2021 18th IFIP TC13 International Conference on Human–Computer Interaction. 30 Aug. – 3 Sept. Bari, Italy.