Personas and Analytics: A Comparative User Study of Efficiency and Effectiveness for a User Identification Task

Personas are a well-known technique in human-computer interaction. However, there is a lack of rigorous empirical research evaluating personas relative to other methods. 

In this 34-participant experiment, my colleagues and I compare a persona system and an analytics system, both using identical user data, for efficiency and effectiveness for a user identification task. 

Results show that personas afford a faster task completion than the analytics system, as well as outperforming analytics with significantly higher user identification accuracy. 

girl_on_phone
Personas outperform Analytics for a User Identification Task

Qualitative analysis of think-aloud transcripts shows that personas have other benefits regarding learnability and consistency

However, the analytics system affords insights and capabilities that personas cannot due to inherent design differences. 

Findings support the use of personas to learn about users, empirically confirming some of the stated benefits in the literature, while also highlighting the limitations of personas that may necessitate the use of accompanying methods.

Read full research

Salminen, J., Jung, S.G., Chowdhury, S. Şengün, S., and Jansen, B. J. (2020) Personas and Analytics: A Comparative User Study of Efficiency and Effectiveness for a User Identification Task. ACM CHI Conference on Human Factors in Computing Systems (CHI’20), Honolulu, HI, USA. 25–30 April, 1-13.

More persona research

Is More Better?: Research Concerning the Impact of Multiple Photos on Perception of Persona Profiles

Research on Personas: Personas and Scenarios as a Methodology for Information Sciences

Automatic Persona Generation for Online Content Creators: Conceptual Rationale and a Research Agenda

Research Concerning: Are Personas Done? Evaluating their usefulness in the age of digital analytics

Scroll to Top