upa - home page JUS - Journal of usability studies
An international peer-reviewed journal

The Combined Walkthrough: Measuring Behavioral, Affective, and Cognitive Information in Usability Testing

Timo Partala and Riitta Kangaskorte

Journal of Usability Studies, Volume 5, Issue 1, Nov 2009, pp. 21 - 33

Article Contents


Bradley, M. M., & Lang, P. J. (1994). Measuring emotions: the self-assessment manikin and the semantic differential. Journal of Behavioral Therapy and Experimental Psychiatry, 25(1), 49-59.

Dillon, A. (2001). Beyond usability: process, outcome and affect in human-computer interactions. Canadian Journal of Library and Information Science, 26(4), 57-69.

Edwardson, M. (1998). Measuring emotions in service encounters: An exploratory analysis. Australasian Journal of Market Research, 6(2), 34-48.

Ekman, P. (1992). An argument for basic emotions. Cognition and Emotion, 6(3/4), 169-200.

Frijda, N. H. (1986). The emotions. New York: Cambridge University Press.

Frøkjær, E., Hertzum, M., & Hornbæk, K. (2000). Measuring usability: Are effectiveness, efficiency and satisfaction really correlated? In Proceedings of CHI 2000: vol. 1. (pp. 345-352).The Hague, The Netherlands. ACM Press.

Hassenzahl, M., Platz, A., Burmester, M., & Lehner, K. (2000) Hedonic and ergonomic quality aspects determine a software's appeal. In Proceedings of CHI 2000: vol 1. (pp. 201-208).The Hague, The Netherlands. ACM Press.

Hassenzahl, M., & Tractinsky, N. (2006). User Experience - a research agenda. Behavior & Information Technology, 25(2), 91-97.

Hazlett, R. L., & Benedek, J. (2007). Measuring emotional valence to understand the user's experience of software. International Journal of Human-Computer Studies, 65(4), 306-314.

Hornbæk, K. (2006). Current practice in measuring usability: Challenges to usability studies and research. International Journal of Human-Computer Studies, 64(2), 79-102.

Hornbæk, K., & Law, E. L. (2007). Meta-analysis of correlations among usability measures. In Proceedings of CHI 2007: vol 1. (pp.617-626). San Jose, CA. ACM Press.

Isen, A. M. (2006). Positive affect and decision making. In M. Lewis & I. Haviland (Eds.) Handbook of emotions (pp. 417-435). New York, NY: Guilford Press.

ISO 9241-11. (1998). Ergonomic requirements for office work with visual display terminals (VDTs) – Part 11: Guidance on usability. ISO/IEC.

Kirakowski, J. (1996). The software usability measurement inventory, background and usage. In P.W. Jordan, B. Thomas, B.A. Weerdmeester & I.L. McClelland (Eds.), Usability Evaluation in Industry (pp.169-178). London, UK: Taylor & Francis.

Mahlke, S., Minge, M., & Thüring, M. (2006). Measuring multiple components of emotions in interactive contexts. In Proceedings of CHI 2006: vol. 2. (pp. 1061-1066). Montreal, Canada. NY. ACM Press.

Mahlke, S., & Thüring, M. (2007). Studying antecedents of emotional experiences in interactive contexts. In Proceedings of CHI 2007: vol. 1. (pp. 915-918). San Jose, CA. ACM Press.

Matera, M., Costabile, M.F., Garzotto, F., & Paolini, P. (2002). SUE inspection: An effective method for systematic usability evaluation of hypermedia. IEEE Transactions on Systems, Man and Cybernetics- Part A: Systems and Humans, 32(1), 93-103.

Nielsen, J. (1994). Heuristic evaluation. In J. Nielsen and R. L. Mack (Eds.), Usability Inspection Methods(pp. 25-64). New York: John Wiley and Sons, Inc.

Nielsen, J., & Levy, J. (2003). Measuring usability: Preference vs. performance. Communications of the ACM, 37(4), 66-75.

Osgood, C.E. (1952). The nature and measurement of meaning. Psychological Bulletin, 49, 197-237.

Partala, T. (2002). The combined walkthrough: Combining cognitive, behavioral, and cognitive methods in human-computer interaction. In Proceedings of WWDU 2002: Vol. 1 (pp. 458-460). Berlin: ERGONOMIC Institut für Arbeits- und Sozialforschung.

Partala, T., & Surakka, V. (2003). Pupil size variation as an indication of affective processing. International Journal of Human-Computer Studies. 59(1-2), 185-198c

Partala, T., & Surakka, V. (2004). The effects of affective interventions in human-computer interaction. Interacting with Computers, 16(2), 295-309.

Partala, T., Surakka, V., & Vanhala, T. (2006). Real-time estimation of emotional experiences from facial expressions. Interacting with Computers 18(2), 208-226.

Picard, R. (1997). Affective computing. Cambridge, MA: MIT Press.

Sauro, J., & Dumas, J. S. (2009). Comparison of three one-question, post-task usability questionnaires. In Proceedings of CHI 2009: vol. 1. (pp.1599-1608). Boston, MA. New York, NY. ACM Press.

Ward R. D. (2005). An analysis of facial movement tracking in ordinary human-computer interaction. Interacting with Computers, 16(5), 879-896.

Wharton, C., Rieman, J., Lewis, C., & Polson, P. (1994). The cognitive walkthrough method: A practitioner's guide. In J. Nielsen and R. L. Mack (Eds.) Usability Inspection Methods (pp. 105-140). New York: John Wiley & Sons.