Tutorial Details

Download: Schedule of Events (PDF) subject to change
By Day - Selected
By Presenter
By Track
View My Agenda

Practical Statistics for User Research

Solutions to common questions in Usability Testing, Surveys, A/B Testing and Benchmarking

Make better decisions with user research. Is Design A faster than Design B? Do more users convert on the new design? Is our Net Promoter Score statistically better than last year? Learn to use and interpret the right statistical tests on small and large sample user-data using just Excel.


Tutorial by Jeff Sauro (Oracle), James Lewis (IBM)
Category:
Track:
General
Time:
9:00am to 5:00pm on Tuesday, June 21, 2011

About the Tutorial

DETAILED DESCRIPTION OF TUTORIAL

I. INTRO: The tutorial will begin with briefly reviewing the most common ways to measure usability and lead into fundamental concepts of statistics and terms (35 Min) a. Statistical Concepts, Terms and misconceptions and Quantifying User Research b. Understanding the role of chance in sampling data: intuition can be helpful and harmful II. Objective: Clearly understand both the limits and data available from small sample usability data through use of confidence intervals (20 Min) a. Confidence Intervals i. Interval estimation and point estimation ii. Confidence Interval around a Completion Rate (Adjusted Wald) iii. Exercise 1. Compute confidence intervals using excel and using the online calculator using instructor or participant provided data for a task completion rate (10 Min) iv. Confidence Interval around mean task time (t-statistic) (15 Min) 1. Dealing with Non-Normal Time data 2. The importance of graphing time-data 3. Mean, Median or Geometric Mean? 4. Exercise a. Compute confidence intervals using excel and using the online calculator using instructor or participant provided data for task times (10 Min)  

III. Objective: Be able to compare two interfaces or versions (A/B Testing) by showing statistical significance (e.g. Product A takes 20% less time to complete a task than Product B p