Practical Statistics for User Research
Make better decisions with user research. Is Design A faster than Design B? Do more users convert on the new design? Is our Net Promoter Score statistically better than last year? Learn to use and interpret the right statistical tests on small and large sample user-data using just Excel.
- 9:00am to 5:00pm on Tuesday, June 21, 2011
About the Tutorial
DETAILED DESCRIPTION OF TUTORIAL
I. INTRO: The tutorial will begin with briefly reviewing the most common ways to measure usability and lead into fundamental concepts of statistics and terms (35 Min) a. Statistical Concepts, Terms and misconceptions and Quantifying User Research b. Understanding the role of chance in sampling data: intuition can be helpful and harmful II. Objective: Clearly understand both the limits and data available from small sample usability data through use of confidence intervals (20 Min) a. Confidence Intervals i. Interval estimation and point estimation ii. Confidence Interval around a Completion Rate (Adjusted Wald) iii. Exercise 1. Compute confidence intervals using excel and using the online calculator using instructor or participant provided data for a task completion rate (10 Min) iv. Confidence Interval around mean task time (t-statistic) (15 Min) 1. Dealing with Non-Normal Time data 2. The importance of graphing time-data 3. Mean, Median or Geometric Mean? 4. Exercise a. Compute confidence intervals using excel and using the online calculator using instructor or participant provided data for task times (10 Min)
III. Objective: Be able to compare two interfaces or versions (A/B Testing) by showing statistical significance (e.g. Product A takes 20% less time to complete a task than Product B p