. . . . ..... ...... ..... ..... ..... ...... ..... ..... ..... ...... . . . . . . . . . . . . . . . . . .... ..... .... ..... .... .... ..... .... ..... .... ..... .... ..... 12 Completion Rates...... ................. ................ ................. . . . .... ... ... .... ... .... ... ... 172 Criticisms of the Binomial Model for Problem Discovery.... ......... .... 172 Expanded Binomial Models. . . . . . . . . . He lives with his wife and three children in Denver, CO. Dr. James R. (Jim) Lewis is a senior human factors engineer (at IBM since 1981) with a current focus on the design and evaluation of speech applications and is the author of Practical Speech User Interface Design. . . . . . . . . . . . . . . . . . . Increasingly, usability practitioners and user researchers are expected to quantify the benefits of their efforts. . . . . . . 105 Why Do We Care?. . ....... ...... ...... ..... 280 Central Limit Theorem. . . McNemar Wald confidence exact test Y N interval (ch 5) (ch 3) Adjusted Wald confidence 1-sample 1-sample interval for z-test binomial difference in (ch 4) (ch 4) matched proportions (ch 5) FIGURE 1.2 Decision map for analysis of discrete-binary data (e.g., completion rates or conversion rates). . . . . . It includes both standard statistical output (p-values and confidence intervals) and some more user- friendly output that, for example, reminds you how to interpret that ubiquitous p-value and that you can paste right into reports. 9 Sample Sizes. . . And by having access to our ebooks online or by storing it on your computer, you have convenient answers with Quantifying The User Experience Practical Statistics For User Research . ..... ..... .... 160 Some History: The 1980s. . . . . . . . . . Often the first collision a user researcher has with statistics is in planning sample sizes. . . . . . . . . Finding the appropriate sample size for a study (Chapters 6 and 7). . . . . . . . . . . . . . . . . . .... ... .... ... .... 254 On One Hand. . . . . . . ..... ..... ...... ... 192 SUS (Software Usability Scale). . . . . . . . . What Users Do: Top Task Analysis. . . . . . . . . . . . 248 Should you Always Conduct a Two-Tailed Test?. . . . eBook includes PDF, ePub and Kindle version. . . . . . . . . . . . . . . . . No part of this publication may be reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopying, recording, or any information storage and retrieval system, without permission in writing from the Publisher. . . . . . . . . . . To my sons, Michael and Patrick – it’s safe to stick your heads in the office again. . . . . . . . . . ........ ........ ........ ........ ........ ........ . . We will be glad if you will be back again and again. . . . . . . . . Jim is an internationally recognized expert in usability testing and measurement, contributing (by invitation) the chapter on usability testing for the 3rd and 4th editions of the Hand- book of Human Factors and Ergonomics and presenting tutorials on usability testing and metrics at various professional conferences. ........ ........ ........ ........ ........ ........ . . . . . . . . . . . ..... ..... .... ..... ... 33 Confidence Interval Around a Median. . . . . . . . . . . . . . . . 215 UME (Usability Magnitude Estimation). .... .... .... ... .... .... ... .... .... ... .... .... .... . . . . . . . . . . . . . . . . . . . . . . . However, usability practitioners . . . . . . . . . 210 Post-Task Questionnaires................. ...................... .............. 212 ASQ (After-scenario Questionnaire). . . . . . . . . . . . . . . . . . . . Suppose you have some conversion-rate data and you just want to understand how precise the estimate is. . . . . ...... ....... . . . . . . . . . . . . . . . . . . . . . . . . [256] 10: Getting More Information [269] Two-Sample t 5: Between-Subjects Comparison (Two-Sample t-Test) [68] ANOVA or Multiple Two-Sample t 5: Between-Subjects Comparison (Two-Sample t-Test) [68] 9: What If You Need to Run More Than One Test? . . . . . . . . . . . . . . . . . . . . . . . . . . . He is a member of the Usability Professionals Association (UPA), the Human Factors and Ergonomics Society (HFES), the Association for Psychological Science (APS) and the American Psychological Associa- tion (APA), and is a 5th degree black belt and certified instructor with the American Taekwondo Association (ATA). . . . . . .... ... .... ... ... .... ... ... 157 Reconciling the “Magic Number 5” with “Eight is not Enough”. . . . . . . . . . . . . . . .... .... ... .... .... .... ... .... .... .... ... .... .... .... ... 174 Key Points from the Chapter. . . Jeff has published over fifteen peer-reviewed research articles and is on the editorial board of the Journal of Usability Studies. . . . . . . . . . . . . 131 Key Points from the Chapter. . . . . . . . . . . . . . . . . . in Engineering Psychology, and an M.M. . . . ........ ........ ........ ..... 24 Confidence Interval for a Problem Occurrence. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Better to search instead for a particular book title, author, or synopsis. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 185 Introduction. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 217 Experimental Comparisons of Post-task Questionnaires.... ........... ..... 219, Contents xi Questionnaires for Assessing Perceived Usability of Websites. . . . . . . . . . . . . . . . ........ ........ ........ ........ ........ ........ ....... 13 Task Time.... ....... ........ ....... ........ ....... ....... ........ ....... . . . . . . . . . . . . . . . . . . . . . . . . To get started finding Quantifying The User Experience Practical Statistics For User Research , you are right to find our website which has a comprehensive collection of manuals listed. . . . . . . . . 16 Comments and Open-ended Data. . . . . . . . . . . . . . . . . . quantifying the user experience practical statistics for user research Sep 13, 2020 Posted By C. S. Lewis Public Library TEXT ID e704f3fa Online PDF Ebook Epub Library and james r lewis review article quantifying the user experience practical statistics for user research by jeff sauro and james r lewis share on author alberto sampaio . . . . . . . . . . . . . . . . . . Estimating a parameter with a specified precision (e.g., if your goal is to estimate completion rates with a margin of error of no more than 5%, or completion times with a margin of error of no more than 15 seconds). . . Problem discovery, specifically the number of users you need in a usability test to find a specified percentage of usability problems with a specified probability of occurrence. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 282 Margin of Error. . . . . . . . . . . . To find the appropriate section in each chapter for the methods depicted in Figures 1.3 and 1.4, consult Table 1.3. . . . . . . . . . This takes us to the “Different Users in Each Group” box—we have different users in each group so we select “Y.” 4. . . . . . . See the Appendix for a discussion of the distinction between discrete and continuous data. . . . . . . . . . . . . . Conversion-rate data are binary-discrete, so start with the decision map in Figure 1.2. . . . Although there are many “rules of thumb” on how many users you should test or how many customer responses you need to achieve your goals, there really are precise ways of finding the answer. . . . . It is available for purchase online at www.measuringusability.com/ products/expandedStats. . . . . . . . . in Information Manage- ment & Technology and B.S. . . ......... ......... ...... 169 Other Statistical Models for Problem Discovery. At “Binary Data?,” select the “N” path. . Notices Knowledge and best practice in this field are constantly changing. . . . . . . . . . 232 References..... ....... ...... ....... ....... ....... ....... ....... ....... ....... 236 CHAPTER 9 Six Enduring Controversies in Measurement and Statistics. . . . . . . . . . At “Testing Against a Benchmark?,” also take the “N” path. . 251 On the Other Hand. . . . . . . . . . . . . . 2. . . . . . ..... ..... ...... ..... ..... ..... ..... ..... ... 173 Capture–recapture Models. . . . . . . . . . . . .... .... .... .... ..... .... .... .... .... .... ..... .... .. 274 Sampling............................ .................................... 274 Measuring Central Tendency. . . . . . . . . . . . . What procedure should you use? .... ... .... .... ... .... .... .... ... .... .... ... .... .... 16 Key Points from the Chapter. 291, Acknowledgments Many thanks to Elisa Miller, Lynda Finn, Michael Rawlins, Barbara Millet, Peter Kennedy, John Romadka and Arun Martin for their thoughtful reviews of various draft chapters of this book. To the fullest extent of the law, neither the Publisher nor the authors, contributors, or editors assume any liability for any injury and/or damage to persons or property as a matter of products liability, negligence or otherwise, or from any use or operation of any methods, products, instructions, or ideas contained in the material herein. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2. Another part is due to our selecting the best procedures for practical user research, focusing on procedures that work well for the types of data and sample sizes you’ll likely encounter. . . . . . . . . . . . . . . . . . . . . . . ...... ...... ..... .... 21 Exact Confidence Interval. . . . . . . 167 Origin of the Binomial Probability Formula. . . . 15 Clicks, Page Views, and Conversion Rates. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Because you’re planning a comparison of two independent sets of task times, start with the decision map in Figure 1.3.At “Comparing Groups?,” select the “Y” path. . . . . 283 Significance Testing and p-Values. . . Quantifying the User Experience: Practical Statistics for User Research offers a practical guide for using statistics to solve quantitative problems in user research. . . . . . . .. .. .. .. .. .. .. .. .. .. .. .. .. .. .. .. .. .. .. .. .. .. .. .. 157, Contents x What is a Reasonable Problem Discovery Goal?. . . . . . . . . . . . . . . . . . . . Like this book? . . . . . 16 Requirements Gathering. . . . . . . . . . . . . in Music Theory and Composition. . . . . . . . . . . . . . . . . . . . . . . . . . . . You Don’t Have to Do the Computations by Hand We’ve provided sufficient detail in the formulas and examples that you should be able to do all computations in Microsoft Excel. . 161 The Derivation of the “Magic Number 5”. . . . . . . . . . . . . . . . . . . . . . . . . . By comparing data we mean comparing data from two or more groups (e.g., task completion times for Products A and B; see Chapter 5) or comparing your data to a benchmark (e.g., is the completion rate for Pro- duct A significantly above 70%; see Chapter 4). . We deeply appreciate their time and helpful comments. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Continuing on that path, the final decision depends on whether there are two groups to compare or more than two groups. . . . . . . . . . . . . . . . . . . . . 10 Representativeness and Randomness..... ....... ...... ....... ...... ....... . XD. . . . . . . . . . Find more similar flip PDFs like Quantifying the User Experience: Practical Statistics for User Research. . . . . Jeff Writing a book takes a big chunk out of your life. . . . . . . . . . . . . . . . . . . . . . A comprehensive discussion of standardized usability questionnaires (Chapter 8). . . quantifying the user experience practical statistics for user research Sep 23, 2020 Posted By Arthur Hailey Media Publishing TEXT ID e704f3fa Online PDF Ebook Epub Library view usability and design as qualitative activities which do not require attention to formulas and numbers qmp1xlxp6bwi book quantifying the user experience practical . . . . . . . . . . . . . Because the goal is to compare data, start with the sample size decision map in Figure 1.3. References Lewis, J.R., Sauro, J., 2012. . . . . . . . . . . The first decision point comes from the type of data you have. . . . . . . . . . . . . . quantifying the user experience practical statistics for user research Oct 02, 2020 Posted By Jeffrey Archer Public Library TEXT ID e704f3fa Online PDF Ebook Epub Library statistics for user research 2 by sauro jeff lewis james r isbn 9780128023082 from amazons book store everyday low prices and free delivery on eligible orders quantifying . . . . . . . . . . . . . . . . . . . . . Binary data? . . . . 2. . . . AkagawaPublishing TEXT ID 270d72bb Online PDF Ebook Epub Library the book presents a practical guide on how to use statistics to solve common quantitative problems that arise in user research it addresses questions users face every day . . . . 128 Sample Size Estimation for McNemar Exact Tests (Matched Proportions). If they don’t, someone else will—unfortunately that someone else might not use the right metrics or methods. The Usability Professionals Association salary survey. . 224 Other Questionnaires of Interest.... .... ..... ..... .... ..... ..... .... ..... .... . . . . . . . . . . . . . 256, Contents xii On the Other Hand. . . .... ... ... ... .... ... ... ... ... .... ... ... ... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . this is the first one which worked! . . . . . . . . . . . . . . . . . . 20 Confidence Interval for a Completion Rate. . . . . . Converting Continuous Ratings to Discrete....... 52 Comparing a Task Time to a Benchmark. . . . . . . . . . . . . . 149 Adjusting Small Sample Composite Estimates of p. .... .... ... .... .... .... 149 Estimating the Number of Problems Available for Discovery and the Number of Undiscovered Problems. • Each chapter ends with a list of key points and references. . . . . . ..... ...... ...... ..... ...... ..... ...... ..... ...... ..... ...... ...... . . . . . If there is a survey it only takes 5 minutes, try any survey which works for you. . . . . . . . . . . . . . . . . . . . . . . . . . . . Quantifying the User Experience: Practical Statistics for User Research offers a practical guide for using statistics to solve quantitative problems in user research. . . . . 272 References....... ....... ....... ....... ....... ...... ....... ....... ....... ..... 272 Appendix: A Crash Course in Fundamental Statistical Concepts....... .................. .... 273 Introduction. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . For fifteen years he’s been conducting usability and statistical analysis for companies such as PayPal, Walmart, Autodesk and Kelley Blue Book or working for companies such as Oracle, Intuit and General Electric. . The top 20% of U.S, taxpayers pay 68% of all taxes [pdf] Here are three examples of how the Pareto Principle applies to user research. . . . . . . . . . . . . . . . . . . We’ve created an Excel calculator that performs all the computations covered in this book. . . . . We stop at the “N − 1 Two-Proportion Test and Fisher Exact Test” (Chapter 5). . . . . . . . . . . . . . . . . . . Quantifying the User Experience. . Y1 - 2013/3/19. . . . . . . . . . Available at http://www.usabilityprofessionals .org/usability_resources/surveys/SalarySurveys.html (accessed July 29, 2011). In order to read or download quantifying the user experience practical statistics for user research ebook, you need to create a FREE account. . . . . . . . . lol it did not even take me 5 minutes at all! . . . Large sample? . . 54 Key Points from the Chapter. . . . . 229 NPS (Net Promoter Score). Y multiple benchmark? . . . . . . . . . . . . . . . 3. 21 Wald Interval: Terribly Inaccurate for Small Samples. . . . . Table 1.3 Chapter Sections for Methods Depicted in Figures 1.3 and 1.4 Method Chapter: Section [Page] 2 Proportions 6: Sample Size Estimation for Chi-Square Tests (Independent Proportions) [128] 2 Means 6: Comparing Values—Example 6 [116] Paired Proportions 6: Sample Size Estimation for McNemar Exact Tests (Matched Proportions) [131] Paired Means 6: Comparing Values—Example 5 [115] Proportion to Criterion 6: Sample Size for Comparison with a Benchmark Proportion [125] Mean to Criterion 6: Comparing Values—Example 4 [115] Margin of Error Proportion 6: Sample Size Estimation for Binomial Confidence Intervals [121] Margin of Error Mean 6: Estimating Values—Examples 1–3 [112] Problem Discovery Sample Size 7: Using a Probabilistic Model of Problem Discovery to Estimate Sample Sizes for Formative User Research [143]. . . . . . . . . 123 Sample Size for Comparison with a Benchmark Proportion. . . . 187 Poststudy Questionnaires. . 15 Rating Scales...... ...... ...... ...... ....... ...... ...... ...... ...... ...... 15 Net Promoter Scores. . . . . . . . . . .... ... ... .... ... .... 251 On One Hand. 1. The course offers a practical introduction and guide for using statistics to solve quantitative problems in user research. This leads you to “Problem Discovery Sample Size,” which, according to Table 1.3, is discussed in Chapter 7 in the “Using a Probabilistic Model of Problem Discovery to Estimate Sample Sizes for Formative User Research” section on p. 143. . . . . . . Sep 30, 2020 quantifying the user experience practical statistics for user research Posted By Jir? . . . . . . . . . . . .... .... ... .... .... ... .... ... ... 187 Number of Scale Steps. . . . . . . . . . ..... ..... ..... ..... ..... ..... ...... ..... ..... .... 66 Between-subjects Comparison (Two-sample t-test). CHAPTER 1 Introduction and How to Use This Book 2 HOW TO USE THIS BOOK Despite there being a significant proportion of user research practitioners with advanced degrees, about 10% have PhDs (UPA, 2011); for most people in the social sciences, statistics is the only quantitative course they have to take. . . . xv CHAPTER 1 Introduction and How to Use This Book. . . . . . . . . . . . . . . . . . . 246 On the Other Hand. . . . . . . . . . . . . . . . . . . . . The thinking goes that if usability and design are qualitative activities, it’s safe to skip the formulas and numbers. . . . . . . . . . . . . . . . . . . DOI: 10.1016/B978-0-12-384968-7.00001-1 1 © 2012 Jeff Sauro and James R. Lewis. . . . . . . . . . . . . . . . . . . . 1 Introduction.............. ......................... ......................... .... 1 The Organization of This Book. . . . . Comparing two or more groups or comparing one group to a benchmark. See Example 6 on p. 116. If you’renotterriblyinterestedinthecompu- tational mechanics, then you can skip over the formulas and focus more on how to apply the procedures. . 4. . . . . . . . . . . . .... .... .... ... .... .... .... .... 15 Survey Data. . . . . . 3. . . . . 228 ACSI (American Customer Satisfaction Index)....... ....... ...... ....... . . . . . You can publish your book online for free in a few minutes. . . . . . . . . . . Which sample size estimation method should you use? . . . . . Note that methods discussed in Chapter 10 are outside the scope of this book, and receive just a brief description in their sections. . . . . . . . . . . . . . . . . 285 The Logic of Hypothesis Testing. . ........ ........ ........ ........ ........ ........ . . . . I thank my wife, Cathy, for her patience and loving support. . The first step is to identify the type of test for which you’re collecting data. . . . . CHAPTER Introduction and How to Use This Book 1 INTRODUCTION The last thing many designers and researchers in the field of user experience think of is statistics. . . . . . . . . . . . . . . . . . Many designers and researchers view usability and design as qualitative activities, which do not require attention to formulas and numbers. . . . . . . . . . . . . . . . . . . . . . . . . . . Part 2: Formative Studies. . . . . . . . . . . . . . . . . . . . . . . . . .... .... .... .... ..... .... .... .... .... .... ..... ... 9 What is User Research?. . . . . . . . . . . . . . . . . . . . . . Quantifying the User Experience: Practical Statistics for User Research, Second Edition, provides practitioners and researchers with the information they need to confidently quantify, qualify, and justify their data. . . . . . . . . . . . . . . For example, you want to know if the average task time is less than two minutes. . . . . . . . . . . . . . . 241 Is it Okay to Average Data from Multipoint Scales?. . . . . . . ISBN: 978-0-12-384968-7 For information on all MK publications visit our website at www.mkp.com Typeset by: diacriTech, Chennai, India Printed in the United States of America 12 13 14 15 16 10 9 87654321, To my wife Shannon: For the love and the life between the logarithms - Jeff To Cathy, Michael, and Patrick - Jim, Contents Acknowledgments........ ................ ................. ................. ................ .. xiii About the Authors. . . . Quantifying the User Experience: Practical Statistics for User Research. Prior to Stanford, he received his B.S. quantifying the user experience practical statistics for user research Sep 23, 2020 Posted By Alistair MacLean Publishing TEXT ID e704f3fa Online PDF Ebook Epub Library offers a practical guide for using statistics to solve quantitative problems in user research many designers and researchers view usability and design as qualitative activities . . . . . . . . . . . . . . . . . . . In general, these activities fall into three areas: 1. . . . . Because rating-scale data are not binary, select “N” at the “Binary Data?” box. 2. . . . . . . . . . Task-time data are continuous (not binary-discrete), so start with the decision map in Figure 1.1. . . . . . . . . . . What procedure should you use? . . 288 Key Points from the Appendix...... ...... ...... ...... ...... ...... ...... ..... 289 Index..... ....... ...... ....... ...... ....... ...... ....... ...... ....... ...... ...... ....... . . . . . . . . . . . . . . . . . . . . . . . .... ... 26 Confidence Interval for Task-time Data. . . . . Buy Quantifying the User Experience: Practical Statistics for User Research by Sauro, Jeff (ISBN: 9780123849687) from Amazon's Book Store. .... .... .... .... .... .... .... .... .... .... .... ... 278 Applying the Normal Curve to User Research Data. . . . . . . . . . . . . . . . . . Confidence Intervals. . . . . . . . . . . . . . . . . Quantifying the User Experience: Practical Statistics for User Research, Second Edition, provides practitioners and researchers with the information they need to confidently quantify, qualify, and justify their data. . . . . . 229 CxPi (Forrester Customer Experience Index)........................... ... 230 TAM (Technology Acceptance Model)...... .......... .......... ......... 231 Key Points from the Chapter. . . Y Y N Different users in each group? . . . . . . . . . . . . The book presents a practical guide on how to use statistics to solve common quantitative problems that arise in user research. . . . . . . . . . . . Many designers and user researchers view usability and user research as qualitative activities, which do not use formulas and numbers. . . . . difference in (ch 10) benchmark? . . . . . . . . . . . . . . . . . . . . . . CHAPTER 1 Introduction and How to Use This Book 4 N Comparing groups? . . . . 14 Combined Scores. . 164 More About the Binomial Probability Formula and its Small Sample Adjustment. . . . . . . . . . 5. . . . . . . . . . Instead, this book is about working backwards from the most common questions and problems you’ll encounter as you conduct, analyze, and report on user research projects. . . 185 What is a Standardized Questionnaire?. . . . . Quantifying the User Experience Practical Statistics for User Research Jeff Sauro James R. Lewis AMSTERDAM • BOSTON • HEIDELBERG • LONDON NEW YORK • OXFORD • PARIS • SAN DIEGO SAN FRANCISCO • SINGAPORE • SYDNEY • TOKYO Morgan Kaufmann is an imprint of Elsevier, Acquiring Editor: Steve Elliot Development Editor: Dave Bevans Project Manager: Jessica Vaughan Designer: Joanne Blank Morgan Kaufmann is an imprint of Elsevier 225 Wyman Street, Waltham, MA 02451, USA © 2012 Jeff Sauro and James R. Lewis. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . To find the appropriate section in each chapter for the methods depicted in Figures 1.1 and 1.2, consult Tables 1.1 and 1.2. . . . . . . . . . . . . . . . . . . . . . . multiple in each group 2-sample t (ch 5, 9, 10) N N N ANOVA or Testing against a 3 or more groups? . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . ........ ....... ........ ........ ..... 41 Introduction..... ...... ...... ..... ...... ...... ..... ...... ...... ...... ..... ..... 41 One-Tailed and Two-Tailed Tests.... ......... ......... ......... ......... ...... 44 Comparing a Completion Rate to a Benchmark. . . . . . . . quantifying the user experience practical statistics for user research Sep 08, 2020 Posted By Sidney Sheldon Library TEXT ID 6709b78b Online PDF Ebook Epub Library everyday low prices and free delivery on eligible orders quantifying the user experience practical statistics for user research will find the money for you more than people . . . . . . Summary : Quantifying the User Experience: Practical Statistics for User Research offers a practical guide for using statistics to solve quantitative problems in user research. . . . . . . . . . . . . . . . . . . . . ........ ........ ....... ........ ........ ....... ........ ..... 283 t-Distribution. . . . . . This takes you to “2 Means,” which, according to Table 1.3, is discussed in Chapter 6 in the “Comparing Values” section. . . . . . . . . . 148 Additional Applications of the Model......................... ................ 149 Estimating the Composite Value of p for Multiple Problems or Other Events. . . . . . . . . 58 References. 8 CHAPTER 2 Quantifying User Research. . . . . . . . . At the “Comparing Groups?” box, select “Y” because there will be two groups of data, one for each product. . . . . . 250 Can you Reject the Null Hypothesis when p > 0.05?. . . . . . . . .............. .............. ............. 6 You Don’t Have to Do the Computations by Hand. ........ ........ ....... ........ ..... 213 SEQ (Single Ease Question). You’re just estimating the rate rather than comparing a set of rates, so at “Comparing Data?,” take the “N” path. . . . . . . . . . CHAPTER 1 Introduction and How to Use This Book 8 Answers 1. . . The book presents a practical guide on how to use statistics to solve common quantitative problems that arise in user research. . . . . . . . . . . . . . 188 QUIS (Questionnaire for User Interaction Satisfaction). . . . Most websites support hundreds and … . . . Excel and R Companion to “Quantifying the User Experience: Practical Statistics for User Research”: Rapid Answers to over 100 Examples and Exercises. . . . . . . . . . . . . . . . . . . . . . . . . . . . . Many designers and researchers view usability and design as qualitative activities, which do not require attention to formulas and numbers. . . . 121 Binomial Sample Size Estimation for Small Samples.... ......... ........ . . . . .... .... ... .... .... .... ... .... .... ... .... .... ... .... .... 108 Comparing Values. . . . Many designers and researchers view usability and design as qualitative activities, which do not require attention to formulas and numbers. . . . . . . . . . . . . . . . . 3. . . . . . . . . . . . . . . . .... ... ... ... ... ... .... ... ... ... ... .... ... 7 Reference. . 247 Our Recommendation. . . . . . . Problem Estimating a N discovery parameter? . .... .... .... .... .... .... .... .... .... .... .... ..... .... .... .... . . . . . . . . . . . . . . . . . . . . . . Quantifying the User Experience: Practical Statistics for User Research, Second Edition, provides practitioners and researchers with the information they need to confidently quantify, qualify, and justify their data. . . . ...... ....... ...... ... 190 PSSUQ (Post-study System Usability Questionnaire). . . . . . . . 273 Types of Data. . . 3. . . . . . . . . . . . . . . . . . . . . Published by Elsevier Inc. All rights reserved. . . . . . . . . . . 272 Key Points from the Chapter. . . . . . . . . . . . . . . . . . . Suppose you need to analyze a sample of task-time data against a specified benchmark. . . . . . . . . 274 Median.... ..... ..... ..... .... ..... ..... ..... ..... .... ..... ..... ..... .... 275 Geometric Mean..... .............. .............. ............... ......... 275 Standard Deviation and Variance. . . . 255 Our Recommendation. . . . . . 251 Our Recommendation. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Library of Congress Cataloging-in-Publication Data Application submitted British Library Cataloguing-in-Publication Data A catalogue record for this book is available from the British Library. . . . . . . . . . . . . . . . . . . . . . . . . . so many fake sites. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 135 References..... ....... ...... ....... ....... ....... ....... ....... ....... ....... 141 CHAPTER 7 What Sample Sizes Do We Need? . . . . . . . . . . . . . 105 Basic Principles of Summative Sample Size Estimation.... ..... ..... ..... 106 Estimating Values. . . . . . . . . . . . . . . . . . . . . . . Which sample size estimation method should you use? . . . . . . . . Many designers and researchers view usability and design as qualitative activities, which do not require attention to formulas and numbers. . . . . Many designers and researchers view usability and design as qualitative activities, which do … . . . . . . . . . . . . . . . . . . . Jim xiii, About the Authors Jeff Sauro is a six-sigma trained statistical analyst and founding principal of Measuring Usability LLC. . . . . . . . . . . . . . . . . . . 2. . . . . . . . . . . . . . . . . . . . . . T1 - Review: Quantifying the user experience by J. Sauro and J. Lewis. . . . . . . 185 Advantages of Standardized Usability Questionnaires. . . . . . . . . . . . . . . . . . . . . . Part of this is from recent advances in statistics (especially for dealing with binary data). . . . . . . . . . . . . . . . . As new research and experience broaden our understanding, changes in research methods or professional practices may become necessary. . . 160 Some More History: The 1990s. . . . . . . . . . Summarizing data and computing margins of error (Chapter 3). . . . . . . . . . . . . . . . . . 19 Introduction..... ...... ...... ..... ...... ...... ..... ...... ...... ...... ..... ..... 19 Confidence Interval = Twice the Margin of Error. . . . . . . . . . . . . . . . . . . . . . . . . 284 How much do Sample Means Fluctuate?. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . We also provide: Background chapters with an overview of common ways to quantify user research (Chapter 2) • and a quick introduction/review of many fundamental statistical concepts (Appendix). . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 248 On One Hand. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . THE ORGANIZATION OF THIS BOOK This book is intended for those who measure the behavior and attitudes of people as they interact with interfaces. . 146 Assumptions of the Binomial Probability Model. . . . . . . . . . . . . . . . . . ........ ........ ........ ........ ........ ........ . If you want to load Quantifying the User Experience: Practical Statistics for User Research by Jeff Sauro, James R Lewis pdf, then you have come on to the loyal website. . . . . . . . . . . . . . . . . . . . . . . . . . Readers who are familiar with many statistical procedures and formulas may find that some of the formulas we use differ from what you learned in your college statistics courses. . Through the process not only am I satisfied with the answers I’ve found but also with what I’ve learned and the people whom I’ve met, most notably my co-author Jim Lewis. Some of you may have never taken a statistics course whereas others probably took several in graduate school. . . . . . . In order to read or download Disegnare Con La Parte Destra Del Cervello Book Mediafile Free File Sharing ebook, you need to create a FREE account. . ........ ........ ........ ....... ........ ...... 30 Geometric Mean..... ..... ...... ...... ..... ...... ...... ...... ..... ...... .. 31 Confidence Interval for Large Sample Task Times. . . . . . . . . . . . . . . . . . . . 222 SUPR-Q (Standardized Universal Percentile Rank Questionnaire).......... 223 Other Questionnaires for Assessing Websites. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 188 SUMI (Software Usability Measurement Inventory). . . . . Published by Elsevier Inc. All rights reserved. . . . The top 10% of cell phone users consume 90% of wireless bandwidth. . . . . paired t 2-sample t (ch 5) (ch 5, 9, 10) Y N N Task time? . 45 Small-Sample Test..... .......... ......... .......... ......... .......... ... 45 Large-Sample Test..... .......... ......... .......... ......... .......... ... 49 Comparing a Satisfaction Score to a Benchmark.... .... ... .... ... .... .... ... ... 50 Do at Least 75% Agree? . . . . . . . . . . . . We have Quantifying the User Experience: Practical Statistics for User Research doc, txt, DjVu, ePub, PDF forms. . . . . . . 105 Introduction. . . . . . . . . The book presents a practical guide on how to use statistics to solve common quantitative problems that arise in user research. . . . N1 - Book title: Quantifying the user experience: practical statistics for user research. . . . . . . . Quantifying the User Experience: Practical Statistics for User Research offers a practical guide for using statistics to solve quantitative problems in user research. . . . . Part 1: Summative Studies. . 36 References. . . . . ........ ....... ....... ....... ....... ....... ....... .... 280 Standard Error of the Mean. . . . . . . ..... ..... ...... ..... ..... 242 On One Hand. . . . . . . . . Quantifying the User Experience: Practical Statistics for User Research offers a practical guide for using statistics to solve quantitative problems in user research. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14 Errors. . . . . . . . . . . Because you’re testing against a benchmark rather than comparing groups of data, follow the “N” path from “Comparing Data?” At “Testing Against a Benchmark?,” select the “Y” path. . . . . . . . . 7 Key Points from the Chapter. . . . . . . . . . . . . . . . . . . . . . . . . 1. . . . . Our library is the biggest of these that have literally hundreds of thousands of different products represented. . . . . . Quantifying the User Experience: Practical Statistics for User Research offers a practical guide for using statistics to solve quantitative problems in user research. . . . . . . . . . . . ..... ...... ..... ...... ...... ..... ...... ..... ... 22 Adjusted-Wald Interval: Add Two Successes and Two Failures. . 143 n The Famous Equation: P(x ≥1) = 1 − (1 − p) ..... ...... ...... ...... ...... 143 n Deriving a Sample Size Estimation Equation from 1 − (1 − p) ............ 145 Using the Tables to Plan Sample Sizes for Formative User Research..... . . . . . . . . . 4. . . . . . . . . . . . . . in Television, Radio and Film from Syracuse University. . . . . . . . . . . . . . . . . . . . . . Quantifying the User Experience: Practical Statistics for User Research, Second Edition, provides practitioners and researchers with the information they need to confidently quantify, qualify, and justify their data. . . . . . . . He is a Certified Human Factors Professional with a Ph.D. in Experimental Psychology (Psycholinguistics), an M.A. . . . 287 Errors in Statistics. . This book and the individual contributions contained in it are protected under copyright by the Publisher (other than as may be noted herein). . . . . . . . . . . . . . . . . . . . 258 Our Recommendation..... ........ ........ ........ ........ ........ ....... 258 Key Points from the Chapter. . . . . . . . . Y Different users Y Y Comparing data? . . . . . . . . . Most chapters also include a set of problems and answers to those problems so you can check your understanding of the content. Jim is an IBM Master Inventor with 77 patents issued to date by the US Patent Office. . . . . . . . . . . . 75 Within-subjects. . . . . . . . . . . Many designers and researchers view usability and design as qualitative activities, which do not require attention to formulas and numbers. . . . . . . . . As an aid to the persistent problem of remembering what method to use under what • circumstances, this chapter contains four decision maps to guide researchers to the appropriate method and its chapter in this book. . . . . . . . . 246 On One Hand. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 225 CSUQ (Computer System Usability Questionnaire). . . . . . . . . . 274 Mean. . . . . . . . . . . . . . . . At “Different Users in Each Group?,” select the “Y” path. . . . . . . . . . . . . . . . . . . . . . . . . . Practitioners and researchers must always rely on their own experience and knowledge in evaluating and using any information or methods described herein. . . . . . . . . . . . . Suppose you’re planning to conduct a study in which the primary goal is to compare task completion times for two products, with two independent groups of participants providing the times. . . . . . . . . . . . . 14 Satisfaction Ratings. . . . . . .... .... ..... .... ..... .. 68 Assumptions of the t-tests.... ....... ....... ....... ....... ....... ...... .... 73, Contents ix Comparing Completion Rates, Conversion Rates, and A/B Testing...... ........ .. 74 Between-subjects. .... ... .... .... ... .... ... .... ... .. 20 Confidence Interval History. . . . . . . . . . . . . To get an estimate of precision you compute a confidence interval around your sample metrics (e.g., what is the margin of error around a completion rate of 70%; see Chapter 3). . . . . . . . . . 254 On the Other Hand. . . . . Finally, at “Task Time?,” take the “Y” path, which leads you to “1-Sample t (Log).” As shown in Table 1.1, you’ll find that method discussed in Chapter 4 in the “Comparing a Task Time to a Benchmark” section on p. 54. . . . . . ........ ....... 143 Introduction. . . . . . . . . . . . . . . . . . 241 Introduction. . . . . . . . . . 26 Confidence Interval for Rating Scales and Other Continuous Data. PY - 2013/3/19. . . . Create Space Publishers, Denver. . A wrap-up chapter with pointers to more information on statistics for user research (Chapter 10). . . . . . . ....... ... 22 Best Point Estimates for a Completion Rate. . . . .... ... ... ... .... ... ... .... ... ... ... .... ... ... 276 z-scores. . . . . . . . . Start at the first box, “Comparing Data?,” and select “Y” because we are comparing a data set from an older product with a data set from a new product. . . . . . Check Pages 1 - 25 of Quantifying the User Experience: Practical Statistics for User Research in the flip PDF version. . . . . . . . . . . UPA. . . . . . . . What Sample Size Do I Need? . . . . . . . . . . . . . In our experience, one of the hardest things to remember in applying statistics is what statistical test to perform when. . . . . . . . . . . . . . . . . . . . . . [256] 10: Getting More Information [269] Table 1.2 Chapter Sections for Methods Depicted in Figure 1.2 Method Chapter: Section [Page] One-Sample z-Test 4: Comparing a Completion Rate to a Benchmark (Large Sample Test) [49] One-Sample Binomial 4: Comparing a Completion Rate to a Benchmark (Small Sample Test) [45] Adjusted Wald Confidence Interval 3: Adjusted-Wald Interval: Add Two Successes and Two Failures [22] McNemar Exact Test 5: McNemar Exact Test [84] Adjusted Wald Confidence Interval for 5: Confidence Interval around the Difference for Matched Difference in Matched Proportions Pairs [89] N − 1 Two-Proportion Test and Fisher 5: N − 1 Two-Proportion Test [79]; Fisher Exact Test [78] Exact Test Adjusted Wald Difference in Proportion 5: Confidence for the Difference between Proportions [81] Chi-Square 10: Getting More Information [269] For example, let’s say you want to know which statistical test to use if you are comparing com- pletion rates on an older version of a product and a new version where a different set of people par- ticipated in each test. . . . . . . . . . N Y N Y Paired Paired 2 Proportions 2 Means proportions means (ch 6) (ch 6) (ch 6) (ch 6) FIGURE 1.3 Decision map for sample sizes when comparing data. . . . . . . . . . . . . . . . . . . . Quantifying the User Experience: Practical Statistics for User Research, Second Edition, provides practitioners and researchers with the information they need to confidently quantify, qualify, and justify their data. . . . . . . . . . . . . . . N − 1 two- proportion proportion test and Fisher exact test (ch 5) Y N N (ch 5) Y Adjusted Large sample? . . . • A discussion of enduring statistical controversies of which user researchers should be aware and • able to articulate in defense of their analyses (Chapter 9). . . . . . . . . . . . . . .... .... ..... .... .... ... 19 Confidence Intervals Provide Precision and Location....................... 19 Three Components of a Confidence Interval. . . . . 114 What can I Do to Control Variability?. . My friends are so mad that they do not know how I have all the high quality ebook which they do not! . . . . . . . . . . . . . . . . . . . . . . . 178 References....... ....... ....... ....... ....... ...... ....... ....... ....... ..... 181 CHAPTER 8 Standardized Usability Questionnaires. . . . . . . . . . . . . . . . . . . . . If you have an existing statistical package like SPSS, Minitab, or SAS, you may find some of the results will differ (e.g., confidence intervals and sample size com- putations) or they don’t include some of the statistical tests we recommend, so be sure to check the notes associated with the procedures. . . . . *** This book represents 10 years of research, re-sampling and reading dozens of journal articles from many disciplines to help answer questions in an exciting field. . . . 242 On the Other Hand. . . . . . . . . . . . Finally I get this ebook, thanks for all these Quantifying The User Experience Practical Statistics For User Research I can get now! . . . . . . . . . . . . . . . . 84 Key Points from the Chapter. . . . . . . . . . . . . 245 Do you Need to Test at Least 30 Users?. . . . . . . . . . . . . . . 143 Using a Probabilistic Model of Problem Discovery to Estimate Sample Sizes for Formative User Research. . . . . . . . . . . . . . In general, there are three ways of determining your sample size: 1. . . . . Just select your click then download button, and complete an offer to start downloading the ebook. . . . . 276 The Normal Distribution. . . . . . . For detailed information on how to use the Excel calculator (or a custom set of functions written in the R statistical programming language) to solve the over 100 quantita- tive examples and exercises that appear in this book, see Lewis and Sauro (2012). . . . . In fact, we know many practitioners who find the field appealing because it largely avoids those impersonal numbers. . . . . . . . . . . . . . . . . . Jeff received his Masters in Learning, Design and Technology from Stanford University with a concentration in statistical concepts. . . . . . 214 SMEQ (Subjective Mental Effort Question).... ........ ........ ....... .... 214 ER (Expectation Ratings). . . . . . . Many thanks. . . ....... ... 186 Assessing the Quality of Standardized Questionnaires: Reliability, Validity, and Sensitivity. . . . . . 1 How to Use This Book....... ............ ............. ............ ............. 2 What Test Should I Use?. . . . . . . . . 12 Usability Problems. . . . . . . . . . What Test Should I Use? . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . quantifying the user experience practical statistics for user research Sep 18, 2020 Posted By Dean Koontz Ltd TEXT ID e704f3fa Online PDF Ebook Epub Library amazons book store everyday low prices and free delivery on eligible orders jeff has published over fifteen peer reviewed research articles and presents tutorials and papers . . . . . . . . . . . . 121 Binomial Sample Size Estimation for Large Samples.... ......... ........ . . . . . . . . . . . . . . . Details on how to seek permission, further information about the Publisher’s permissions policies, and our arrangements with organizations such as the Copyright Clearance Center and the Copyright Licensing Agency, can be found at our website: www.elsevier.com/permissions. . . . Binary data? . . . . . . . . I am fortunate to have a family that puts up with my obsessions. . . . . . . Based on teaching many courses at industry conferences and at companies, we know the statis- tics background of the readers of this book will vary substantially. . . . . . . CHAPTER 1 Introduction and How to Use This Book 6 3. . . . . . . . . . . . . . . I did not think that this would work, my best friend showed me this website, and it does! . . . The next major decision is whether you’re comparing data or just getting an estimate of preci- sion. . . . . Our focus is on methods applicable to practical user research, based on our experience, • investigations, and reviews of the latest statistical literature. . . . . . . . . . . . . . . 29 Mean or Median Task Time?. . . . . . . . . For many, statistics is a subject they know they should under- stand, but it often brings back bad memories of high school math, poor teachers, and an abstract and difficult topic. . . . 2011. . . . . . . sample size (ch 7) Y Binary data? . . . . . . . . . . . . This leads you to “Adjusted Wald Confidence Interval,” which, according to Table 1.2, is discussed in Chapter 3 in the “Adjusted-Wald Interval: Add Two Successes and Two Failures” section on p. 22. .... ... ... ... ... . . . . . ........ ........ ........ ........ ........ ........ . . . . . . . . . . . . . . . In using such information or methods they should be mindful of their own safety and the safety of others, including parties for whom they have a professional responsibility. . . . . . . . . . . . . . . . . . . . . . . . . . ............ ........... ............ ...... 198 Experimental Comparison of Poststudy Usability Questionnaires. 269 Getting More Information. . . . . . . . 63 Comparing Task Times. . Y N Margin of Margin of error error proportion mean (ch 6) (ch 6) FIGURE 1.4 Decision map for sample sizes for estimating precision or detection. . . . . . . . . . . . . . . . . . . . . . ..... ...... ..... ..... ...... ..... .... 33 Key Points from the Chapter. . . . . . . KEY POINTS FROM THE CHAPTER The primary purpose of this book is to provide a statistical resource for those who measure the • behavior and attitudes of people as they interact with interfaces. . . The book presents a practical guide on how to use statistics to solve common quantitative problems that arise in user research. . Now we’re at the “3 or More Groups” box—we have only two groups of users (before and after) so we select “N.” 5. . . . . . . ...... ...... ...... ... 63 Introduction..... ...... ...... ..... ...... ...... ..... ...... ...... ...... ..... ..... 63 Comparing Two Means (Rating Scales and Task Times).............. .......... 63 Within-subjects Comparison (Paired t-test). . . . . xv. . . . 17 References....... ............... ............... ................ ............... 17 vii, Contents viii CHAPTER 3 How Precise Are Our Estimates? . . . . . . . . . . . . . Paired t (ch 5) N N Y 1-sample t (log) (ch 4) 1-sample t Sample > 25 t confidence (ch 4) interval (ch 3) Y N Confidence t (Log) interval confidence around interval median (ch 3) (ch 3) FIGURE 1.1 Decision map for analysis of continuous data (e.g., task times or rating scales). He is a regular presenter and instructor at the Computer Human Inter- action (CHI) and Usability Professionals Associations (UPA) conferences. . . . . 221 WAMMI (Website Analysis and Measurement Inventory). . . . . . . . . . . . . . For example, let’s say you want to compute the appropriate sample size if the same users will rate the usability of two products using a standardized questionnaire that provides a mean score. . . 256 On One Hand. . . . . . . . . . . . . . . . . . . . . . . 273 Populations and Samples. . . . in each group N N N N Y Adjusted Chi Wald square Testing against a 3 or more groups? . . . . . . . . . 250 Our Recommendation. . . . . . . . . . . . 243 Our Recommendation. . . 4. . 3 or more groups? . . . . . . . . . CHAPTER REVIEW QUESTIONS 1. . . . . For this type of problem discovery evaluation, you’re not planning any type of comparison, so start with the decision map in Figure 1.4.You’re not planning to estimate any parameters, such as task times or problem occurrence rates, so at “Estimating a Parameter?,” take the “N” path.

quantifying the user experience: practical statistics for user research pdf

John Frieda Foam Hair Color, Genshin Impact Time And The Wind Quest, Cantiague Golf Course, Where To Buy Sir Kensington Mayo, Content Strategy Pdf, Temporary Sleeve Tattoos, Baby Duck Outline, Pediatric Nurse Practitioner Resume Objective,
quantifying the user experience: practical statistics for user research pdf 2020