data-collection techniques
DESCRIPTION
Data-collection techniques. Contents. Types of data Observations Event logs Questionnaires Interview. Two types of data. Usability Measures. Use/problem Descriptions. Observations. Observe in real-time or from video recordings Can be used both for measures and descriptions. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Data-collection techniques](https://reader036.vdocuments.site/reader036/viewer/2022062409/5681465b550346895db37a4d/html5/thumbnails/1.jpg)
Data-collection techniques
![Page 2: Data-collection techniques](https://reader036.vdocuments.site/reader036/viewer/2022062409/5681465b550346895db37a4d/html5/thumbnails/2.jpg)
Contents
Types of data Observations Event logs Questionnaires Interview
![Page 3: Data-collection techniques](https://reader036.vdocuments.site/reader036/viewer/2022062409/5681465b550346895db37a4d/html5/thumbnails/3.jpg)
Two types of data
Usability MeasuresUse/problemDescriptions
![Page 4: Data-collection techniques](https://reader036.vdocuments.site/reader036/viewer/2022062409/5681465b550346895db37a4d/html5/thumbnails/4.jpg)
Observations
Observe in real-time or from video recordings
Can be used both for measures and descriptions
Usability MeasuresUse/problemDescriptions
![Page 5: Data-collection techniques](https://reader036.vdocuments.site/reader036/viewer/2022062409/5681465b550346895db37a4d/html5/thumbnails/5.jpg)
http://www.mangold.de/english/intoverview.htm
![Page 6: Data-collection techniques](https://reader036.vdocuments.site/reader036/viewer/2022062409/5681465b550346895db37a4d/html5/thumbnails/6.jpg)
Measures from observations
Particularly suitable for measuring effectivity and efficiency
How many tasks were performed?
How quickly was the task performed?
Were the goals achieved?
How many errors were made?
Effectivity
Efficiency
![Page 7: Data-collection techniques](https://reader036.vdocuments.site/reader036/viewer/2022062409/5681465b550346895db37a4d/html5/thumbnails/7.jpg)
Use/problem descriptions from observations
Description of breakdowns Describe situations when there is a
”breakdown” in the users interaction with the product
Description of use Describe how the user actually used the
product
![Page 8: Data-collection techniques](https://reader036.vdocuments.site/reader036/viewer/2022062409/5681465b550346895db37a4d/html5/thumbnails/8.jpg)
Event logs
Logging of the user’s interaction with the product
Typically collected automatically Can be used both for measures and
descriptions
Usability MeasuresUse/problemDescriptions
![Page 9: Data-collection techniques](https://reader036.vdocuments.site/reader036/viewer/2022062409/5681465b550346895db37a4d/html5/thumbnails/9.jpg)
http://zing.ncsl.nist.gov/WebTools/WebVIP/overview.html
![Page 10: Data-collection techniques](https://reader036.vdocuments.site/reader036/viewer/2022062409/5681465b550346895db37a4d/html5/thumbnails/10.jpg)
http://zing.ncsl.nist.gov/WebTools/FLUD/example-pretty.html
![Page 11: Data-collection techniques](https://reader036.vdocuments.site/reader036/viewer/2022062409/5681465b550346895db37a4d/html5/thumbnails/11.jpg)
http://zing.ncsl.nist.gov/WebTools/VisVIP/overview.html
![Page 12: Data-collection techniques](https://reader036.vdocuments.site/reader036/viewer/2022062409/5681465b550346895db37a4d/html5/thumbnails/12.jpg)
http://zing.ncsl.nist.gov/hfweb/proceedings/etgen-cantor/
![Page 13: Data-collection techniques](https://reader036.vdocuments.site/reader036/viewer/2022062409/5681465b550346895db37a4d/html5/thumbnails/13.jpg)
http://zing.ncsl.nist.gov/hfweb/proceedings/etgen-cantor/
![Page 14: Data-collection techniques](https://reader036.vdocuments.site/reader036/viewer/2022062409/5681465b550346895db37a4d/html5/thumbnails/14.jpg)
http://zing.ncsl.nist.gov/hfweb/proceedings/etgen-cantor/
![Page 15: Data-collection techniques](https://reader036.vdocuments.site/reader036/viewer/2022062409/5681465b550346895db37a4d/html5/thumbnails/15.jpg)
http://www.mangold.de/english/patternexample.htm
![Page 16: Data-collection techniques](https://reader036.vdocuments.site/reader036/viewer/2022062409/5681465b550346895db37a4d/html5/thumbnails/16.jpg)
http://zing.ncsl.nist.gov/WebTools/VisVIP/overview.html
![Page 17: Data-collection techniques](https://reader036.vdocuments.site/reader036/viewer/2022062409/5681465b550346895db37a4d/html5/thumbnails/17.jpg)
Measures from event logs
Suitable for measuring effectivity and efficiency
Effectivity
Efficiency
![Page 18: Data-collection techniques](https://reader036.vdocuments.site/reader036/viewer/2022062409/5681465b550346895db37a4d/html5/thumbnails/18.jpg)
Use/problem descriptions from event logs
Visualise interaction patterns (Quantify use)
![Page 19: Data-collection techniques](https://reader036.vdocuments.site/reader036/viewer/2022062409/5681465b550346895db37a4d/html5/thumbnails/19.jpg)
Questionnaire
Self-made or validated Most useful for collecting measures
Usability Measures
![Page 20: Data-collection techniques](https://reader036.vdocuments.site/reader036/viewer/2022062409/5681465b550346895db37a4d/html5/thumbnails/20.jpg)
Self-made or validated?
Designing your own questionnaire allows you to address issues of particular interest; however, it is difficult to create good items
Validated questionnaires (e.g. SUMI) have typically gone through extensive testing. Thus, test items are generally good, but they may not address the issues you are particularly interested in.
![Page 21: Data-collection techniques](https://reader036.vdocuments.site/reader036/viewer/2022062409/5681465b550346895db37a4d/html5/thumbnails/21.jpg)
http://www.acm.org/~perlman/question.cgi?form=NAU
![Page 22: Data-collection techniques](https://reader036.vdocuments.site/reader036/viewer/2022062409/5681465b550346895db37a4d/html5/thumbnails/22.jpg)
http://www.acm.org/~perlman/question.cgi?form=ASQ
![Page 23: Data-collection techniques](https://reader036.vdocuments.site/reader036/viewer/2022062409/5681465b550346895db37a4d/html5/thumbnails/23.jpg)
http://www.acm.org/~perlman/question.cgi?form=PUEU
![Page 24: Data-collection techniques](https://reader036.vdocuments.site/reader036/viewer/2022062409/5681465b550346895db37a4d/html5/thumbnails/24.jpg)
Measures from questionnaires
Can be used for measuring all attributes, but is particularly suitable for measuring satisfaction; we are interested in the user’s subjective opinion
Satisfaction
![Page 25: Data-collection techniques](https://reader036.vdocuments.site/reader036/viewer/2022062409/5681465b550346895db37a4d/html5/thumbnails/25.jpg)
Interview
Structured, semi-structured, open Most useful for use/problem
descriptions
Use/problemDescriptions
![Page 26: Data-collection techniques](https://reader036.vdocuments.site/reader036/viewer/2022062409/5681465b550346895db37a4d/html5/thumbnails/26.jpg)
Use/problem descriptions from interviews
Information about previous experiences and knowledge that might explain the user’s performance
Obtain explanations: the user’s preferences Breakdowns errors
![Page 27: Data-collection techniques](https://reader036.vdocuments.site/reader036/viewer/2022062409/5681465b550346895db37a4d/html5/thumbnails/27.jpg)
Student tasks
• What data-collection techniques do you think are suitable for testing your product?
• What do you believe are the strengths and weaknesses of the technique?