![Page 1: Purpose of field research designs Types of field studies Planning a field study Sampling plan Questionnaire design –Online Questionnaires Data analysis](https://reader036.vdocuments.site/reader036/viewer/2022062321/56649dde5503460f94ad6603/html5/thumbnails/1.jpg)
• Purpose of field research designs• Types of field studies• Planning a field study
• Sampling plan
• Questionnaire design– Online Questionnaires
• Data analysis
• Special concerns in field research
Field Research Designs
![Page 2: Purpose of field research designs Types of field studies Planning a field study Sampling plan Questionnaire design –Online Questionnaires Data analysis](https://reader036.vdocuments.site/reader036/viewer/2022062321/56649dde5503460f94ad6603/html5/thumbnails/2.jpg)
• Population• An entire group of people, events or things of interest
• Element• Single member of population
• Sample• Subgroup of the population
• Subject• Single member of sample
• Sampling• Selecting sufficient number of elements from
population so that features of the sample (e.g., mean) can be generalized to the population
Some Definitions
![Page 3: Purpose of field research designs Types of field studies Planning a field study Sampling plan Questionnaire design –Online Questionnaires Data analysis](https://reader036.vdocuments.site/reader036/viewer/2022062321/56649dde5503460f94ad6603/html5/thumbnails/3.jpg)
Advantages of Sampling
• Less cost• Compared to cost of studying population
• Less error• In collecting & analysing data
• Less time• Because fewer elements considered
• Less intrusive/destructive• E.g., when measurement changes
phenomenon
![Page 4: Purpose of field research designs Types of field studies Planning a field study Sampling plan Questionnaire design –Online Questionnaires Data analysis](https://reader036.vdocuments.site/reader036/viewer/2022062321/56649dde5503460f94ad6603/html5/thumbnails/4.jpg)
• Random sampling • Each member of population has EQUAL
chance of being selected into sample• Ease of identifying population
• Company vs. community vs. student populations
• Determining sample• Random number tables, computerized routine, drawing
from urn
Sampling Plan
![Page 5: Purpose of field research designs Types of field studies Planning a field study Sampling plan Questionnaire design –Online Questionnaires Data analysis](https://reader036.vdocuments.site/reader036/viewer/2022062321/56649dde5503460f94ad6603/html5/thumbnails/5.jpg)
• Random sampling • Randomly select additional participants if
initially selected ones refuse/cannot• Order population, sample every xth person –
ordering is not related to variable of interest• E.g., Immigration checks
• Use of convenience sample• Include variables that assess representativeness
of obtained sample• If response rate is low
• e.g., ethnic harassment study
Sampling Plan
![Page 6: Purpose of field research designs Types of field studies Planning a field study Sampling plan Questionnaire design –Online Questionnaires Data analysis](https://reader036.vdocuments.site/reader036/viewer/2022062321/56649dde5503460f94ad6603/html5/thumbnails/6.jpg)
• Modified random sampling• Stratified random sampling• Divide population into subgroups & randomly
select from subgroups• Sub-grouping expected to influence results (e.g.,
motivational levels in R&D vs. secretarial staff)
• Used when total sample size is small and number of subgroups is large• E.g., visible minorities at Scar campus
Sampling Plan
![Page 7: Purpose of field research designs Types of field studies Planning a field study Sampling plan Questionnaire design –Online Questionnaires Data analysis](https://reader036.vdocuments.site/reader036/viewer/2022062321/56649dde5503460f94ad6603/html5/thumbnails/7.jpg)
• Modified random sampling (cont’d)• Cluster sampling• Choose participants based on membership of a
group• Groups are then chosen to participate in study• Stats computed can have large sampling errors
– E.g., examine units in 4 vs. 30 boxes of a shipment
• Over-sampling from a subgroup – E.g., gays in the org’n
• Need to weight descriptive stats appropriately
Sampling Plan
![Page 8: Purpose of field research designs Types of field studies Planning a field study Sampling plan Questionnaire design –Online Questionnaires Data analysis](https://reader036.vdocuments.site/reader036/viewer/2022062321/56649dde5503460f94ad6603/html5/thumbnails/8.jpg)
• Sampling plan
• Questionnaire design– Online Questionnaires
• Data analysis
• Special concerns in field research
Field Research Designs
![Page 9: Purpose of field research designs Types of field studies Planning a field study Sampling plan Questionnaire design –Online Questionnaires Data analysis](https://reader036.vdocuments.site/reader036/viewer/2022062321/56649dde5503460f94ad6603/html5/thumbnails/9.jpg)
• Use existing measures of concepts• Comparability• Reliability (standardization)• Validity
Questionnaire Design
![Page 10: Purpose of field research designs Types of field studies Planning a field study Sampling plan Questionnaire design –Online Questionnaires Data analysis](https://reader036.vdocuments.site/reader036/viewer/2022062321/56649dde5503460f94ad6603/html5/thumbnails/10.jpg)
• Writing Items• Comprehensiveness• E.g., commitment scale
• Accuracy• Maintain respondents’ cooperation & dignity
Questionnaire Design
![Page 11: Purpose of field research designs Types of field studies Planning a field study Sampling plan Questionnaire design –Online Questionnaires Data analysis](https://reader036.vdocuments.site/reader036/viewer/2022062321/56649dde5503460f94ad6603/html5/thumbnails/11.jpg)
• Writing Items• Structured vs. Open-ended items • Respondent involvement in research• Purpose of research
• Exploratory vs. confirmatory
• Type of question• E.g., When all possibilities are not known/too many
• Resource availability• Time & money for coding & analysing
Questionnaire Design
Saks 69-73; Sekaran 238-242
![Page 12: Purpose of field research designs Types of field studies Planning a field study Sampling plan Questionnaire design –Online Questionnaires Data analysis](https://reader036.vdocuments.site/reader036/viewer/2022062321/56649dde5503460f94ad6603/html5/thumbnails/12.jpg)
• Writing Items• Use simple, direct, familiar language• Be clear & specific (avoid ambiguous items)• Use positively and negatively worded items• Avoid double-barreled items• Avoid Leading questions• Avoid loaded questions• Ensure applicability to all respondents• Avoid recall-dependent items
Questionnaire Design
Saks 69-73; Sekaran 238-242
![Page 13: Purpose of field research designs Types of field studies Planning a field study Sampling plan Questionnaire design –Online Questionnaires Data analysis](https://reader036.vdocuments.site/reader036/viewer/2022062321/56649dde5503460f94ad6603/html5/thumbnails/13.jpg)
• Writing Items• Minimize Response styles
• Yea/Nay sayers (acquiescence)• Positive vs. negatively worded items
• Social Desirability» Forced choice format» Content-specific anchors (e.g., BARS)» Items scattered across survey
Questionnaire Design
Saks 69-73; Sekaran 238-242
![Page 14: Purpose of field research designs Types of field studies Planning a field study Sampling plan Questionnaire design –Online Questionnaires Data analysis](https://reader036.vdocuments.site/reader036/viewer/2022062321/56649dde5503460f94ad6603/html5/thumbnails/14.jpg)
• Response options in structured scales• Types of Rating Scales• Likert, Semantic Differential, Itemized Rating etc. (p.
197-199 Sekaran)
• Bimodal responding• Using only a portion of the response options
• Ensure anchors have same meaning to all respondents• Use numbers w/verbal descriptors
Questionnaire Design
![Page 15: Purpose of field research designs Types of field studies Planning a field study Sampling plan Questionnaire design –Online Questionnaires Data analysis](https://reader036.vdocuments.site/reader036/viewer/2022062321/56649dde5503460f94ad6603/html5/thumbnails/15.jpg)
• Response options in structured scales• Identify time frame of phenomenon of interest• Optimal number of scale points • 5 points is best, fewer results in less variability
• Instructions • Provide examples • Participants’ education level • Previous exposure to method of data collection
• e.g., web/email surveys
Questionnaire Design
![Page 16: Purpose of field research designs Types of field studies Planning a field study Sampling plan Questionnaire design –Online Questionnaires Data analysis](https://reader036.vdocuments.site/reader036/viewer/2022062321/56649dde5503460f94ad6603/html5/thumbnails/16.jpg)
• Response options in structured scales• Sequencing• General to specific, easy to difficult• Avoid placing positively and negatively worded items
tapping into the same dimension near each other• Beware of ordering effects• Issues with dispersal of items
• Numbering• Attend to data analyses issues
Questionnaire Design
Sekaran 242
![Page 17: Purpose of field research designs Types of field studies Planning a field study Sampling plan Questionnaire design –Online Questionnaires Data analysis](https://reader036.vdocuments.site/reader036/viewer/2022062321/56649dde5503460f94ad6603/html5/thumbnails/17.jpg)
• Response options in structured scales• Layout (appearance)• Introduction
• e.g., Study Information Sheet
• Organization• By sections• Personal Data
• Request sensitive personal data at the end• Open-ended questions in the end• Conclusion
Questionnaire Design
Sekaran 245-249
![Page 18: Purpose of field research designs Types of field studies Planning a field study Sampling plan Questionnaire design –Online Questionnaires Data analysis](https://reader036.vdocuments.site/reader036/viewer/2022062321/56649dde5503460f94ad6603/html5/thumbnails/18.jpg)
• Pre-testing Survey• Readability, item content, ambiguities
• Ways to Optimize Return Rate• Upper management or union support• Work time allocated for survey completion• Coercion, confidentiality concerns
• Participants’ belief in value of research• Previous experience with HR research
• 30% rate is common
Questionnaire Design
![Page 19: Purpose of field research designs Types of field studies Planning a field study Sampling plan Questionnaire design –Online Questionnaires Data analysis](https://reader036.vdocuments.site/reader036/viewer/2022062321/56649dde5503460f94ad6603/html5/thumbnails/19.jpg)
• Optimizing Return Rate• Professional appearance• For mailed survey: use first class mail & include
return postage
• Send reminders• Provide Incentives for responding• Keep survey at optimal length• Identify characteristics of non-responders to
establish representativeness of sample• Identify mechanism for clarifying questions
Questionnaire Design
![Page 20: Purpose of field research designs Types of field studies Planning a field study Sampling plan Questionnaire design –Online Questionnaires Data analysis](https://reader036.vdocuments.site/reader036/viewer/2022062321/56649dde5503460f94ad6603/html5/thumbnails/20.jpg)
• Advantages • Speed• Delivery to participants• Completed surveys to researcher
• Cost efficiency• Environmental costs (e.g., paper, ink)• Personnel costs (e.g., typing, data entry)
Online Questionnaires
![Page 21: Purpose of field research designs Types of field studies Planning a field study Sampling plan Questionnaire design –Online Questionnaires Data analysis](https://reader036.vdocuments.site/reader036/viewer/2022062321/56649dde5503460f94ad6603/html5/thumbnails/21.jpg)
• Concerns • Respondents’ access to computers
• Establish invariance b/w paper-pencil and computer versions (e.g.,achievement, attitude measures)
• Ballot stuffing• Unique access control numbers
• Start up costs• E.g. survey monkey $20/month
• Technical difficulties during survey administration• Researcher’s control over design interface
• E.g. survey monkey
• Employee reactions to online surveys
Online Questionnaires
![Page 22: Purpose of field research designs Types of field studies Planning a field study Sampling plan Questionnaire design –Online Questionnaires Data analysis](https://reader036.vdocuments.site/reader036/viewer/2022062321/56649dde5503460f94ad6603/html5/thumbnails/22.jpg)
• Preliminary Data Cleaning• Use descriptive data to catch errors• E.g., means, ranges, standard deviations
• Coding open-ended responses
• Analysis & Interpretation• Descriptive data• Frequencies, means
• Group comparisons • T-tests, ANOVAs
• Establish relations between variables• Correlations, regressions
Data Analysis
![Page 23: Purpose of field research designs Types of field studies Planning a field study Sampling plan Questionnaire design –Online Questionnaires Data analysis](https://reader036.vdocuments.site/reader036/viewer/2022062321/56649dde5503460f94ad6603/html5/thumbnails/23.jpg)
• Scale reduction• Alternatives to shortening existing scales• Reduce number of variables• Use alternative methods of measurement
• E.g., peer ratings, archival data etc.
Special Issues in Field Research
![Page 24: Purpose of field research designs Types of field studies Planning a field study Sampling plan Questionnaire design –Online Questionnaires Data analysis](https://reader036.vdocuments.site/reader036/viewer/2022062321/56649dde5503460f94ad6603/html5/thumbnails/24.jpg)
• Percept-percept problem• Response bias due to cross-sectional, mono-
method measurement of all variables• Alternatives to self-report questionnaires
• E.g., archival, objective data
• Multiple data collection times• E.g., Longitudinal study
• Dispositional influences • E.g., neuroticism
Special Issues in Field Research
![Page 25: Purpose of field research designs Types of field studies Planning a field study Sampling plan Questionnaire design –Online Questionnaires Data analysis](https://reader036.vdocuments.site/reader036/viewer/2022062321/56649dde5503460f94ad6603/html5/thumbnails/25.jpg)
• Survey matching• Ensure confidentiality & anonymity
• Controlling extraneous variables• Conceptual understanding• Sample characteristics• Measurement or control of variables
Special Issues in Field Research
![Page 26: Purpose of field research designs Types of field studies Planning a field study Sampling plan Questionnaire design –Online Questionnaires Data analysis](https://reader036.vdocuments.site/reader036/viewer/2022062321/56649dde5503460f94ad6603/html5/thumbnails/26.jpg)
• Response Variability• Dichotomous scales (e.g., y/n responses)
• Ethics• Info re: research objectives• Precautions re: anonymity• Limit demographic info requested• Web/email based surveys
• Mechanisms for research feedback • Implications, planned action, follow up
Special Issues in Field Research