ws 1b surveying participants: lessons from viva calle san jose
TRANSCRIPT
Surveying Participants: Lessons from Viva CalleSJ
2016 International Open Street Summit
Asha Weinstein Agrawal, PhD
August 18, 2016
Mineta Transportation Institute
Presentation outline
1. About the survey project
2. Sampling considerations
3. Questionnaire design considerations
4. Where to learn more
Photo by 8-80 Cities
Survey project partners
1. My co-author: Hilary Nixon, PhD
2. Mineta Transportation Institute
3. City of San Jose, Parks & Recreation
4. Silicon Valley Bicycle Coalition
Our survey – a few details
• Short! (1 page with 12 questions)
• Self-complete
• Available in three languages
• Surveyors were stationed at 6 key locations
• 618 people returned usable surveys
Presentation outline
1. About our survey project
2. Sampling considerations
3. Questionnaire design considerations
4. Where to learn more
Sampling Options
Sampling approach
Advantages Disadvantages
Census Accurately reflects all participants
Impossible!
Random sample
Results can be generalized to all participants
Impossible!
Intercept at key locations
Easy to administerResults may approximate a random sample
Can’t generalize with full confidence
Presentation outline
1. About our survey project
2. Sampling considerations
3. Questionnaire design considerations
4. Where to learn more
Questionnaire design
1. What topics to include? Ask:
– How would I use the results?
– Is there another (better) way to get this information?
2. How many questions can I include? Ask:
– What is my desired response rate?
– What is my budget and desired # of responses?
Questionnaire design, cont.
3. How to word each question? Ask:
– Would a distracted 6th grader understand it?
– What are all the ways this question could be interpreted?
– How accurately can people answer?
– Will people tell the truth?
– How can I simplify even more (grammar & vocab)?
Sample question: outreach
How did you learn about today’s Viva CalleSJevent? (Check all that apply)
□ Radio
□ Newspaper
□ Flyer/poster
□ E-newsletter or email blast
□ Facebook, Twitter, or other social media
□ Other (please specify)___________
2015 results: outreach
Source of information% of
respondents
Facebook, Twitter, or other social media 29
Other 23
Word of mouth (volunteered) 21
Flyer/poster 21
Newspaper 12
E-newsletter or email blast 12
Radio 5
No response 1
Note: Respondents could select multiple options.
REVISED outreach question
How did you learn about today’s Viva CalleSJ event? (Check all that apply)
□ Radio
□ Newspaper
□ Flyer/poster
□ E-newsletter or email blast
□ Facebook, Twitter, or other social media
□ Word of mouth (friend, co-worker, etc.)
□ Other (please specify)___________
Sample question: money spent
How much money are you likely to spend at Viva CalleSJ?
□ Nothing
□ $1 to $10
□ $11 or more
2015 results: estimated $ spent
Amount spent% of
respondents
$11 or more 53
$1 to $10 35
Nothing 10
No response 3
Draft NEW spending question
How much money have you spent at Viva CalleSJtoday, in each category?
$______Food/drink from food trucks
$______SJMADE Marketplace at Arena Green
$______Food/drink from restaurant along route
$______Stores along the route
$______Other
□ I have not spent any money at all
Comparing the two questions
1. How much money are you likely to spend at Viva CalleSJ?
2. How much money have you spent at Viva CalleSJ today in each category?
Mineta Transportation Institute
Want to learn more?
• Report at transweb.sjsu.edu/project/1430.html
• Email: [email protected]