land of miami, delaware, potawatomi, and shawnee peoples€¦ · remind me, why are we doing this?...
TRANSCRIPT
![Page 1: Land of Miami, Delaware, Potawatomi, and Shawnee Peoples€¦ · Remind me, why are we doing this? • Exploring usage, outcomes, and/or impacts for recently ended programs or online](https://reader033.vdocuments.site/reader033/viewer/2022052010/601fce05fade6f220d650a4c/html5/thumbnails/1.jpg)
Land of Miami, Delaware, Potawatomi, and Shawnee Peoples Resources in Indiana http://www.miamiindians.org http://www.pokagonband-nsn.gov/
![Page 2: Land of Miami, Delaware, Potawatomi, and Shawnee Peoples€¦ · Remind me, why are we doing this? • Exploring usage, outcomes, and/or impacts for recently ended programs or online](https://reader033.vdocuments.site/reader033/viewer/2022052010/601fce05fade6f220d650a4c/html5/thumbnails/2.jpg)
Ask an Evaluator: Balancing Data Needs with Reality
Association
of Midwest
Museums Jeremy W. Foutz
STEAM Workgroup
Image from https://haeschecollectibles.net/
![Page 3: Land of Miami, Delaware, Potawatomi, and Shawnee Peoples€¦ · Remind me, why are we doing this? • Exploring usage, outcomes, and/or impacts for recently ended programs or online](https://reader033.vdocuments.site/reader033/viewer/2022052010/601fce05fade6f220d650a4c/html5/thumbnails/3.jpg)
Audience Research in a
Time of Crisis:
![Page 4: Land of Miami, Delaware, Potawatomi, and Shawnee Peoples€¦ · Remind me, why are we doing this? • Exploring usage, outcomes, and/or impacts for recently ended programs or online](https://reader033.vdocuments.site/reader033/viewer/2022052010/601fce05fade6f220d650a4c/html5/thumbnails/4.jpg)
General Guidelines
• Know why you’re doing evaluation
• Balance the many contexts
• Prioritize your data needs
• Focus with methodologies
• Re-balance with access and
privilege
![Page 5: Land of Miami, Delaware, Potawatomi, and Shawnee Peoples€¦ · Remind me, why are we doing this? • Exploring usage, outcomes, and/or impacts for recently ended programs or online](https://reader033.vdocuments.site/reader033/viewer/2022052010/601fce05fade6f220d650a4c/html5/thumbnails/5.jpg)
Remind me, why are we doing this?
• Exploring usage, outcomes, and/or impacts for
recently ended programs or online offerings
• Learning of needs during the crisis of your
audience, sometimes of vulnerable populations
• Exploring the nature of museum life when some
normalcy returns and we can safely gather
• Exploring the impact of the crisis for audiences on
mission-specific topics
![Page 6: Land of Miami, Delaware, Potawatomi, and Shawnee Peoples€¦ · Remind me, why are we doing this? • Exploring usage, outcomes, and/or impacts for recently ended programs or online](https://reader033.vdocuments.site/reader033/viewer/2022052010/601fce05fade6f220d650a4c/html5/thumbnails/6.jpg)
Balancing the many contexts
• Practice compassion and consider the contexts of
your audience and/or participants
• Equity in evaluation is a step beyond culturally
responsive evaluation (CRE), though they exist on
the same continuum
• Proactively talk with internal and external
stakeholders to understand any changes to their
situation which influence your work
![Page 7: Land of Miami, Delaware, Potawatomi, and Shawnee Peoples€¦ · Remind me, why are we doing this? • Exploring usage, outcomes, and/or impacts for recently ended programs or online](https://reader033.vdocuments.site/reader033/viewer/2022052010/601fce05fade6f220d650a4c/html5/thumbnails/7.jpg)
Resources
• Considerations for Conducting Evaluation Using A
Culturally Responsive and Racial Equity Lens (from
Public Policy Associates and Michigan State
University)
• LGBTQ Welcoming Guidelines (from American
Alliance of Museums)
• Culturally Responsive Research Framework (from
Oregon Museum of Science and Industry’s REVEAL
project)
![Page 8: Land of Miami, Delaware, Potawatomi, and Shawnee Peoples€¦ · Remind me, why are we doing this? • Exploring usage, outcomes, and/or impacts for recently ended programs or online](https://reader033.vdocuments.site/reader033/viewer/2022052010/601fce05fade6f220d650a4c/html5/thumbnails/8.jpg)
You can’t always get what you want
• Focus on what you need to know now vs what you
want to know
• Keep the data requests small
• Evaluation still has real costs – preparation, data
collection, platforms, analysis, incentives,
reporting, staff/contractors
![Page 9: Land of Miami, Delaware, Potawatomi, and Shawnee Peoples€¦ · Remind me, why are we doing this? • Exploring usage, outcomes, and/or impacts for recently ended programs or online](https://reader033.vdocuments.site/reader033/viewer/2022052010/601fce05fade6f220d650a4c/html5/thumbnails/9.jpg)
Focus with methodologies
• For exploring usage of online materials, get your
evaluators and IT professionals together
• Online surveys have a function but need
supplement
• Consider old-school data collection methods and
new ways of listening to your visitors
• Keep data security and audience privacy as a
priority
• Know the limits of your methodologies
![Page 10: Land of Miami, Delaware, Potawatomi, and Shawnee Peoples€¦ · Remind me, why are we doing this? • Exploring usage, outcomes, and/or impacts for recently ended programs or online](https://reader033.vdocuments.site/reader033/viewer/2022052010/601fce05fade6f220d650a4c/html5/thumbnails/10.jpg)
Rebalance with access and privilege
• Participatory evaluation methods can help
mitigate inequity of privilege
• Mobile internet access is widespread, but not
everywhere
• Make sure your instruments are mobile-friendly
• Patience
• Revisit equitable evaluation frameworks
throughout the evaluation process
![Page 11: Land of Miami, Delaware, Potawatomi, and Shawnee Peoples€¦ · Remind me, why are we doing this? • Exploring usage, outcomes, and/or impacts for recently ended programs or online](https://reader033.vdocuments.site/reader033/viewer/2022052010/601fce05fade6f220d650a4c/html5/thumbnails/11.jpg)
Thank you!
Please reach out with questions, ideas, or comments!
@steamworkgroup (Twitter)
steamworkgroup.com