a step by step guide - episcenter sfp...2012/11/15 · a step by step guide when you go to the...
TRANSCRIPT
A Step By Step Guide
When you go to the EPISCenter website, navigate to the SFP 10-14 page and click on Evaluation Tools for SFP 10-14. Then, click on EPISCenter SFP 10-14 Spreadsheet for Outcomes Analysis and Reporting to download the tool or paste the link below into your browser to go there directly.http://www.episcenter.psu.edu/ebp/strengthening/outcomemeasurementtools
You are almost ready to begin exploring the tool!
But first a few words about security and quality control features…
“Enable Content”o A window may pop up telling you that the spreadsheet is a
macro enabled file and asking how you would like to download it.o Download it as an “Excel file”.o Excel should automatically open and the spreadsheet should
appear.o Then click the enable content button and make the file a trusted
document
“Green “Automatic Saving” Button
This feature prepares your spreadsheet for submission to PCCD by:o removing names/identifiers from the spreadsheeto appropriately naming the spreadsheet
IMPORTANT!Please save a copy of the full file for your records on your computer before
using this feature and before submitting the modified file to PCCD.
“Green “Automatic Saving” Button –
Have you watched the video on how to use this feature? No? Go to http://episcenter.psu.edu/resources or click
on the link in the Instructions Tab of your spreadsheet.
Data Validation Featureso Drop down lists – limit response optionso Pink Cells – provide an alert to potential data entry errors
Protected Worksheetso Locked Cellso Unlocked Cells
Cells that do not require data to be entered are locked to prevent the unintentional corruption or removal of formulas.
Please do not attempt to unlock the cells.
Use Clear Contentso There is danger in using Copy, Paste, Fill, and Delete
• Accidental deletion of data validation or formulas
Read the Instructions Tabo These instructions can be printed for reference as you enter data.
The SFP 10-14 Spreadsheet Tabso Instructionso Process PMso Outcomes PMs o Reporto Raw Data Entry Tabs for Each Quarter
• Attendance• Parent–Caregiver Survey • Youth Survey• Parent Fidelity• Youth Fidelity• Family Fidelity
o Populated Tabs• Facilitator Ratings• Comments
There is a NAVIGATE button on each tab that allows you to move quickly between tabs. When you click on it, there is a drop down box listing all the sheets in the workbook.
EPISCenter Family Identifier & Attendance Form (for survey coding)
EPISCenter Parent and Youth Pre/Post Surveys(or retrospective if week 1 is missed by a participant) Facilitator Ratings Participant Feedback/Comments
Fidelity Observation Forms (2 parent, 2 youth, and 2 family sessions)
Follow-up Survey Is Optional -- Developer’s 3–Month Follow-up Survey (not summarized in tool)
Contact the EPISCenter to learn more about the recommendations for survey administration and coding.
Enter data into only 1 spreadsheet per year. Do not begin a new spreadsheet after each program or reporting quarter.
A full year’s worth of data is to be collected in a spreadsheet. After 4 quarters, begin a new spreadsheet for year 2.
The spreadsheet calculates cumulative totals and percentages for the performance measures for 1 year of SFP 10-14 programming.
A worksheet is available from the EPISCenter to assist you in adding the year 1 and year 2 results together.
Enter Data into ALL yellow cells for the quarter you are reporting on. What Quarter are you reporting on?
o Oct-Deco Jan-Maro Apr-Juneo July-Sept
What year are you reporting on? Include agency name, data person’s contact info., and grant number Enter data for PMs 1-3. Enter 0 when appropriate. PMs 4-13 will be completed automatically from survey and fidelity
data that you enter in other parts of the Excel workbook. If factors influenced data administration, collection, or analysis,
please enter them in the comments box (row 25).
No data will be directly entered here. However, please review this tab as your outcomes data will be summarized here.
Familiarize yourself with Outcomes Performance Measures 1-17. These will be automatically populated when you enter data into
other parts of the Excel workbook. The performance measures align with the core concepts taught in
the curriculum and the short and long-term goals as demonstrated in the research on SFP 10-14 (see logic model and survey constructs).
Note the cumulative column -o Tells you the total number of surveyed individuals or families with the
desired change for each performance measure. The total is cumulative and captures data for one year of your grant.
Note the percentage column - Tells you the percent of surveyed individuals/families with the desired change for each
performance measure. The total is cumulative and captures data for one year of your grant.
This is a resource that will provide you with a summary suitable for sharing with stakeholders.
Only the yellow cell information for Report Date and Time Period Summarized will need to be directly entered here.
Report Date – This cell should indicate the date you submit the report to PCCD or distribute the report to stakeholders.
Time Period Summarized – This cell should highlight the total amount of time reflected in the data captured. For example, if you were funded January of 2012 and print a report for this quarter, you would type January 1, 2012 – October 31, 2012.
The Report Tab summarizes fidelity observation data by parent, youth, and family component. You are encouraged to share this with your facilitators.
There is one Attendance Tab for each quarter Up to 5 programs can be documented in one Attendance Tab Do not enter Attendance Tab data until a 7-week SFP 10-14 program
has ended Use the Family Identifier & Attendance Form to enter participant data
accurately Only enter families if they attended at least 1 session Do not enter the names of any families that registered, but did not
attend any sessions. Skip the coded family spaces as necessary Be sure to enter a “0” if a program participant was absent on any given
week For each participant, indicate if a pre/post or retrospective survey was
administered Only enter youth participating in the youth session. Do not enter
siblings in childcare Adults assuming the primary role for childrearing should be entered as
the male and female caregivers (parents, stepparents, foster parents, grandparents, etc…). Others living in the home and attending with the primary caregiver(s) can be entered as other adults
Enter Pre/Post and Retrospective Survey Responses for all adult participants in each program
PCCD sites are expected to utilize the pre/post survey except when participants do not attend week 1
When the retrospective survey is used, the Before Column is entered as the pre survey responses and the Now Column is entered as the post survey responses
Note that the names of participants will populate the columns with the matching participant codes. Only enter data in columns that have a name above them
Refer to the Family Identifier & Attendance Form to enter coded survey data accurately
Enter youth pre/post and retrospective survey answers in this tab
Survey and data entry instructions are the same as for the parent/caregivers
Make sure to enter all pre, post, or retrospective survey data for each youth
The Fidelity Tabs are where you will enter data from the fidelity observations for the parent, youth, and family components of all observed sessions.
You are required to observe and enter data for 2 observations of each component during every 7-week program. Observations should be completed between weeks 2 and 6.
Enter the summary data for each section of the observation forms from all 6 observations (at a minimum).
You will be able to enter data for session 1 and session 7, however, observing these sessions will not meet PCCD’s requirement.
The tool will automatically calculate the average percentage of fidelity for the components of all observed session’s entered (Report Tab).
The total number of observations and the number of observations rated above 75% will summarize in the Process PMs Tabs.
PCCD only looks at curriculum and delivery adherence scores, not room and equipment or group participation scores.
When entering survey data for caregivers and youth, you should also enter the facilitator ratings and comments from the surveys
This information is entered after the survey responses for each surveyed individual
The data is summarized at the end of the workbook for each quarter on the Facilitator Ratings and Comments Tabs
Remember to enter the names of the facilitators on the Facilitator Rating Tab
Survey Administration Tip: When preparing the post surveys for printing/administration, remember to type in the facilitators names.
Process PMs 4-13 should now be populated based on the data you have entered.
If these totals do not meet your expectations check the following:o Did you enter all attendance data?o Did you enter pre AND post, or retrospective data?
If the data does not seem to accurately reflect what you have entered, please contact the EPISCenter at:
814-867-3037
After entering pre and post data for several individuals go back to the outcomes tab to verify that the data is being summarized correctly there.
If it is not, check the following:o Did you enter the data in the correct quarter that the individuals
completed the program?o Did you enter both pre (before) and post (now) test data?
If you check these common errors and data is still not summarizing correctly, contact the EPISCenter at:
814-867-3037
Is all data entered as accurately as possible? Do all yellow cells for the quarter have data?
o Zeros count! Do not leave any yellow cells blank.o Put your name on your work! Be certain that the contact
information on the Process PM Tab is filled in.
Save your spreadsheet to your computer. Navigate to the Instructions Tab and click on the green
“Auto Save” button. Attach the new “de-identified” version of your
spreadsheet with your quarterly report in Egrants.
Impact data is a crucial part of demonstrating the value of SFP 10-14 to your community.
The data belongs to your site and can be shared in a variety of ways:
o Print and Distribute the Report Tabo Create your own report using the summary datao Utilize one of the templates available on the SFP 10-14 page of the
EPISCenter Website• http://www.episcenter.psu.edu/ebp/strengthening/outcomemeasurementtools
Use the data in your required year 2 outcomes report. Share your data with program staff (facilitators) to help guide
model adherence and to help them realize the impact their dedication to quality delivery can have.
Your spreadsheet is reviewed each quarter by the EPISCenter.
Please make requested corrections in a timely manner. The accuracy of your spreadsheet submission impacts
the ability of the state to demonstrate the impact of SFP 10-14 in PA.
