R10 Indian General Assistance Program

Environmental Results & IGAP Assistance Agreements

ATCEM 2008

• EPA’s Mission: to protect human health and the environment

• EPA Awards: approximately ½ its budget (~$4 billion/ FY) in Assistance Agreements

• EPA Assistance Agreements: key ways by which, in partnership with other governments and organizations, environmental protection is delivered to the public

• EPA’s Obligation: to ensure that work funded through Assistance Agreements furthers the Mission and achieves environmental benefits for the taxpayer

• addresses EPA Grants Management Plan Goal 5: Support Identifying and Achieving Environmental Outcomes

• establishes EPA policy for addressing environmental results under EPA Assistance Agreements

• ensures that EPA Assistance Agreements are results oriented and aligned with EPA’s Strategic Goals.

• is implemented through existing regulatory requirements for work plan development and performance evaluation in 40 CFR Part 35

• addresses environmental results in 3 stages of the assistance process:

1) Funding Announcements (application/ funding process) 2) Work Plan Development (containing anticipated outputs & outcomes)

3) Performance Reporting (including results & performance measures)

What’s EPA Order 5700.7 ?Environmental Results under EPA Assistance Agreements

What’s 40 C.F.R. Part 35 B ?Environmental Program Grants to

Tribal Governments

• establishes administrative requirements for Assistance Agreements, supplementing EPA’s general requirements in 40 CFR Part 31

• includes provisions to improve accountability for environmental programs and performance

• requires explicitly defined:

- work plans- outputs and outcomes- work plan component timeframes and funding amounts- performance evaluation process- performance reporting schedule

R10’s Tribal Trust & Assistance Unit ?

• recognizes the importance of linking IGAP Assistance Agreements to EPA’s performance goals

• ensures that Assistance Agreement announcements, work plans, funding recommendations, and performance reports discuss anticipated environmental results and how they will be measured

• addresses criticism of EPA and IGAP concerning the issuance of grants without clearly noted and well-defined expectations of measurable results/ outcomes

How Do We Demonstrate Environmental Results?

A. Outputs & Outcomes• help define, explain, and communicate to others• the purpose, and the expected environmental results of the project

B. Logic Models & Workplans• logic models are diagrams used to identify outputs and outcomes• help develop logical progression from tasks to outputs to outcomes• explain how an outcome or output supports a goal or objective• provide sound basis for work-planning and performance reporting by

connecting resources and activities with desired, measurable results

C. Performance Measures & Reports• performance measures are target values for outputs and outcomes• are metrics used to gauge program or project performance• should be built into outputs and performance reports• both help you manage projects, and assure you and EPA that you have

accomplished the purpose of the project

So What’s a Logic Model?

A logic model is a diagram and text that shows the logical (causal) relationships between program elements and the problem to be solved, and defines measurements of success.

We use these resources…

We use these resources…

For these activities…

For these activities…

To produce these outputs…

To produce these outputs…

So that these customers can change their ways…

So that these customers can change their ways…

Which leads to these outcomes…

Which leads to these outcomes…

Leading to these results!

Leading to these results!

And What are Outputs & Outcomes?

Outputs/ Deliverables: • environmental activities, efforts, and/or associated work products that will

be produced or provided over a period of time or by a specified date to support an environmental goal or objective

• must be measurable during the assistance agreement funding period• in short- the products

Outcomes: • results, effects, or consequences that will occur from carrying out an

environmental program or activity to support an environmental or programmatic goal or objective

• may be knowledge, behavior, environmental, health-related, or programmatic results

• must be quantitative, not necessarily achievable in funding period• in short- the impacts

What Does a Logic Model Show?

Inter-mediate

Changes in behavior, practice or decisions.

Behavior

Inter-mediate

Changes in behavior, practice or decisions.

Behavior

Customer

User of the products/ services. Target audience the program is designed to reach.

Customer

User of the products/ services. Target audience the program is designed to reach.

Activities

Things you do– activities you plan to conduct in your program.

Activities

Things you do– activities you plan to conduct in your program.

Outputs

Product or service delivery/ implementation targets you aim to produce.

Outputs

Product or service delivery/ implementation targets you aim to produce.

Resources/ Inputs:

Programmatic investments available to support the program.

Resources/ Inputs:

Programmatic investments available to support the program.

Short-term

Changes in learning, knowledge, attitude, skills, understanding.

Attitudes

Short-term

Changes in learning, knowledge, attitude, skills, understanding.

Attitudes

Long-term

Change in condition.

Condition

Long-term

Change in condition.

Condition

External Influences

Factors outside of your control (positive or negative) that may influence the outcome and impact of your program/project.

External Influences

Factors outside of your control (positive or negative) that may influence the outcome and impact of your program/project.

Outcomes

WHYHOW

PROGRAM RESULTS FROM PROGRAM

Outputs and Deliverables for IGAP?

Outputs/ Deliverables: • activities, efforts, work products

Example IGAP Outputs/ Deliverables: • conferences attended / materials and contacts gathered, travel reports shared• meetings held / agendas, notes, materials collected • issues researched / materials gathered, files created, presentations made• reports generated/ reports shared and submitted• newsletter articles written / newsletters published and submitted• solid waste management planning / SWM plan shared and submitted • baseline assessments conducted / summary reports shared and submitted• community clean-ups / bags or pounds of litter removed and reported

Output Test:• Will you do it or make it? Is it measurable? Can you count it, or give it a

quality rating?

Short-term, Intermediate, and Long-term Outcomes?

Outcomes: results, effects, or impacts of work

• short-term/intermediate (this year> next few years- knowledge/behaviors)• intermediate/ long-term (next 2 >20 years- behaviors/conditions)

Example Short-term/Intermediate Outcomes: • increase tribal knowledge of environmental issues and protection• increase tribal knowledge of technical resources and funding opps• increase tribal knowledge of grants administration• increase admin capacity to respond to local environmental concerns• decrease amount of litter in community and recyclables in landfill

Example Intermediate/Long-term Outcomes:• increase in tribal actions protective of the environment • increase in resources and funding sought and obtained by tribe• increase tribal programmatic capacity to address local env issues• increase quality and safety of environment and subsistence resources

Outcome Test:• Should it happen because of your work? Is it quantitative? Can you put the

words “increase” or “decrease” or “number of” in front of it?

Behavioral Outcomes

• Regulated entities implement Reduction Plan recommendations

• Coordination increases between trade associations, local colleges, regulated entities, and local governments

• Regulated entities more safely manage hazardous waste and toxic chemicals during storage and transportation

• Regulated entities improve compliance and “beyond compliance” rates

Activities

• Assist with preparation and implementation of Reduction Plans and meeting regulatory requirements through site visits and follow-up visits, training seminars and workshops, fielded phone calls, educational materials, etc.

Resources (FY 03)

• 6.6 FTE

• $ 0.52 million

Outputs

• Site visits and follow-up visits

• Recommen-dations

• Training seminars and workshops

• Published information and outreach materials

• Fielded phone calls

• Public meetings

Knowledge Outcomes

• Regulated entities increase understanding of regulations and what it will take to achieve regulatory compliance

• Regulated entities increase understanding of “beyond compliance” options

Environmental Outcomes

• Regulated entities use fewer toxic chemicals and generate less hazardous waste

• Regulated entities safely dispose of toxic chemicals and hazardous waste

• Regulated entities reduce the severity of toxic and hazardous spills

Customer

• Large Quantity Generators of hazardous waste

• Small Quantity Generators of hazardous waste

• Conditionally-Exempts Generators of hazardous waste

• Reporters to the Toxic Release Inventory

Goals: Protect public health, safety, and the environment from the risks associated with using toxic chemicals and generating

hazardous waste; improve regulatory compliance; and reduce management and disposal costs.

Oregon’s Toxic Waste Reduction Assistance Program

Program outcomes related to factor(s)

- HOW - WHOWHAT and WHY

External Influences:

OutcomesResources/ Inputs Activities Outputs Customers

reachedShort-term(change in attitude)

Intermediate(Change in behavior)

Long-term(change in condition)

Logic Modeling Activity

More to do before you start writing.

• Carefully read the funding announcement.

• Call the potential funder to discuss your priorities to see if they match.

• If you plan on using contractors, begin requesting information about costs and typical rates for the work you are considering.

Ok, now you can start writing.

IGAP proposals should have:

• narrative introduction

• Workplan

• detailed budget

Contents of Narrative

• Description of the Tribe

• It’s administrative capacity

• Tribes history with IGAP program.

• Background info. on the environmental issues to be addressed by this workplan.

• Tribes long term environmental goals that will be supported in this workplan.

• Part 35 requirements

Tribal descriptionThese are things that are helpful for a reader to know

about your Tribe. • Where is it located? • Cultural groups?• How many members? • Community population?

Administrative Capacity

• Is your Tribe a compacting or self governance Tribe?

• Does it have regular audits?• What other programs are administered?• How many employees?• Current financial policies and procedures?• Current personnel policies and procedures?• Financial policies and systems?• Past issues?

History with IGAP program

• How long has the Tribe had the IGAP?

• Accomplishments with IGAP?

• Not achieved some goals?

• Past issues?

• Changes or corrective actions.

Background information on Environmental issues

“Narrative description of risks to human health and the environment to be addressed by the applicant, and their relation to any environmental assessment or strategy efforts conducted to date.”

• Describe the problems to be addressed with this workplan.• What has been tried in the past?• Does the work you are proposing relate to an environmental or

strategic plan that is currently in place? • Who are your partners?

Project Officer’s note: Update your description to match this years workplan!

Tribe’s long term environmental goals

• What is the change that the Tribe is working toward? (Vision Statement, Goals – Logic Model?)

• This is a long term outcome. • Remember that outcomes can be accomplished after the

grant’s project period is completed.

• Outcome: The result, effect or consequence that will occur from carrying out an environmental program or activity that is related to an environmental or programmatic goal or objective. Outcomes may be environmental, behavioral, health related or programmatic in nature, must be quantitative, and may not necessarily be achievable within an assistance agreement funding period. (From 2006 IGAP Guidance)

Example IGAP Workplan Component 1

Outputs/

Outputs/

Example IGAP Workplan Component 2

Example IGAP Workplan Component 3

Outputs/

Example IGAP Workplan Component 4

Outputs/

Example IGAP Workplan Component 5

Outputs/

Example IGAP Workplan Component 6

Outputs/

R10 Tribal Coordinators?

• link proposed results in Assistance Agreements to EPA’s Strategic Plan and Government Performance & Results Act (GPRA) Architecture

• ensure that expected outputs and outcomes are appropriately addressed in Assistance Agreement funding announcements, workplans, funding recommendations, and performance reports

• review recipient performance and progress in achieving outputs and outcomes, ensure that reports comply with 40 CFR Parts 31 & 35, and document it in official project file and Grantee Compliance Database

• consider how the results from completed Assistance Agreement projects contribute to EPA’s programmatic goals and objectives

• report significant results information from completed projects as part of EPA’s Annual Report process and internal evaluation system

EPA’s IGAP Logic Model!

Outputs/

References & Resources ?

• Indian General Assistance Program 2006 Grant Administration Guidance- http://www.epa.gov/indian/pdfs/gap2006.pdf

• IGAP Guidelines on Awards and Management of General Assistance Agreements- http://www.epa.gov/indian/pdfs/gap2000.pdf

• Indian General Assistance Program Act of 1992- http://www.epa.gov/indian/pdfs/4368b.pdf , http://www.epa.gov/indian/pdfs/pl103155.pdf

• EPA: Laws & Regulations- http://www.epa.gov/epahome/rules.html#codified

• EPA Office of Grants & Debarment: Policy Regulations & Guidance- http://www.epa.gov/ogd/grants/regulations.htm

• EPA's Policy for Environmental Results Under EPA Assistance Agreements (EPA Order 5700.7)- http://www.epa.gov/ogd/grants/award/5700.7.pdf

• 40 CFR Part 35- http://www.access.gpo.gov/nara/cfr/waisidx_02/40cfr35_02.html

• 40 CFR Part 31- http://www.access.gpo.gov/nara/cfr/waisidx_05/40cfr31_05.html

• EPA’s Grants Management Plan- http://www.epa.gov/ogd/EO/finalreport.pdf

• EPA’s Strategic Plan- http://www.epa.gov/ocfo/plan/2003sp.pdf

R10 Indian General Assistance Program

Environmental Results & Assistance Agreements

ATCEM 2008