Program Monitoring and Evaluation

Components of Program Monitoring

Systems

Establishing systems — clearly defined procedures — is key to effectively managing a Program Director’s many administrative duties and ensures sustainability of your unique AmeriCorps program operations should any staffing changes occur. To provide as detailed instruction as possible, each system should include the following five elements:

  • Objective – the end goal of each system
  • Frequency – how often various key duties will be performed (i.e., weekly, monthly, etc.)
  • Mode – a step-by-step process for achieving that end goal
  • Distribution – information on how documentation will be collected and maintained
  • Persons Responsible – assignment of responsibility for system components to appropriate program staff.

CCCS requires its AmeriCorps*State programs to submit for monitoring systems for the following essential operations associated with AmeriCorps program management:

  • Member recruitment
  • Program-defined background check criteria
  • Member documentation collection
  • Member training, education & development
  • Member supervision
  • Processing member timesheets
  • Monitoring member hours & exiting
  • Member disciplinary action
  • Member death or injury
  • Host (service) site relations
  • Program promotion & online presence

The required systems listed above must meet at minimum the standards illustrated in the Risk-Based Monitoring Tool Part I – Systems. Additional detail is welcome, and additional systems beyond those contained on this list may be created and maintained by programs at program discretion, but are not required for review by CCCS Program Officer.

Compliance Site Visits

Compliance Site Visits are conducted to assist with program development and implementation as well as to ensure compliance with CNCS and CCCS rules and regulations. Your CCCS Program Officer will typically visit eligible programs once per year. Components of the site visit are divided into five components: 1) systems review (see Systems section), 2) program compliance, 3) member discussion, 4) AmeriCorps program staff discussion, 5) host (service) site visit and site supervisor discussion. Programs in their first year of a grant cycle (including re-compete programs) will complete all parts of the visit. Programs in the second or third year of their grant cycle will be exempt from Parts 2-4, unless any of the following circumstances are present:

  • Prior monitoring visits identify insufficient documentation and/or systems
  • Program has newly hired primary staff member
  • Program demonstrates a need for additional support
  • Program requests additional support
  • Program maintained less than 70% recruitment and/or retention
  • Program has significantly increased their grant
  • Program has significantly changed its performance measures
  • Program fell significantly short in reaching their performance measures
  • Program demonstrated findings in Part 3 (member discussion) of a previous site visit (Please note, in the event of this finding, the program will only be required to repeat Part 3 of the Compliance Site Visit.)
  • Program demonstrates concerns regarding prohibited activities
  • Program has repeatedly failed to comply with reporting deadlines

Compliance Site Visits will be scheduled by your CCCS Program Officer. Should the date determined present an unresolvable conflict, please contact your CCCS Program Officer well in advance to reschedule.

Preparing for a Compliance Site Visit

To prepare for a Compliance Site Visit, program staff should:

  1. Review the Risk-Based Monitoring Tool Part 1 – Systems and Part II - Compliance provided by your CCCS Program Officer.
  2. Ensure that all systems (above) have been updated as requested prior to your scheduled site visit date.
  3. Prepare all related documentation for components of the Risk-Based Monitoring Tool Part II - Compliance for the scheduled visit date.
  4. Ensure that all required parties (members, appropriate program staff, member supervisors/ host site supervisors) will be available for the scheduled visit date.

Note: This should typically be verified with your CCCS Program Officer at least one to two weeks prior to the visit.

  1. Verify that member timesheets are properly completed, signed and up-to-date.
  2. Ensure that there is a private meeting space available for CCCS staff to meet with program staff, host site staff and members. A table with chairs should also be available in the space.
  3. Ensure that CCCS staff will have access to all necessary files (see Risk-Based Monitoring Tool Part II - Compliance).
  4. Provide any additional information requested by CCCS staff.

After the Compliance Site Visit

After the visit, the AmeriCorps Program Director will receive feedback in a site visit report. Your CCCS Program Officer will provide this to the AmeriCorps Program Director and the designated Executive Director of the program’s legal applicant.

Note: It is important to ensure that your program keeps all requested program/legal applicant contact information up-to-date with the Commission. Program Directors must submit contact information to the CCCS Program Officer in writing (email is acceptable).

Program Directors must respond to any findings indicated in the site visit report with a corrective action plan and provide requested documentation by the date specified in the report. If it is determined that your program has significant compliance issues or requests additional assistance, your CCCS Program Officer may schedule additional site visits.

Desk Monitoring

While site visits can provide a first-hand view of program operations, desk-based monitoring is an indirect, yet invaluable view of your program’s management. Using the My AmeriCorps Portal in eGrants the Commission will review each program and service site’s progress on member recruitment and retention and conduct member status inquiries (i.e. enrollment, exit, suspension). And, using the OnCorps Reporting Portal, the Commission will accept systems document submissions from programs and monitor member documentation progress. Findings that are not in compliance with AmeriCorps Regulations and Terms & Conditions for AmeriCorps State and National Grants or CCCS policies and requirements will be documented in a Compliance Citation (see Compliance Citations Below).

Days of Service Tools

Although programs are encouraged to participate in and promote all national service days of service and commemorations, programs must participate in and then submit AmeriCorps Day of Service Monitoring Tools for the following required national service recognition events:

Martin Luther King, Jr. Day of Service: All AmeriCorps*Connecticut programs must implement a service project in celebration of Martin Luther King, Jr. Day. Programs nationwide celebrate Martin Luther King, Jr., Day as a "day on, not a day off" by engaging youth, neighbors, partners, and businesses in service projects that promote Dr. King's legacy of service and justice. Resources are provided by CNCS to assist programs in planning an effective MLK Day service project. The designed service project must include all AmeriCorps staff and members. AmeriCorps*Connecticut programs may collaborate with each other and with community partners.

AmeriCorps Week: All AmeriCorps*Connecticut programs must refer to their Grantee Agreement for specific instructions regarding any Commission-defined requirements for program participation in AmeriCorps Week, dates for which are set by CNCS to occur annually during the second full week in March from Sunday to Saturday. AmeriCorps Week is set aside to highlight the impact AmeriCorps members have all over the country each and every day; in addition to meeting any Grantee Agreement requirements, AmeriCorps*Connecticut programs are strongly encouraged to participate in promoting awareness in their communities and at large about their AmeriCorps impact via social media and participation in events and activities visible in the community.

Descriptions of all service days and commemorations are available in the AmeriCorps Events section.

Performance Measures

Performance measurement is the systematic, ongoing tracking of your program’s outputs and outcomes. Performance measures are used to gauge your program’s progress on addressing its defined community need. Program staff must have detailed and accurate procedures for tracking performance measures. Program Directors, key staff and, where appropriate, AmeriCorps members should be informed about the program’s performance measures and how that data is assessed and maintained. Performance Measures will be monitored by your CCCS Program Officer on a quarterly basis (see below).

The Corporation has developed a comprehensive resource center that describes all National measures, in detail, by priority area. You may review these measures by visiting the CNCS website: http://www.nationalservice.gov/resources/performance-measurement.

If you are considering adjusting your program performance measures, mid-year, please consult with your CCCS Program Officer as early as possible. All requests for Performance Measure amendments must be received by February 28th annually. (See Table 1: Program Amendment Reporting).

Program Progress Reporting

The Connecticut Commission collects Program Progress Reports on a quarterly basis; these reports are submitted by programs electronically using the OnCorps Reporting Portal; each program will be provided with a link and login instructions to access the portal at the start of the program year.

Program Progress Report includes:

  • Demographic Information
  • Recruitment and Retention Data
  • Performance Measures
  • Disability and Inclusion
  • Member Timekeeping Reports
  • Great Stories/Photos (featuring member and program success stories)

As detailed in your program grant agreement, progress reports are due on or before the 15th day of the month following the end of the quarter:  January 15, April 15, July 15 and October 15.

NOTE: It is expected that all progress and financial reports due to the Commission will be received by their respective due dates. Program directors should coordinate with fiscal and other relevant program staff to ensure that all deadlines are met. Late submissions may lead to delayed or withheld reimbursements.

 

Compliance Citations

Compliance Citations will be issued to programs that are found out of compliance with CNCS or CCCS requirements at any point in the program year. Compliance citations will be issued by the CCCS Program Officer and maintained in the program’s file. Program Directors are responsible for disseminating information contained within a Compliance Citation to the appropriate program staff. They are also responsible for ensuring that any required corrective action and reporting is completed as requested. An accumulation of compliance citations may lead to withheld, delayed, or suspended grant payment requests. These citations will also be considered during evaluation of continuation and re-compete funding requests.

Program Evaluation

All AmeriCorps programs are required to conduct a program evaluation process. This process is broken into three components timed to occur over the cycle of three AmeriCorps grant periods of three years each. See

Table 3 Evaluation Timing for a description of what components of the evaluation process apply to your program based on its grantee status. Re-competing and continuation programs must submit a summary of their evaluation efforts/plans to date or a copy of their evaluation results with their annual application for funding.

 

Evaluations may be performed internally or independently, depending on the amount of CNCS grant funds received by your program (45 CFR§2522.700-740).

 

  • AmeriCorps regulations require AmeriCorps*State and National grantees receiving more than $750,000 of CNCS grant funds to conduct an independent evaluation. Independent evaluations must use an external evaluator with no formal or personal relationship to the organization.
  • AmeriCorps*Connecticut Formula and Competitive receiving less than $750,000 of CNCS grant funds can submit an internal evaluation (see Table 2 Evaluation Type).

 

The evaluation process is a helpful tool in assessing and developing improvements to your program that may enhance future funding applications. There are different types of evaluation designs that can be used, depending upon what you wish to assess about your program. For more detailed information about evaluation designs and planning, please see http://www.nationalservice.gov/resources/evaluation