Category Archives: Learning4

Data Collection and Program Improvement

Welcome to Module Four! There are seven key steps in the evaluation and performance measurement process.  In Module 4, we will focus on Steps Five, Six, and Seven: Define the problem. Implement evidence-based programming. Develop program logic. Identify measures. Collect … Continue reading

Posted in Learning4 | Leave a comment

Data Collection and Program Improvement

Darcy has developed a strong set of process and outcome measures for her mentoring program. Even though she is not a professional evaluator, Darcy is able to demonstrate that she has a strong program design and will monitor program implementation … Continue reading

Posted in Learning4, sub | Leave a comment

Hiring an Outside Evaluator

Once her program has been fully implemented and has operated long enough to have an impact, Darcy may want to consider hiring a professional evaluator. If so, she should consult Hiring and Working With An Evaluator, a briefing paper that can … Continue reading

Posted in Learning4, sub | Leave a comment

Step Five: Collect and Analyze Data

Darcy thinks about ways she can collect important program data. Data: Documented information or evidence of any kind. Darcy needs to measure the relationship that the youth and mentor develop during the program, the youths’ bonds to school, and youths’ prosocial … Continue reading

Posted in Learning4, sub | Leave a comment

Step Five: Collect and Analyze Data

Anecdotal Evidence You might be tempted to show that a program is working by providing anecdotal evidence.  An individual might cite one or two instances of a certain result as “proof” that a program is working effectively without considering whether … Continue reading

Posted in Learning4, sub | Leave a comment

Step Five: Collect and Analyze Data

Once data have been collected, they need to be analyzed. Data should clearly demonstrate whether or not a program met its objectives. Since most juvenile justice programs are trying to change attitudes and/or behaviors, data analysis usually focuses on: Whether … Continue reading

Posted in Learning4, sub | Leave a comment

Step Five: Collect and Analyze Data

Data analysis will show that one of four possibilities has occurred: You realize that your program was implemented as designed and your objectives were achieved. You realize that your program was implemented as designed, but you did not reach your … Continue reading

Posted in Learning4, sub | Leave a comment

Step Five: Collect and Analyze Data

Let’s look at the first possibility:  You realize that your program was implemented as designed and your objectives were achieved.  This scenario is ideal. How should Darcy respond? She might want to consider hiring an evaluator.  Because Darcy has chosen … Continue reading

Posted in Learning4, sub | Leave a comment

Step Five: Collect and Analyze Data

The second possible result after data analysis is that you realize your program was implemented as designed, but you did not reach your intended objectives.  If this occurs, consider the following questions: Did something happen independent of the program that … Continue reading

Posted in Learning4, sub | Leave a comment

Step Five: Collect and Analyze Data

The third possible result after data analysis is that you become aware that your program was not implemented correctly and your objectives were not achieved.  If this has occurred, focus on reasons why program implementation did not occur as it … Continue reading

Posted in Learning4, sub | Leave a comment

Step Five: Collect and Analyze Data

Finally, let’s consider the fourth potential result of data analysis: You realize that your program was not implemented as designed, but your objectives were achieved.  While this is unusual, it is certainly possible. Let’s consider one of Darcy’s program activities: … Continue reading

Posted in Learning4, sub | Leave a comment

Step Six: Report Findings

It is important that Darcy include a plan for reporting data in her letter to the Mayor.  Remember that four requirements were listed as responsibilities of each applicant. These included:  Substantial information demonstrating the existence of the youth-related problem the … Continue reading

Posted in Learning4 | Leave a comment

Step Six: Report Findings

To make her application stronger, Darcy should mention ways she will analyze and report her findings once she is able to collect data.  She should state how she will collect data related to her original goal, objectives, and activities, and … Continue reading

Posted in Learning4, sub | Leave a comment

Step Six: Report Findings

In addition to a report outline, Darcy submits a program timeline with her application. In planning her program, Darcy comes up with the following timeline that she will abide by: Northwest Community Center Mentoring Program Timeline Year 1 Months 1-3 … Continue reading

Posted in Learning4, sub | Leave a comment

Step Seven: Reassess Program Logic

The final step in the evaluation process is to look at the program’s impact overall, and return to the logic model to see if it needs modification.  The data analyses lead to conclusions about how well the program has fulfilled … Continue reading

Posted in Learning4 | Leave a comment

Step Seven: Reassess Program Logic

If you have implemented an evidence-based program correctly, measured consistently, and the problem still exists, you probably need an evaluation to determine why the program has failed to meet its goal(s).  A thorough evaluation will separate the program’s impact from … Continue reading

Posted in Learning4, sub | Leave a comment

Final Quiz

Posted in Learning4 | Leave a comment

Tutorial Completion

Great job!  You have completed the NJJEC tutorial.  Let’s review the seven steps of performance measurement and evaluation: Define the problem. Implement evidence-based programming. Develop program logic. Identify measures. Collect and analyze data. Report findings. Reassess program logic.   Questions?  … Continue reading

Posted in Learning4 | Leave a comment