Wednesday 6 February 2013

Assignment 3: Evaluation Assessment

Assignment 3:  Evaluation Assessment
 
Centennial Collegiate Dance Academy:  What happens when things change?
         
 
 Engage Stakeholders

 

Who should be involved?

Participants in the dance academy, teachers, administration

How might they be engaged?

It will be a participatory/collaborative evaluation, so the results will directly inform future decision making.

 

          Focus the Evaluation

 

What are you going to evaluate?  Describe program (logic model).

The Centennial Collegiate Dance Academy.  Students in grades 9-12 can choose Arts Ed 9, Dance 10, 20 or 30 and receive a fine arts credit.  The academy has undergone a staffing change and there have been a few problems since the change. I would like to evaluate whether or not the students are gaining the same skills and maintaining the same level of engagement as the academy was previously experiencing.  Was the sole success of the program reliant on who was teaching the program. 

What is the purpose of the evaluation?

To answer questions about the success of the program with any teacher leading it.  Are there specific curriculum components that make the program more or less successful?

Who will use the evaluation? How will they use it?

Who/users
How will they use the information?
Students
Students will be able to see state their opinion/views on the program’s success; therefore having a say in program effectiveness.
Guidance Counsellors
To be able to make informed recommendations to future participants in the program.
Administration
To see whether the program is maintaining effectiveness despite staffing changes.

What questions will the evaluation seek to answer?

Why has the program suffered in the last year? Strengths/Weaknesses? 
Are students developing/increasing their dance skill?
Are students satisfied with the program?

What information do you need to answer the questions?

What I wish to know
Indicators – How will I know it?
How has the program changed?
Asking students who have been with the program for the past 4 years  
Are the needs of the students being met?
 Enjoyment/Engagement
 Are students satisfied with the program?
Offering an alternatives to the program
 How can we get more boys involved in the program?
 increase in male enrolment

 

When is the evaluation needed?

For staffing purposes before the end of June.

What evaluation design will you use?

Rippey – Transactional

          Collect the information

 


What sources of information will you use?

Existing information:
Previous evaluation plan
People:
Current dance instructor, developer of the program
Pictorial records and observations:
 

 

What data collection method(s) will you use?

x
Survey
 
Document review
x
Interview
 
Testimonials
x
Observation
 
Expert panel
 
Group techniques
 
Simulated problems or situations
 
Case study
 
Journal, log, diary
 
Tests
 
Unobtrusive measures
 
Photos, videos
 
Other (list)

 

Instrumentation: What is needed to record the information?

A questionnaire/survey.
 

 

When will you collect data for each method you’ve chosen?

Method
Before program
During program
Immediately after
Later
Survey
 
 
X
 
Interview
 
X
 
 
Observation
 
X
 
 

 

Will a sample be used? 

 

No
x
 
Yes
 
If yes, describe the procedure you will use.

          Analyze and Interpret

 


How will the data be analyzed?

Data analysis methods:
I will read the data, tabulate and analyze it.
Who responsible:
I am.

 

How will the information be interpreted—by whom?

Firstly by me, then by student services.
 

 

What did you learn? What are the limitations?

The limitations will be in the responses from the students.  Are there teenage emotions coming into play, instead of factual issues.
 

 

 


               Use the Information

 

How will the evaluation be communicated and shared?

To whom
When/where/how to present
Dance instructor
Upon completion of the evaluation/meeting/written report
Administration
Upon completion of the evaluation/meeting/written report
 
 
 
 

Next steps?

 

 

          Manage the evaluation                 Standards

x
Human subject’s protection
 
Utility
 
Management chart
 
Feasibility
 
Timeline
x
Propriety
x
Responsibilities
 
Accuracy
 
Budget 
 
 

 

2 comments:

  1. HI Krissy sorry but my original feedback must have been lost in the ether.
    I think that you have done a good job of addressing the main points. I believe that there is room to add more detail. Would a teacher also be someone who wold use the results of the evaluation? The section on instrumentation just mentions a survey but you also have other potential collection methods listed in the previous section. I was hoping to see what you have learned so far about the program based on your initial review and your thoughts related to the next steps in the assessment and planning process. When you are putting together your evaluation plan make sure you explain how you will manage the evaluation and look after the concerns of the stakeholders and the participants. The more information you have in this section the easier it is to craft your final evaluation plan.

    Jay

    ReplyDelete
  2. Thank you for the feedback Jay. It is really helpful!

    ReplyDelete