Tuesday, October 9, 2012

What in the World is Inter-rater Reliability?


If you are a trained ATPPS Observer you are eligible to do observations for your colleagues even if you are NOT a BIL.

Each observation you do makes you eligible for a $50 stipend.


 BUT.....there is a hoop that you need to jump through first...

You must attend the
 PSI INTER-RATER RELIABILITY GALA

This fabulous gathering will be held
Monday, October 29th in the Media Center!

Mark Your Calendars now...
You won't want to miss it :)


Just for a giggle, I looked up Inter-Rater Reliability on Wikipedia and this is what I learned:

In statistics, inter-rater reliability, inter-rater agreement, or concordance is the degree of agreement among raters. It gives a score of how much homogeneity, or consensus, there is in the ratings given by judges. It is useful in refining the tools given to human judges, for example by determining if a particular scale is appropriate for measuring a particular variable. If various raters do not agree, either the scale is defective or the raters need to be re-trained.






Here is a simpler explanation of what this meeting will entail!




  • We will gather together to watch a couple of video examples of teachers teaching.
  • We will use the ATPPS Rubric to score the lessons.
  • We will talk about how and why we scored the items.

The shared conversation will help us have a common sense of what is Proficient or Basic.  This will make our observation coaching more consistent and cohesive.

 Remember....this meeting is mandatory for you to be on the list to do observations!

 
 If you have any questions about this....don't hesitate to ask!
I will send more information about the videos in a week or so!
Let me know if you need a copy of the scoring rubric.





No comments:

Post a Comment