ࡱ> 352 ,bjbj ., ||  /111111$JUUj    / /  P /P 0,H UU"| : Apply a Rubric to a Student Product Select a student product whose evaluation would provide evidence that students have met a particular outcome. Student products particularly suitable for this method include, but are not limited to, an essay, a research project, a demonstration, an oral presentation, an exhibit, a performance, a team project, a portfolio, an embedded question on an exam, and so forth. Create a rubric, checklist, or some other list of criteria against which you will evaluate the student product. One common type of rubric includes a set of criteria (e.g., citation) that subdivide the outcome (e.g., research skills) along with descriptions and levels of proficiency (e.g., satisfactory: demonstrates adequate knowledge of MLA citation with a few minor errors). Take a random sample of student products in one or (preferably) more courses or course sections that address the outcome (at the same level or at two different levels if demonstrating value added/progress is desired). Sample sizes do not need to be large. Select a manageable number of products whose number would satisfy you and allow you to come to some reasonable conclusions. Sampling methods also do not need to be complex. Select a method that you can justify and rationalize. Remove student and instructor identifiers from the sample, as you are assessing student learning in the aggregate, not individual students and certainly not instructors. Calibrate scorers by reviewing the rubric, asking them to score an example at each proficiency level, reviewing the scores, coming to some agreement about the scores, and scoring more sample products until the scorers have achieved an acceptable level of inter-rater reliability. Divide the products into manageable subsets, asking a team of two scorers to score each subset preferably together so that they can resolve differences as they score. If scorers do not score together, then you will need to devise a method for resolving differences. One common method is to bring in a third scorer. Aggregate the results across the subsets of products, compute numbers and percentages, and insert them in a summary rubric of results. Share the results with the faculty, evaluate the results against the achievement target, and discuss strategies for improving teaching and learning and/or assessment methodology. $M D E O P u V]\]d,hyh @}h/Bh_h hCXhV}h^Zh&hohh}Mh}Mh}M5 $%  x, & Fgd}M$a$gd}M ,1h/ =!"#$% ^ 2 0@P`p2( 0@P`p 0@P`p 0@P`p 0@P`p 0@P`p 0@P`p8XV~_HmH nH sH tH @`@ NormalCJ_HaJmH sH tH DA D Default Paragraph FontRiR  Table Normal4 l4a (k (No List PK![Content_Types].xmlj0Eжr(΢Iw},-j4 wP-t#bΙ{UTU^hd}㨫)*1P' ^W0)T9<l#$yi};~@(Hu* Dנz/0ǰ $ X3aZ,D0j~3߶b~i>3\`?/[G\!-Rk.sԻ..a濭?PK!֧6 _rels/.relsj0 }Q%v/C/}(h"O = C?hv=Ʌ%[xp{۵_Pѣ<1H0ORBdJE4b$q_6LR7`0̞O,En7Lib/SeеPK!kytheme/theme/themeManager.xml M @}w7c(EbˮCAǠҟ7՛K Y, e.|,H,lxɴIsQ}#Ր ֵ+!,^$j=GW)E+& 8PK!Ptheme/theme/theme1.xmlYOo6w toc'vuر-MniP@I}úama[إ4:lЯGRX^6؊>$ !)O^rC$y@/yH*񄴽)޵߻UDb`}"qۋJחX^)I`nEp)liV[]1M<OP6r=zgbIguSebORD۫qu gZo~ٺlAplxpT0+[}`jzAV2Fi@qv֬5\|ʜ̭NleXdsjcs7f W+Ն7`g ȘJj|h(KD- dXiJ؇(x$( :;˹! I_TS 1?E??ZBΪmU/?~xY'y5g&΋/ɋ>GMGeD3Vq%'#q$8K)fw9:ĵ x}rxwr:\TZaG*y8IjbRc|XŻǿI u3KGnD1NIBs RuK>V.EL+M2#'fi ~V vl{u8zH *:(W☕ ~JTe\O*tHGHY}KNP*ݾ˦TѼ9/#A7qZ$*c?qUnwN%Oi4 =3ڗP 1Pm \\9Mؓ2aD];Yt\[x]}Wr|]g- eW )6-rCSj id DЇAΜIqbJ#x꺃 6k#ASh&ʌt(Q%p%m&]caSl=X\P1Mh9MVdDAaVB[݈fJíP|8 քAV^f Hn- "d>znNJ ة>b&2vKyϼD:,AGm\nziÙ.uχYC6OMf3or$5NHT[XF64T,ќM0E)`#5XY`פ;%1U٥m;R>QD DcpU'&LE/pm%]8firS4d 7y\`JnίI R3U~7+׸#m qBiDi*L69mY&iHE=(K&N!V.KeLDĕ{D vEꦚdeNƟe(MN9ߜR6&3(a/DUz<{ˊYȳV)9Z[4^n5!J?Q3eBoCM m<.vpIYfZY_p[=al-Y}Nc͙ŋ4vfavl'SA8|*u{-ߟ0%M07%<ҍPK! ѐ'theme/theme/_rels/themeManager.xml.relsM 0wooӺ&݈Э5 6?$Q ,.aic21h:qm@RN;d`o7gK(M&$R(.1r'JЊT8V"AȻHu}|$b{P8g/]QAsم(#L[PK-![Content_Types].xmlPK-!֧6 +_rels/.relsPK-!kytheme/theme/themeManager.xmlPK-!Ptheme/theme/theme1.xmlPK-! ѐ' theme/theme/_rels/themeManager.xml.relsPK] , , , 8@0(  B S  ?. . + . . pU808^8`0o(. ^`hH. pLp^p`LhH. @ @ ^@ `hH. ^`hH. L^`LhH. ^`hH. ^`hH. PLP^P`LhH.pU`@           /B}MCX^Z @}oV}&y_, . @A, H@UnknownG* Times New Roman5Symbol3. * ArialA BCambria Math"hMJ )^^!r4( ( 2QHX ?}M2!xx#Apply a Rubric to a Student ProductOwneredaffron Oh+'0  , L X dpx$Apply a Rubric to a Student ProductOwner Normal.dotm edaffron11Microsoft Office Word@6F@u{G@.P^՜.+,0  hp|  MUW(  $Apply a Rubric to a Student Product Title  !#$%&'()+,-./014Root Entry F0' /P6Data  1TableWordDocument.SummaryInformation("DocumentSummaryInformation8*CompObjy  F'Microsoft Office Word 97-2003 Document MSWordDocWord.Document.89q