邢唷��>� CG���,-FED��������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������€z餫�k懼W7剓詙3錞�( � � ���������n痂$9嘳�+?e~徐.�*)�塒NG  IHDR��陣�gAMA眻晿籀PLTE���ベ熭 IDATx滍��U澿1P$@|�躴蜙gxY;飩;9怀3粠+亮晀'塐退驽輣親獲妬賑星:琴q�5�5絮姩u�佔�6R圔W簥緘葵^'�{鯬�$�>}|轤o}i/#/#/#/#/#�?"宝边q4紝�q4 N脤D耚鲠群岯d铴三oRn屺獚@d>k�P煣劍��(f5倕怭畭c輋$d�Z庌�42 酒Z袀窒aH飕"罒蝍i/墑<�t� 枺1a�$R�X�6窹藽i茪倥2l``挷貸$湮F朄L�$儶0{ �*s抴�y� ,攘Ji瓳�霋G怞焎諍瑍f$鎺)y=F!扵$陰�3"u�/橺3V拖I髮H9奕b榛?�5^>"M_�$VJR�E 盰?���%�=:�2竣1肏]`�禕WUg鮶Ec�74$y�'�<�3债|膖 )upz�7蓲婩泗坄EC剬�?絝赡琑|z$枂崕蕊7W樢P絰Z�s;6鋩!温B萩n�)鸴�,�)阣埻8噀恭E蘗�腥l %�6僶� 踔�硫0o愬:(q#$�ⅲ乗|:$y8绦 ;E�#�$嗂?堅Qv賨)厔y�9Sj�< 恸 橤粛袲� ゝ%�頸\=e萍 芉T9掶鑕�蓪v岤攼�Bm(�+_圙#b苐嚚地Y ) 俶↘|罣"瓨U磵<爳`2h"�*� 6i�<0�,2�,耹`腱憟雙烲齦xd3亓h詎��墭Ep�&�2"X 脝鄜�1 �� O懖GC�cc�鮠"ο乺 漴 =>"貄鏙睥蕶E婹H�V貯'^叒M�-b鵟 t�2鵕�.�2e \�&Z�4�埢 c宎U�#R€睰H%FA��*蒝 懭 靎BX.�3�r>仒涸豂z~r,垹7r$瘋塧&Z嵢 ]b胨蚱 厾2冿\尦蒵D]槮藻働倘�*jF鑿O骍H犟 C縘�1Q �矹箳c&q^.鱮墊=F玴a"螧攛ā 员jE虪r毇悹�>ag雹Ms>"R~f€e瑽紃嗪P壚霰抝�衵PPV\wb泚eaCi舨癛u}�!8v貰c2翞6袽泥 孟贻q愫道o璂�4Ck魽€'鮺捩�!b� N璂D听l7姵蛀YC昂+_�+�$� -寉}K鶺�1s[0a:cl趢 B陻&金4"� �.j喒 幹佫裈�RНen萴熁�0�9~ 殸M=Rp娖(A舾 f�Uwb瘷潦�0 S菋� �4P�靽`2aNS�鄥� 得饼捠畧� #怖粕U�`<^桴<∝zUN�8F�l�!X�<册矟警挠+�擟珺郺B9缮�蛦�欃郈HR軸_PQ騻XF髮^b�驦�&B" *6P�POwD柛庯盙P榁€宫9�UP_猓YE骇�崣坼茸t{馢RU5�9緑�彏H篢F繃晵p<� !V^Lc鷯鞥+桰@圚簃:谸朇M�C葇N$苑�9︵璶m � N%�愆'� )湡D�! =輦娘cmDb牁孖凸$樦 "G�#$@e@`�!�︷丯篻3�S輪Ь排湞?Eo x�, !kE*Ra`渹犤磦$'鷱谼� ,檳?E� *韾�唳n覥$>u儮虓\櫃r奰C芚陧 社`瞇sI銩 "拹 i€1劯╰禸瑯輲�7kv墩N�?@�#o�d釵憼寬4�綝囻0燙賦!$�蔙�蠄鱇P� yH%睗燜 仯瑇Z撚Z~睂8z]悵03`暣节招&��8F.@鎹V鏑,�!L+`io�箽�3P慵镚HA弬d翢a郌炞�=#$普u[�xf<€嚷録烤?亃裭喉緡�ーuj瘯iL奓礭B}蘩(A籊@訂V�m 仐i寲闗dQ鈯裧凄A硰`>51u袝靈�"4c儧 �,@jX︿j # `烑�$�8胊�!;kU`鄏劾b�娻�2筿m�$1齶,$缷繰胐��-# �*哵'�籱�*鍡S糽鲬缼鳎鼶僮�!� ��r�J }ix彚0獣P�2%S坓⒕`尷�sr>贬既辑�散铺6<"!簁�A�*Dp� �/裉z0€4�� T"y�|l喅 I昄!3皟"5`�$聕�3�,1垹婛L2�%�狐﹙�"/�4!r署P判第瞏耪B�#詫tOt弻@v噲O谶G嬪吝欴f_鵛髩�+畅�B墕箑挀�=�z�((w缨~犿[阧I�X�关�)"埍崱��(养鹁'^詚>P靺�-� j�� �汸W�D窖糜谡O準�&�4詘爧-坉佢`z澽|C腱?gm蟩�帙j淂葀B樧賁b=坟=鋤B�9z���蛌�#f鷲\o勞�!5L殂�)s�+橗$B騪涧宙炑謾�痴`苗泮yR慗� ��-灟i�`*と W)襓-`掁G|_又鰧好轰�567A�"褌"歺滎O谹];繕�!1铫圕轂g� )&A郹�-祍{Hm舼痓ō倖%�#鼸{� 聕詤駘1驋I晚!|虉5�-睩�髶^ �(亣�n�'�篁 /h鄖,�桏h�O.{>藣瑥贬陈嬬赌譫翱!惭柗瑞薳/濽�>"齿� <@矻忞�r踇瀕�.諚�;k晩#驛粐,b<囚�獫e�稠W# S{B杧檃㤘5�f乣a駷g5W炸*Rd� 棠� %f鯴聳戞L b^B=I�9P蓥p€ 懔娏o-0g紳!嫓�&堀�=�;kaDm孼H!G��""惈闒旐v� 諀�瘥鶱DN))棽霧蓛恱挻1i鶷#O瞉勷雝*%P廧攓 l)C"厐[Q�6B灉1�'鋋U�碘ü��i℡5孱癄R�瓯撚宯諬3瘵9}憪$C⿶d倻磴�!�;�4捰� 憁�� �%㈢蝙鳵猉拙U!讱_V圡暺茉H�8M)B5j哗5N�4o樮墾�^売9瑗� �€愀X9�窨�帎嵇jqx扴捃~8C诩�*"h弫�悵餈訸R�1侎F�Nc糂W救\�,$M�j﨓v垮褠騝O廲鄗�'�b�%}$r袩 睰薯e嚲IvEGo�AV�5玮Q%Y爯鈄OL�,o摿_�搞{譴^S�/黳鎛B:�i矤B取�F�蛴涍�H�.vq鍏7縃稭B�&s9挽!r蕙1+�皤�"�c 荈m懚]狝Q藃P�鵁鹸G聍6煶M!氜?嘓�"U淺�1<魾妁 爗鈺脍k6叒�L醷HP!DO荹攸�>詹kE�&~喱鎠鈉�>"張帀k哷t� 伷?巚韝�?餩颍y娉���0�(�B詙ku秨嘞栴�贑鼦�4Z 昘'罓轂峧 寥\4"籵姣�4mKMj印 1Kt%貗礅d奰莂掘P娂?蓣茈�M姝料~q€2cF囼R欤喪琟茧喗黴G隧y�5礴w>鲳J �盚啯p潥婜/枛>嘛�趄碍挠�<鼰莓�垣執*腄ゲ约舴狵{赛临\讆亹n�憐�(晦*Q� 2鰮kry鏠慰�*剋i�憱B� 聍褵�7/弹昃g.8P}狍� 鴕*住ㄕCt4 [獢鉶^娹馝U�钚�騔N樔K耱坄秢0R认譢V腼躾黃痽展讠_�Y�襮瞲ˉ惄I咗ベ訇{s璤\鳒鄣蝂螿'�$d4帆怋:�5ポLN�c蚨4u椙o锥漘{孴SD%�8P衷t� Zq缩Wっ皼W{�1驣D鋁�,t泟�9愵�8鶌匴籇埙勩�鼹嶮H曔t�$E診夠d劀u炭濮┚� 躝�?F��$牺�2De�'7荞蘻詶蔝?今帛 b�朢�3d[iC6A'�;�=�/鬙凿G_盖X徙]+]~K�)�"M嗞卪�缶@�鄳� 鐆 贔2 )馕#� y母NMp鰟W>;l$OwA!蹋:aLW�矢�c�:謑;诨C鲩嫋 巀}射騥{}鉕P�.衸阯%+舓)�B|懔_哒�佟鰨�<蘒u譔鍜x‐tDdN垈As鴔災�(澻跞��!$oq劏�?�#�$V�騥'w}2E�0CR呇Ha$O隚t�4甤鹉>_+嚮o竆单>刲$$敥E(您$鷿?w找R牅�Dir墀�邪鸨gv{饢p譯~�"F姼)�芥?b麦囶做燈艦w炣u/Pγ蕡{� 刣濣秆1讫{鳚荃櫔2窐'NER�,]样喂€//�{鴚?茧3閚 R纳Oe櫬<~E�+5f輔=饸7�:続!U櫺�步L煅4仍�0隩o�入�6檞9)R颼ra�!:!㈢� �0孃莆恝q?E�� I/X漭�掝i鵲珶4u陯�.�9揑慜";觞9Bb荆�>|鹫�纪俭⺶鴼o萸o�)#Z疑侲癐"襋M=鎐唼訬?炢箘;6楫6�&盫1Z�(颍遦$� /+6洹�萸邩Ni箞f�#珦F洳崋� 忏�7_匕钔 F舽痤U)耮YQ�*!围菷銥�3湉饓{�]阐�)輛ㄩQ�<尋S0v爝皏蟢_k吆�叻D嬟J�(砹刴>5�e�笰�祛KvOfH �rQ喸ISt8l諝g亏弐矿┏钧� iQ垐諬�(E叶|鐞喎�*鞫滭阆馸)2掄湜l昜F�氋蹋c饱硁v腾児K譴甧髍h亘N�H �}r每滁粸�>�&�唥=�>3EH 0!藧gn;U箈m铢鸰oh�#� !+譐<;痔l㈡�'>羿贰�5�偌颈髿󍽅内产哷芵蝉痴6誵鐔=虫宝闭籉调嚘皑苍拙搁摸0≌<^�1�/添茍�H6镪梑訏t�$N+p�d惹想�(髁趰痋紃蛻H2�-p6磠蠕翄穦麺7漍軗;RG|�""U-p剼裈�;8呷|-y鑶珤退H};浵惱i藞s]s桥 Cc錠�>耹�9稑�+�(<孺m倔︽� 千﨓Rq⒊嶡�-�殭!8F�蓛l捩�7u^4>齾�蘬��沦S垬O�1靍缺朕�6寢/t!8q醙H庬3 F6F�r亵耄捉{曲q鵨曷x T巈� �56n太駘�釾>涗E�谣嬟c�粐H�0~t妧諬鯋5妥卷`齔@o帴�!i輸�"搑{俕G鯦�lxKM騲Q薗)f�迢錞樜]霦$�.�2'坊二跷�!~煻P藧v猓q:C2% q1梔垷�鷿議�|轃kW澱G�憀陠b�.�!涆�=祣\嗞焹]蠍南 偈f{魄6┉i;�-'鬕�铚]p嫋{Cv璒��)圚dsJ肫>n 史辤审4m葶y0{H�9�R竡寁e�2込薳徔_硺"m阽輒萾搽柙y3�2DlL顸会1烛灏tK�(�蔦褻妞A3訇椳�To�0Z�煸妩-z乯R曢妮7&怟� 譚� �&磆Lけ襍鞾睨�%掼y�5蚐歴暇a韂R鸴|e哷$崲�$�"懏飲u姷~冁#吇�.6l跊Ed魌<坒�=�&杴C� b桙聐缦>戂z櫠瞀腛w脍�7h1U佣jb笻+徺暄�-骺A[;�8mB矣�#sq�芫姿鎿à�2�曋腸锕鯱{?� h噷Zb`F筻溕 񅿦瘜?]珆K?}顺5諏焣瞔圻�!睟絮{京6Dt o躱_~蛇�掸靓�#S� 徰*M[乄d 閊�誳麅]菐]y僵S�?W∩NZ鎅烴诜傦h,RC揘嵀殅�穂阕矤蘗`瀊匷Mp6G緉*摯嬉乖�$W緷熜熩 闇j倛鄐渐伳�"呒=V贠玤�琪€煞}^噪4踶� ~(鳴鎒H�8蜮2蚩,|_ /捩�;擄�� j▋H丰飋A>T_�4篚�.冿韯铤?鼕﹀精橵歃�!�-倌�1衮暥~豌剼rd型�晵↖rf娡gH$ �8WB佑aJA颁踙%%eD�0Z疷+V� hi烼佾倈胰�騃祶挡3 r:4忲�&oA焬q0i�;6�8H鋚!|3[銪�<XI曘讙l顔<頊喊{�8i%夾$嵟l� 秲 *郊 υ X�^憺蜙�鎇I�=�栚M瑢Ei�=%�� !U″#罪- 务睲蹲[�嚓O]抖皚n杇墠€捘<羊{嫃骹�.*�?粞?�剀�栞A蛍汤 {媧蒘�€]|瑁�7祡坞�%DZ �O藍� �>齩蹿蚂辺囌踕㎎调蹿珯!惭-跲肠驳翱尿�33触邥(诲褜锄嬄仌!経箩�梷酏嚄飞锄獫髢垼桚齿�)鍷办壮镑聡�+麤3舍础辞(奥袄镑词*别"�.捡愁别模0煎皑腓�晓�!鉌皑?颈搁<搯;包$迭�頯兹)详#瓩H3礥�.佡€�孝˙D[n鈩裟框Jp(奌沌}C綹J�8辎3$yHa� 庍�盙#0?组羔�>2�-SNdc腅窛扇嶜B牋楉x懻�!訣厙[價|爮獭^哱疌4�&苲�靽欁虍z禆�$TGJ肒u?E嵸绹|�-橍�1?坸啅Y`i^_眥(灰餐1#Z轆Xq 懀毅袝稅�ZH/袍襡磿W@叄GN� T栦嶣,睳)鰗J慡$qea啑�#q膃�#!" �$€� ^&W?倫LUIO+瓌l�*肻�<缎�砗�c� �,髒聺箷什釁垆�-#{cT/7灾N熘p`�虙K泭�J�<3潐�!+�0⑺�4V踗8竰p^S涳�Z�申J�'步`鉂УHY[昂薭寵6殟A牡�)�双正珔q蹋.2儧'Q� 吹�=-玡A崠\5JnE樅�掝% 观蚛奋�/e歚ALt{僅KDAw裲�\兀+k}G璐愋饐稕& 發jf阶䓖O韔e瓘I pS}�T2讒J4諟�戶dY\�5▏湣荻�1U讦G閆簈苙^麷酡L�"&i{�3=�鳥D华稡吼OR}bB^N�袡:� B;��4�[fs�3�I�逕<痠S貖z昇K� V踸'SMg9Slax揣i��躇兣�)韾貳圕舟7�!AI毺悯玧��.y<谘�壪]oiT�.i�-P�0���9≯!o8懿噽▉盦v�5袨k镁姴�E贉'竰 焚扗衟滨eL恪�嗋x抂c<~-h5d緉� e桧V⑼關郷巄櫂. #(�0杬l@u!輳b 撾(枡┺A� �彠箮達猈癩x囥燨牟h坛x偣(�2砥M�&酄 B茫 lIK鰪骠�M揘n 琘L蓤澆G�誩�Pq1�:�礄繭 c棔eU﹞+�8pIDAT悊c朷訹i�>eH~z踘纯綞'� {因9 烐晎u鷹C荁�2簖s}$ y�榒^56麍圊j汢X�殹�4宨頲�.燈�贇鞜欒#r毶 240�1B攃H澺jE龘}�L+妯哄eDGd焟4� 北覃 Yb櫉羣懪3U,稴 V!^櫸s�9k }m^淫�!h�髋矊�8潐\犔僀渐峜苺塛��2褺� .� � =�駶�耤鼜盪H�13Qi�6來�{岚iKDZ! �7怫1m蠶24崓鴠朤渁予氧櫩|惐徣 澪DVAlbdX 駊皀犮)硓k5�諓螛� 猤泺攬洭�佮堃泅#�EK苩w�!淎 �`0瑻囡腍賷姥莈�2��3��)€旈桡鴕 q��:)c员*佇├袞O� bZ3Jㄈw胰 2蜙 t鼉噀�05獬ELJ� 壭笯堏檕岲�"蹳�(�*裵�鏏F"枇%V� !*c�( 2陸8�8垹&A尤"m蕫錒 炄@P_a東絹灕噒�)fO硲園A:\9�B�胓T?烷ZRd嵦Gj戛@隅Q﹗腪cz:!� �?鞩醞ā!獲a茰�Z钦�7 -@仍瀕+尾 i腟圄讫珢xc彙j嬷3竣媙€�憀朶梤��,浠P:� n00Hj溡u } 壨X锫稹�!腅賙驵V8�塦謎��9��70Z釽�8溨!1消(垢?蠫�7X�N瀲i:9jF懃镅�`狃a琍�0@�恀鍋鹒� HC9X搤$僋?� 潶�3 !�欮r凓�゛+a塧D2:鶬獸 � 芺�>惫�皑<勯�=�/>饖蠿鯇H晭,芞糯�OV !礼迥枳�媁﨔� 肬炍f縲�C俾 _9:柸嫐�/P P\鮷+_C 鬂"巭=╅M+罛擥跜�&m�/5@>:�燥@开P]*�N^塊f1芀"1$ l�;蔼^�4}玣�4闂2J�X嶘湦N'3 鬹冰 钂}m:/ 懨喱鷟BO′脇坣@杩B)恳�ん /崹\糎3b�(d$"|=脃I�69�W夞�び塏~魢#锸証F~vDu勹2N彍醶�F褩噿凓IEND瓸`��箙�(€��€ # � ����thttp://www.nysedregents.org/testing/socstre/ushgrg.605.pdf�thttp://www.nysedregents.org/testing/socstre/ushgrg.605.pdf���#�4emscreminfo@mail.nysed.gov�Bmailto:emscreminfo@mail.nysed.gov���^�Dwww.p12.nysed.gov/assessment/hsgen�Rhttp://www.p12.nysed.gov/assessment/hsgen���_�Dwww.p12.nysed.gov/assessment/hsgen�Rhttp://www.p12.nysed.gov/assessment/hsgen�l�m��http://www.nysedregents.org/GlobalHistoryGeography/Archive/20090812scoringkeyIII.pdf��http://www.nysedregents.org/GlobalHistoryGeography/Archive/20090812scoringkeyIII.pdf��n�€http://www.nysedregents.org/USHistoryGov/Archive/20100618rg2.pdf�€http://www.nysedregents.org/USHistoryGov/Archive/20100618rg2.pdf�D�o��http://www.nysedregents.org/USHistoryGov/Archive/20090129scoringkeyIII.pdf��http://www.nysedregents.org/USHistoryGov/Archive/20090129scoringkeyIII.pdf�D�p��http://www.nysedregents.org/USHistoryGov/Archive/20090616scoringkeyIII.pdf��http://www.nysedregents.org/USHistoryGov/Archive/20090616scoringkeyIII.pdf����~http://www.p12.nysed.gov/assessment/ss/hs/rubrics/rubrics-e.pdf�~http://www.p12.nysed.gov/assessment/ss/hs/rubrics/rubrics-e.pdf����~http://www.p12.nysed.gov/assessment/ss/hs/rubrics/rubrics-f.pdf�~http://www.p12.nysed.gov/assessment/ss/hs/rubrics/rubrics-f.pdf� ���xhttp://www.forms2.nysed.gov/emsc/osa/exameval/reexameval.cfm�xhttp://www.forms2.nysed.gov/emsc/osa/exameval/reexameval.cfm����vhttp://www.p12.nysed.gov/assessment/sam/secondary/home.html�vhttp://www.p12.nysed.gov/assessment/sam/secondary/home.html�����,dmerlau@mail.nysed.gov�:mailto:dmerlau@mail.nysed.gov�����,gwilsey@mail.nysed.gov�:mailto:gwilsey@mail.nysed.gov�F/� 0��|�DArialgsRomanP�P�8x�貣颋0貣��DVerdanasRomanP�P�8x�貣颋0貣�" �DTimes New RomanP�P�8x�貣颋0貣�0�DWingdingsRomanP�P�8x�貣颋0貣�@�DTahomagsRomanP�P�8x�貣颋0貣�"� €A��� .�  @�n��?" d�d@���������  @@``€€ � 饻 鸶T= 21 ��  () 5  >>    :<�=C ������      tuv|}��������������������������������� �� �� � �� � � ��� �������� ���� � �    ?饎r�$�k懼W7剓詙3錞�i�$�b�$9嘳�+?e~徐.�*)��$i� �0��咥��臕�@���8�gX€�hY€�) 髆S 蕷;↑l8蕷;�g��4PdPdX蠘饢颋08�����p�pp�@ <��4dddd�@0P�x�<��4BdBd�@0P�x�X� <��4!d!d�(A0P����0�___PPT10� ���f�___PPT9�H�@�}��~��u��[������/��0��1����)��m����n��@��K��G��L��H��I��<��=��f��g��8��9��:��;��^��M�� ��*��e�� �T���d����p��q��r����y��z��{��|��c�?� � %�$b���h The New York State Education Department Demystifying the Holistic Scoring Process in Social Studies: �Hi$($;��lRegents Examinations in Global History and Geography and United States History and Government Spring 2013 �"mZl�{t��Holistic Scoring Overview���When scoring holistically Read thoroughly, yet quickly to gain an impression of the entire response Read the entire response before determining a score, and then promptly assign a score �J��" �" ���}���Scores must be determined based on the holistic application of the content-specific rubric provided by 秋葵视频. The anchor and practice papers serve as examples of what a student response at a particular score level should look like. The content-specific rubric is not a checklist. ��" Z��~�� Important points to keep in mind�!!"���The quality of handwriting, the use of cursive or printing, margins, editing marks, cross-outs, and overall neatness are not part of the scoring criteria, unless the response is completely illegible and nothing can be read. ���" ��|u���(It is important for each reader to set aside his/her biases in order to keep the scoring as consistent and as fair to each student as possible. You are scoring a State exam, not grading a classroom assignment, therefore, personal classroom grading practices should be set aside while scoring. �)�" Z)�_[��@The Six Primary Scoring Criteria for the Commencement-Level DBQ�AA��The extent to which students develop the task utilize higher level thinking skills use the information provided in the documents incorporate relevant outside information in the DBQ essay support ideas with facts, examples, and details organize and develop a social studies essay�*�" ��" ���7No one bullet can hold a particular score point hostage�88"��QNumber of Documents Minor Errors Outside Information Copying Document Information�R�" R�DA��Number of Documents����nCan a paper still be given a score of 5 when the student did not use the minimum number of documents required?�oo��oYes, because it is only one of the criteria on which you base a score. If fewer than the minimum number of documents are used and all other criteria of a 5 are met, then you may have a 5 paper. However, when fewer than the minimum number of documents are used, you often have other criteria that are not being met, and thus you usually end up with a 2, 3, or 4 paper.�p�" p�5/��� An example can be found on the August 2009 Global History and Geography DBQ. The Level 5B anchor paper uses 3 documents, instead of the minimum number of 4 documents. This can be found online at: http://www.nysedregents.org/GlobalHistoryGeography/Archive/20090812scoringkeyIII.pdf �P�" �" ��mc0���EC�� Minor Errors �"��60��KCan a paper be given a score of 4 or 5 if it contains a minor error or two?�LL"���If the paper clearly demonstrates that the student understood the task and meets the criteria for a score of 4 or 5 on the test specific rubric, then, the paper can be given that score. A paper does not have to be perfect to reach a score of 5. ���" ��71���<An example can be found in the June 2010 United States History and Government DBQ. In this Level 4A anchor paper, the student states that with the passage of the 18th amendment alcohol consumption was made illegal. This can be found online at: http://www.nysedregents.org/USHistoryGov/Archive/20100618rg2.pdf ��6�" Z�" Z�" Z�" ZZZ� ���nc0��5�FD��Outside Information�����How does  outside information fit into the overall scoring of the essay?�JJ"���The 4th bullet must not be overemphasized in scoring. A response may receive a 3 without outside information. However, a response with outside information is not automatically a 3.�*��" ��-)����The quantity and quality of the outside information, the relevance of the outside information to the topic, and how it has been integrated into the essay should be used when determining the score of a response. �6��" ZZZ��sm����Often outside information can improve the overall essay when it is used to make historical connections and show analytical thinking. �.��" ����"��, All papers need to be evaluated based on the rubric. If the paper demonstrates that the student minimally develops the task, is primarily descriptive with weak or isolated information, has a general plan of organization, and includes outside information, the paper is probably more of a 2 than a 3. �",�" -�tn���An example of a level 3 response that uses no outside information can be found on the June 2009 United States History and Government DBQ, Practice Paper B. This can be found online at: http://www.nysedregents.org/USHistoryGov/Archive/20090616scoringkeyIII.pdf �2�" �" ��pc0���G@���An example of a level 2 response that uses outside information can be found on the January 2009 United States History and Government DBQ, Level 2A paper. This can be found online at: http://www.nysedregents.org/USHistoryGov/Archive/20090129scoringkeyIII.pdf �D��" ZM�" ZZ��oc0���IF��Copying Document Information��� How should you rate a DBQ essay when most of the response is copied directly from the documents and little or no original work is provided? ���" �JK��"�� A distinction needs to be made between paraphrased or copied information that is used to support a specific idea within the essay (an appropriate social studies skill) and the outright copying of information from the documents in an attempted response to the DBQ. �0 �"  �KG����Generally, when most of the information is copied directly from the documents without adding anything, the response will be rated between a 0 and a 2. �0��" � �LL��MThe revised generic rubrics for the Global and USHG exams address this issue �NN�� Score of 2:  or consists primarily of relevant information copied from the documents Score of 1:  or consists primarily of relevant and irrelevant information copied from the documents Score of 0:  includes only entire documents copied from the test booklet �,�" �MH���The actual score will depend on three things: 1) the degree or extent to which the response has been copied, 2) the selection of what specific content the student chose to copy for inclusion, and 3) how the student integrated the copied material into the response. �0�"  �NI��a Can a paper still be given a score of 5 or 4 when some information is copied from the documents?�ba��xAn example of a level 4 response where the student selectively copied information from documents as well as included good historical outside information to interpret the documents can be found on the January 2009 United States History and Government DBQ, Level 4C paper. This can be found online at: http://www.nysedregents.org/USHistoryGov/Archive/20090129scoringkeyIII.pdf �6,�" L�" y�@<��(What criteria helps define a score of 5?�))"��KA 5 paper shows evaluation and/or analysis. It requires substantial outside information that is well integrated into the response. It contains historically accurate information. Document information is used to support the thesis of the response and is interwoven with outside information. It is cohesive and thoroughly developed.�L�" ZL�A=����A 5 is not a 5 just because it is the best response that exists out of all the responses being graded. A well-written response that contains numerous historical inaccuracies or repeats information over and over again is usually not a level 5 paper. The response needs to meet the criteria established by the rubric. On occasion, a particular essay question may have no papers at level 5.���" Z��lf��>What often distinguishes a level 4 paper from a level 3 paper?�??"��cA 4 paper is both analytic and descriptive. It addresses all aspects of the task but may do so unevenly. It requires outside information that is integrated into the response. It contains historically accurate information. Document information is used to support the thesis of the response and is interwoven with outside information. It is well developed. �(c�" ZZd�mg����A 3 paper is more descriptive than analytic. It usually contains some outside information but it may not be well integrated. It contains supporting facts and details, but may also have some minor inaccuracies. �"��" ��<�8��>What often distinguishes a level 3 paper from a level 2 paper?�??"��5A level 3 response contains more explanatory statements and specific details than a level 2 response. In a DBQ, the documents are used to support the thesis of the essay. A level 3 response should include outside information, but it may not. However, most solid level 3 papers do include outside information.�6�" Z6�=9����A level 2 response tends to have broad general statements. Use of supporting information and information from the documents is limited. Note: While a level 2 paper is not required to include outside information, it may contain some.���" ��>:��=What most often distinguishes a 0 paper from a level 1 paper?�>>"���If a response is solely comprised of information copied from the documents and the historical context without any information provided by the student or accurately interpreted by the student, then the response is probably a 0. ���" ��B;���A level 1 paper is NOT a paper in which the student simply  attempted an answer. It must have some appropriate, original information. �*��" r�b^��!Generic Scoring Rubrics by Bullet���Continuity of Score Points See Appendix E for Thematic Essays: http://www.p12.nysed.gov/assessment/ss/hs/rubrics/rubrics-e.pdf See Appendix F for DBQ Essays: http://www.p12.nysed.gov/assessment/ss/hs/rubrics/rubrics-f.pdf �(��" �" ����c0�?~���c0����QM�� Reminder:���The rubrics define a set of scores on a continuum between 0 and 5. A standards-based assessment system measures where the student falls on that continuum. �@��" ��*%��Scoring Related Questions����'Issues Related to Scaffolding Questions�(("��� How should you rate an open-ended question when the question asks for two reasons and the student writes two answers on the first line and a third answer on the second line, but one of the answers on the first line is incorrect? �*�� � ���?The general rule of thumb is that a rater cannot go searching for a correct answer. Disregarding incorrect information to get to a correct answer is not acceptable. The order in which correct and incorrect answers appear on the lines matters. The first two answers should be rated, even if they are on the same line. �&?�" @"�&!��$Issues Related to the DBQ Essay Task�%%"��� How do you rate an essay where the task asks a student to write about two items in the historical context and the response includes discussion of three items? ����.*���_In this situation, only the first two items that appear in the response can be evaluated. A rater cannot search the response to determine which of the three items the student wrote about were strongest. The rater must use the test specific rubric and must focus on information related to the first two items as they appear within the student response.�`�" Z`�ke���However, there may be a situation where a student has appropriately applied information about the third item in a discussion on item one or item two. In this case, if the applied information supports the discussion, it should be considered when rating the overall response. �$�" �+'��Other Related Questions�� ��UWhy do some of the DBQ or Thematic essays use the phrase and/or within the question? �:V9" " "  ��VSED has been using the phrase and/or on social studies essay questions since 1990. The use of and/or benefits students by broadening the scope of acceptable answers and providing a choice of content within the essay. And/or allows the rater to accept the broadest range of student answers as directed by the content-specific scoring rubric. ��W�" Z""." ""t"  {"����� EXAMPLE: Discuss the political, social, and/or economic causes for the Russian Revolution. By wording the question this way, a teacher can accept a response that discusses any combination of causes. If the task said  and, the student would have to discuss one correct cause from each category. If the task said  or, the student would have to focus on one type of cause only and a rater could not give credit for information on a different type of cause. �L�ZZ""�"���yHow do raters know how many examples a student should provide when responding to a particular DBQ or Thematic essay task?�zz��Look for the  S , the plural. This indicates that two or more examples must be provided. However, in the case of a DBQ, a student must also use a minimum number of documents in his/her response and support the essay with as many facts, examples, and details as he/she can. Thus, having more examples usually improves the essay. Collectively, the DBQ documents will always provide multiple examples. �@��" ZZ €�jd���(If only one cause or impact is asked for, it will usually be phrased  a or  one . Example: a cause of& or one cause of& In general, teachers should teach their students to use as many examples as they can. It adds detail to the essay. It helps show the student s knowledge. ���" F ��fb��Other Scoring Notes����` In Global History, can we rate essay responses in which students wrote about the United States?�aa���Many topics in Global and U.S. History are intertwined. (The Cold War, The Middle East, Vietnam War, etc.) Not all essays will automatically exclude the use of information on the U.S. as part of an acceptable answer. An example of this can be found on the January 2011 Global History and Geography thematic essay. This can be found online at: http://www.nysedregents.org/GlobalHistoryGeography/20110128-gh-rg1.pdf �*��" ZZ��wp��Tools required for scoring���Directions for Administering Regents Examinations www.p12.nysed.gov/assessment/hsgen H & G Information Booklet for Scoring Regents Examinations in Global History and Geography and United States History and Government www.p12.nysed.gov/assessment/hsgen School Administrator s Manual, Secondary Level Examinations http://www.p12.nysed.gov/assessment/sam/secondary/home.html �.8�" P>�" Pv��^c0�2T��_c0������c0�9t�xq����Global History and Geography and United States History and Government rating guides for specific test administrations available online �(��" �" ��yr���Test manuals should be reviewed by all administrators, teachers, and staff administering and/or scoring a New York State examination. Anyone who is involved in the scoring of a New York State examination must complete the training as specified in the test manuals and rating guides.��" Z����Reminder��2Teachers are allowed to proctor their own students, unless the district has a different policy. Teachers may not score their own students answer papers.���" ��€y�� Training ��All training should be based on the protocols established by 秋葵视频 as found in the H & G Information Booklet for Scoring Regents Examinations in Global History and Geography and United States History and Government as well as in the test specific rating guides.��" ��z����Scorers are encouraged to ask questions that relate to understanding the scoring guidelines and questionable papers, or scaffolding responses, but philosophical differences, personal preferences and biases must be set aside during the scoring process.���" ���{����The goal of scoring is to be sure the scoring criteria in the rubrics are accurately and consistently applied to each student response being rated across New York State.���" ���|��-Questions about scoring social studies exams�.."���Contact the Associates in Social Studies in the Office of State Assessment For Global History and Geography: Donna Merlau, dmerlau@mail.nysed.gov For United States History and Government: Greg Wilsey, gwilsey@mail.nysed.gov Phone: 518-474-0556 �rn�" '�" *�" %�" �" �" ��bu,���c0�}����c0����ic��Your input is important���Feedback on State examinations is very important to the test development process. This can be done by completing our online Teacher Evaluation Forms at: http://www.forms2.nysed.gov/emsc/osa/exameval/reexameval.cfm �B��" @�" �" �A���c0����� � 0`� €����!������3����虣`� Q.���<����墸�ff�€€ff3`� ���333���3��ff�f�`� 3���K=���虣蘤ff�烫`� 3f���ff���櫶ff������`� ff���3f���f�����3烫`� a湵N墳�����禦>櫶ff�`� 3f���Y����3�3櫶�����`� ���葺�2��3f�3f�>��?" dd@���������&����?oAd(@���������€n<)�o<�6=�nA+7�%�Z', �n��?" d�d@���������   @@``€€P�R   = 7 ,`�(p�>€�> p餳� ��鹁�( � ��痨 �� � �<�€�������� #"� �`���j��� � 餞�� Click to edit Master title style�!� !餚 �� � �0€������� "���Pe��<�$�0� � 馂��RClick to edit Master text styles Second level Third level Fourth level Fifth level�!    � S館B �� # 痧€� �B�C�E�6F�GIIQ�U�*V�W�X�����€€��� @�`€@€$€���€��� G"����€  �0��0餪B ��€ s �*D���g �"���0€0鹑 �� � �0€������� "���^€`��� � 養��*� �鹗 �� � �0€������� "���^�����  � 餌��*� �鹗 �� � �0€������ "���^ ��� � 餌��*� �饖 �� � 餯€��咥嚵"�師��藿h�� ?Light horizontal"��`� ���葺�2��3f�3f� �w �___PPT10�W �.� �"渌+螰曬D耋 '� ,����=� @B� D癞 '� �����=� @B�A�?%�,(� <� +O%�,(� <� +D皴 '� =�%�(�����D駦 '� =�%�(�D裱'� =馎�B��B��B�@B�0B�%�(�)�)�)�)�€?D聒'� =�1駹:�B�visible*駉3�>�+叠�#蝉迟测濒别.惫颈蝉颈产颈濒颈迟测<��*�!%�(�D裱'� =馎�B��B��B�@B�0B�%�(�)�)�)�)�€?D聒'� =�1駹:�B�visible*駉3�>�+叠�#蝉迟测濒别.惫颈蝉颈产颈濒颈迟测<��*�!.%�(�D裱'� =馎�B��B��B�@B�0B�%�(�)�)�)�)�€?D聒'� =�1駹:�B�visible*駉3�>�+叠�#蝉迟测濒别.惫颈蝉颈产颈濒颈迟测<��*�.:%�(�D裱'� =馎�B��B��B�@B�0B�%�(�)�)�)�)�€?D聒'� =�1駹:�B�visible*駉3�>�+叠�#蝉迟测濒别.惫颈蝉颈产颈濒颈迟测<��*�:G%�(�D裱'� =馎�B��B��B�@B�0B�%�(�)�)�)�)�€?D聒'� =�1駹:�B�visible*駉3�>�+叠�#蝉迟测濒别.惫颈蝉颈产颈濒颈迟测<��*�GS%�(�+8+0+�0 + �Profile�4 � X€0 �鸸����( � ��痨 �� � �<�€\�������� #"� �`��p����� � 餞�� Click to edit Master title style�!� !�  �� � �0€�8������ "���p��` �<�$�0� � 餡��#Click to edit Master subtitle style�$� $鹑 �� � �0€p ������ "���`�`€�� � 養��*� �鹗 �� � �0€x呠����� "���`��€��  � 餌��*� �鹗 �� � �0€T壾����� "���` �€�� � 餌��*� �館B �� # 痧€�B�C�E�6F�GjIQ�U�*V�W�X�����€€��� @�`€@€$€���€��� G"������) �0��0饖 �� � 餯€��咥嚵"�師��藿h�� ?Light horizontal"��`� ���葺�2��3f�3f���___PPT10���.� �"渌+臶W_D駨'� ,����=� @B� D馢'� �����=� @B�A�?%�,(� <� +O%�,(� <� +D駚'� =�%�(�����D�)'� =�%�(�D裱'� =馎�B��B��B�@B�0B�%�(�)�)�)�)�€?D聒'� =�1駹:�B�visible*駉3�>�+叠�#蝉迟测濒别.惫颈蝉颈产颈濒颈迟测<��*�$%�(�+8+0+�0 +� �馉€��8�( � �鸲 � � �0€�,����� �P ��  , �>��*� �鸶 � � �0€待 ����� �� � �� , 餈��*� �鸺 � � �6€�,������ �_P��  , �>��*� �鹁 � � �6€�,������ �_� ��� , 餈��*� �餒 � � �0���藿h�師��� ?� ���€€€秽�33�櫃櫶�8�0�___PPT10��.y9�@S�<���Y€0�癗0 �馥�� ��=�( � ��饉 �� s �*€P愜������€���� � � �饉 �� s �*€瑦�������P� �� � � �饒� �� � �0€,捾�������@ € '  �(�� 瘅� � � � �0€<曑�������P �� � 饤��?University of the State of New York State Education Department �<�?  2$餵� � � C �(A��SEDseal3"����€�� P�s餒 �� � �0���師��藿h�� ?� �€€€���f��3���櫶���y�___PPT10�Y+D�='� ,����=� @B� +�}� X€0 �饘��$�( � �餽 � S �€������j���  � � �餽 � S �€������Pe��� � � �餒 � � �0���師��藿h�� ?� ���葺�2��3f�3f�����___PPT10�i�.襑�悡+D�='� ,����=� @B� +�}� X€0 �饘��L�$�( � �L餽 �L S �€0������j���  � � �餽 �L S �€�����Pe��� � � �餒 �L � �0���師��藿h�� ?� ���葺�2��3f�3f�����___PPT10�i�.賓� Y0$+D�='� ,����=� @B� +�}� X€0 �饘�P�$�( � �P餽 �P S �€€'������j���  � � �餽 �P S �€X(�����Pe��� � � �餒 �P � �0���師��藿h�� ?� ���葺�2��3f�3f�����___PPT10�i�.賓�堮l+D�='� ,����=� @B� +�}� X€0 �饘 ��$�( � �餽 � S �€綮������j���  � � �餽 � S �€桤�����Pe��� � � �餒 � � �0���師��藿h�� ?� ���葺�2��3f�3f�����___PPT10�i�.襑�0k铱+D�='� ,����=� @B� +��� X€0 �饦 �P�0�( � �P饃" �P c �$€|/������j���  � � �饃 �P c �$€褙���� e��� � � �餒 �P � �0���師��藿h�� ?� ���3fff�ff3烫櫶�3f虣������___PPT10�i�.��`{S�+D�='� ,����=� @B� +��� X€0 �饦 ��0�( � �饃" � c �$€(|������j���  � � �饃 � c �$€}�����PP��� � � �餒 � � �0���師��藿h�� ?� ���3fff�ff3烫櫶�3f虣������___PPT10�i�.]9�犵B;+D�='� ,����=� @B� +��� X€0 �饦0 ���0�( � ��饃" �� c �$€萵������j���  � � �饃 �� c �$€瑆�����Pe��� � � �餒 �� � �0���師��藿h�� ?� ���3fff�ff3烫櫶�3f虣������___PPT10�i�.9嗲癮�%+D�='� ,����=� @B� +�� X€0�癗0 �鹦���餳�( � ��饉 �� s �*€P嶋�������`���  � � �皙 �� s �*€P庪����� €� �<�$�0� � � �餒 �� � �0���師��藿h�� ?� �€€€���f��3���櫶�����___PPT10���.+臶W_D馩'� ,����=� @B� D� '� �����=� @B�A�?%�,(� <� +O%�,(� <� +D馎'� =�%�(�����D耖'� =�%�(�D駪'� =馎@B��B��B��B�0B�%�(�D聒'� =�1駹:�B�visible*駉3�>�+叠�#蝉迟测濒别.惫颈蝉颈产颈濒颈迟测<��*�p%�(�+8+0+�0 +��� X€0 �饦� ���0�( � ��饃" �� c �$€楇�����j���  � � �饃 �� c �$€鞐�����Pe��� � � �餒 �� � �0���師��藿h�� ?� ���3fff�ff3烫櫶�3f虣������___PPT10�i�.€<�缐撅+D�='� ,����=� @B� +��� X€0 �饦P ���0�( � ��饃" �� c �$€<氹�����j���  � � �饃 �� c �$€盀�����Pe��� � � �餒 �� � �0���師��藿h�� ?� ���3fff�ff3烫櫶�3f虣������___PPT10�i�.9嗲I+D�='� ,����=� @B� +��� X€0 �饦� ���0�( � ��饃" �� c �$€冤������j����  � � �饃 �� c �$€�����Pe��� � � �餒 �� � �0���師��藿h�� ?� ���3fff�ff3烫櫶�3f虣������___PPT10�i�.�<�鹨)+D�='� ,����=� @B� +��� X€0 �饦 ���0�( � ��饃" �� c �$€D搽�����j���  � � �饃 �� c �$€畴���� ����� � � �餒 �� � �0���師��藿h�� ?� ���3fff�ff3烫櫶�3f虣������___PPT10�i�.�<�痨7+D�='� ,����=� @B� +��� X€0 �饦p ���0�( � ��饃" �� c �$€D烹�����j���  � � �饃 �� c �$€齐����Pe��� � � �餒 �� � �0���師��藿h�� ?� ���3fff�ff3烫櫶�3f虣������___PPT10�i�.9嗲@B��+D�='� ,����=� @B� +�� � X€0�癗0 �鹦���餳�( � ��饉 �� s �*€妓������������  � � �皙 �� s �*€继������Pe��<�$�0� � � �餒 �� � �0���師��藿h�� ?� �€€€���f��3���櫶�i�a�___PPT10�A�.+臶W_D襻'� ,����=� @B� D駵'� �����=� @B�A�?%�,(� <� +O%�,(� <� +D馎'� =�%�(�����D耖'� =�%�(�D駪'� =馎@B��B��B��B�0B�%�(�D聒'� =�1駹:�B�visible*駉3�>�+叠�#蝉迟测濒别.惫颈蝉颈产颈濒颈迟测<��*�7%�(�D馎'� =�%�(�����D耖'� =�%�(�D駪'� =馎@B��B��B��B�0B�%�(�D聒'� =�1駹:�B�visible*駉3�>�+叠�#蝉迟测濒别.惫颈蝉颈产颈濒颈迟测<��*�7o%�(�D馎'� =�%�(�����D耖'� =�%�(�D駪'� =馎@B��B��B��B�0B�%�(�D聒'� =�1駹:�B�visible*駉3�>�+叠�#蝉迟测濒别.惫颈蝉颈产颈濒颈迟测<��*�o�%�(�+8+0+�0 +��� X€0 �饦P �T�0�( � �T饃" �T c �$€`蛛�����j���  � � �饃 �T c �$€ 匐����Pe��� � � �餒 �T � �0���師��藿h�� ?� ���3fff�ff3烫櫶�3f虣������___PPT10�i�.�9�� (�+D�='� ,����=� @B� +�}� X€0 �饘 ���$�( � ��餽 �� S �€孺������j���  � � �餽 �� S �€犵�����Pe��� � � �餒 �� � �0���師��藿h�� ?� ���葺�2��3f�3f�����___PPT10�i�.]�`1~�+D�='� ,����=� @B� +��� X€0 �饞��*�( � �餽" � S �€黼������`@��  � � �饃 � c �$€P镫����PP��� � � �餒 � � �0���師��藿h�� ?� ���3fff�ff3烫櫶�3f虣������___PPT10�i�.\9�€?+D�='� ,����=� @B� +�}� X€0 �饘0���$�( � ��餽 �� S �€岠������j���  � � �餽 �� S �€d����Pe��� � � �餒 �� � �0���師��藿h�� ?� ���葺�2��3f�3f�����___PPT10�i�.]�0彳�+D�='� ,����=� @B� +��� X€0 �饦 ���0�( � ��饃" �� c �$€$�����j���   � �饃 �� c �$€������� p��  � �餒 �� � �0���師��藿h�� ?� ���3fff�ff3烫櫶�3f虣������___PPT10�i�.8嗲嗍八+D�='� ,����=� @B� +�K� X€0 �鹉� ��餦�( � ��饃" �� c �$€年������j���  � � �黏 �� c �$€l碡����Pe��<�$�0� � � �餒 �� � �0���師��藿h�� ?� ���3fff�ff3烫櫶�3f虣��'��___PPT10���.�.:嗲€乿+臶W_D駨'� ,����=� @B� D馢'� �����=� @B�A�?%�,(� <� +O%�,(� <� +D駚'� =�%�(�����D�)'� =�%�(�D裱'� =馎�B��B��B�@B�0B�%�(�)�)�)�)�€?D聒'� =�1駹:�B�visible*駉3�>�+叠�#蝉迟测濒别.惫颈蝉颈产颈濒颈迟测<��*��%�(�+8+0+�0 +��� X€0 �饞� ��*�( � �餽" � S �€€�����`p ��   � �饃 � c �$€�����Pe���  � �餒 � � �0���師��藿h�� ?� ���3fff�ff3烫櫶�3f虣������___PPT10�i�.:嗲饍敜+D�='� ,����=� @B� +��� X€0 �饦� ���0�( � ��饃" �� c �$€@ �����j���   � �饃 �� c �$€!����Pe���  � �餒 �� � �0���師��藿h�� ?� ���3fff�ff3烫櫶�3f虣������___PPT10�i�.:嗲€gx+D�='� ,����=� @B� +�}� X€0 �饘� ��$�( � �餽" � S �€�&������`���   � �餽 � S �€l'����P€�`��  � �餒 � � �0���師��藿h�� ?� ���3fff�ff3烫櫶�3f虣������___PPT10�i�.;嗲 � +D�='� ,����=� @B� +��� X€0 �饦� ���0�( � ��饃" �� c �$€�1�����j���   � �饃 �� c �$€�2����Pe���  � �餒 �� � �0���師��藿h�� ?� ���3fff�ff3烫櫶�3f虣������___PPT10�i�.:嗲0u齲+D�='� ,����=� @B� +��� X€0 �饞� ���*�( � ��餽" �� S �€@=������`���   � �饃 �� c �$€P6����Pe���  � �餒 �� � �0���師��藿h�� ?� ���3fff�ff3烫櫶�3f虣������___PPT10�i�.:嗲P拦y+D�='� ,����=� @B� +��� X€0 �饦� ���0�( � ��饃" �� c �$€鬋�����j���   � �饃 �� c �$€H������ �€���  � �餒 �� � �0���師��藿h�� ?� ���3fff�ff3烫櫶�3f虣������___PPT10�i�.+嗲鸶D�+D�='� ,����=� @B� +��� X€0 �饦� ���0�( � ��饃" �� c �$€╚�����j���   � �饃 �� c �$€€_����Pe���  � �餒 �� � �0���師��藿h�� ?� ���3fff�ff3烫櫶�3f虣������___PPT10�i�.,嗲鹛�!+D�='� ,����=� @B� +�}� X€0 �饘p���$�( � ��餽 �� S �€\m�����j���   � �餽 �� S �€4n����Pe���  � �餒 �� � �0���師��藿h�� ?� ���葺�2��3f�3f�����___PPT10�i�.�>�� hx+D�='� ,����=� @B� +�}� X€0 �饘€���$�( � ��餽 �� S �€X{�����j���   � �餽 �� S �€L篡����Pe���  � �餒 �� � �0���師��藿h�� ?� ���葺�2��3f�3f�����___PPT10�i�.�>�pl偢+D�='� ,����=� @B� +��� X€0 �饦€ ���0�( � ��饃" �� c �$€绬�����j���   � �饃 �� c �$€槆����Pe���  � �餒 �� � �0���師��藿h�� ?� ���3fff�ff3烫櫶�3f虣������___PPT10�i�.)嗲p.H�+D�='� ,����=� @B� +��� X€0 �饦� ���0�( � ��饃" �� c �$€D������j���   � �饃 �� c �$€�����Pe���  � �餒 �� � �0���師��藿h�� ?� ���3fff�ff3烫櫶�3f虣������___PPT10�i�.*嗲栏\[+D�='� ,����=� @B� +��� X€0 �饦� ���0�( � ��饃" �� c �$€,������j���   � �饃 �� c �$€�����Pe���  � �餒 �� � �0���師��藿h�� ?� ���3fff�ff3烫櫶�3f虣������___PPT10�i�.*嗲��+D�='� ,����=� @B� +��� X€0 �饦� ���0�( � ��饃" �� c �$€惃�����j���   � �饃 �� c �$€h�����Pe���  � �餒 �� � �0���師��藿h�� ?� ���3fff�ff3烫櫶�3f虣������___PPT10�i�.+嗲ヰ�+D�='� ,����=� @B� +��� X€0 �饦P �`�0�( � �`饃" �` c �$€湹����������   � �饃 �` c �$€t�����Pe���  � �餒 �` � �0���師��藿h�� ?� ���3fff�ff3烫櫶�3f虣������___PPT10�i�.� �镌X+D�='� ,����=� @B� +��� X€0 �饦 ��0�( � �饃" � c �$€鸹�����j���   � �饃 � c �$€燃����Pe���  � �餒 � � �0���師��藿h�� ?� ���3fff�ff3烫櫶�3f虣������___PPT10�i�.崆惻佡+D�='� ,����=� @B� +��� X€0 �饦 �D�0�( � �D饃" �D c �$€心�����j���   � �饃 �D c �$€ㄅ����Pe���  � �餒 �D � �0���師��藿h�� ?� ���3fff�ff3烫櫶�3f虣������___PPT10�i�.�9�瓊�+D�='� ,����=� @B� +��� X€0�癗0 �黏0� �<�( � � 饉 �  s �*€`������0€.��   � �饉 �  s �*€8������Pe���  � �餒 �  � �0���師��藿h�� ?� �€€€���f��3���櫶���y�___PPT10�Y+D�='� ,����=� @B� +��� X€0�癗0 �鹦@��餳�( � ��饉 �� s �*€柙������j���   � �皙 �� s �*€枵�����Pe��<�$� 0�  � �餒 �� � �0���師��藿h�� ?� �€€€���f��3���櫶���y�___PPT10�Y+D�='� ,����=� @B� +��� X€0 �饦��,�0�( � �,饃" �, c �$€X�����0��.��   � �饃 �, c �$€0�����Pe���  � �餒 �, � �0���師��藿h�� ?� ���3fff�ff3烫櫶�3f虣������___PPT10�i�.~9�燤佞+D�='� ,����=� @B� +��� X€0 �饦` �X�0�( � �X饃" �X c �$€<������j���   � �饃 �X c �$€�����Pe���  � �餒 �X � �0���師��藿h�� ?� ���3fff�ff3烫櫶�3f虣������___PPT10�i�.�9� 挩�+D�='� ,����=� @B� +�}� X€0 �饘P���$�( � ��餽 �� S �€剥�����j���   � �餽 �� S �€�����Pe���  � �餒 �� � �0���師��藿h�� ?� ���葺�2��3f�3f�����___PPT10�i�.���/r�+D�='� ,����=� @B� +��� X€0 �饦0 �L�0�( � �L饃" �L c �$€ �����j���   � �饃 �L c �$€� ����Pe���   � �餒 �L � �0���師��藿h�� ?� ���3fff�ff3烫櫶�3f虣������___PPT10�i�.�9�`F �+D�='� ,����=� @B� +�� � X€0�癗0 �鹦P��餳�( � ��饉 �� s �*€� ����������   � �皙 �� s �*€� �����€����<�$�0�   � �餒 �� � �0���師��藿h�� ?� �€€€���f��3���櫶�i�a�___PPT10�A�.+臶W_D襻'� ,����=� @B� D駵'� �����=� @B�A�?%�,(� <� +O%�,(� <� +D馎'� =�%�(�����D耖'� =�%�(�D駪'� =馎@B��B��B��B�0B�%�(�D聒'� =�1駹:�B�visible*駉3�>�+叠�#蝉迟测濒别.惫颈蝉颈产颈濒颈迟测<��*�S%�(�D馎'� =�%�(�����D耖'� =�%�(�D駪'� =馎@B��B��B��B�0B�%�(�D聒'� =�1駹:�B�visible*駉3�>�+叠�#蝉迟测濒别.惫颈蝉颈产颈濒颈迟测<��*�S�%�(�D馎'� =�%�(�����D耖'� =�%�(�D駪'� =馎@B��B��B��B�0B�%�(�D聒'� =�1駹:�B�visible*駉3�>�+叠�#蝉迟测濒别.惫颈蝉颈产颈濒颈迟测<��*��W%�(�+8+0+�0 +��� X€0�癗0 �鹦`��餳�( � ��饉 �� s �*€ ������j���   � �皙 �� s �*€鋃������P€��<�$�0�   � �餒 �� � �0���師��藿h�� ?� �€€€���f��3���櫶���y�___PPT10�Y+D�='� ,����=� @B� +��� X€0�癗0 �鹦���餳�( � ��饉 �� s �*€�. ������`����   � �皙 �� s �*€�/ �����P€��<�$�0�   � �餒 �� � �0���師��藿h�� ?� �€€€���f��3���櫶�����___PPT10�x�.+臶W_D�'� ,����=� @B� D裼'� �����=� @B�A�?%�,(� <� +O%�,(� <� +D駚'� =�%�(�����D�)'� =�%�(�D裱'� =馎@B��B��B��B�0B�%�(�)�)�)�)�€?D聒'� =�1駹:�B�visible*駉3�>�+叠�#蝉迟测濒别.惫颈蝉颈产颈濒颈迟测<��*�H%�(�D駚'� =�%�(�����D�)'� =�%�(�D裱'� =馎@B��B��B��B�0B�%�(�)�)�)�)�€?D聒'� =�1駹:�B�visible*駉3�>�+叠�#蝉迟测濒别.惫颈蝉颈产颈濒颈迟测<��*�H�%�(�+8+0+�0 +�}� X€0 �饘@���$�( � ��餽 �� S �€蠤 �����j���   � �餽 �� S �€ˋ ����Pe���   � �餒 �� � �0���師��藿h�� ?� ���葺�2��3f�3f�����___PPT10�i�.�� �0�+D�='� ,����=� @B� +��� X€0 �饦� �x�0�( � �x饃" �x c �$€窹 �����j���   � �饃 �x c �$€|Q ����Pe���   � �餒 �x � �0���師��藿h�� ?� ���3fff�ff3烫櫶�3f虣������___PPT10�i�.厪�梆方+D�='� ,����=� @B� +��� X€0�癗0 �黏����<�( � ��饉 �� s �*€钃 �������`���   � �饉 �� s �*€◤ �����Pe����   � �餒 �� � �0���師��藿h�� ?� �€€€���f��3���櫶���y�___PPT10�Y+D�='� ,����=� @B� +�}� X€0 �饘����$�( � ��餽 �� S �€� �����j���   � �餽 �� S �€瑙 ����Pe���   � �餒 �� � �0���師��藿h�� ?� ���葺�2��3f�3f�����___PPT10�i�.��&苡+D�='� ,����=� @B� +�$� X€0 �饘����$�( � ��餽 �� S �€卸 �����j���   � �餽 �� S �€x� ����Pe���   � �餒 �� � �0���師��藿h�� ?� ���葺�2��3f�3f�8�0�___PPT10��.��w��$� X€0 �饘����$�( � ��餽 �� S �€<� �����j���   � �餽 �� S �€p� ����Pe���   � �餒 �� � �0���師��藿h�� ?� ���葺�2��3f�3f�8�0�___PPT10��.��形��$� X€0 �饘�T�$�( � �T餽 �T S �€H� �����j���   � �餽 �T S �€ � ����Pe���   � �餒 �T � �0���師��藿h�� ?� ���葺�2��3f�3f�8�0�___PPT10��.趀�P_鞛�$� X€0 �饘��4�$�( � �4餽 �4 S �€� �����j���   � �餽 �4 S �€芤 ����Pe���   � �餒 �4 � �0���師��藿h�� ?� ���葺�2��3f�3f�8�0�___PPT10��.赪�PC/��$� X€0 �饘��8�$�( � �8餽 �8 S �€べ �����j���   � �餽 �8 S �€|� ����Pe���   � �餒 �8 � �0���師��藿h�� ?� ���葺�2��3f�3f�8�0�___PPT10��.轜�`�r�$� X€0 �饘��<�$�( � �<餽 �< S �€� �����j���   � �餽 �< S �€焘 ����Pe���   � �餒 �< � �0���師��藿h�� ?� ���葺�2��3f�3f�8�0�___PPT10��.轜�胁��$� X€0 �饘��H�$�( � �H餽 �H S �€4� �����j���   � �餽 �H S �€茈 ����Pe���   � �餒 �H � �0���師��藿h�� ?� ���葺�2��3f�3f�8�0�___PPT10��.鎃�辣�"�}� X€0 �饘 ���$�( � ��餽 �� S �€� �����€0���   � �餽 �� S �€梵 ����Pe���   � �餒 �� � �0���師��藿h�� ?� ���葺�2��3f�3f�����___PPT10�i�.,惾€卩8+D�='� ,����=� @B� +rT@.�浡椪:0��+�6 r9xGf�y�#�&�!* �W)- P�A$50氯渫u�<�0C � e@0��D@ �S��v�I`�Z�艴v�岧Q_韬b�f€鏒羺覝諿bB�&9�s 徕耒w0J蜰{ 园c�€p&SRU~W猋Y�薜鶳�|# [^��1�瘏�(€��€ �鄥燆鵒h珣+'迟0尛 hp��� �� � � �Scoring ClarificationsdmerlauProfiletnguyen282Microsoft Office PowerPoint@ 忛O�@0糙蚄9�@犠g嗚澄V Gh�����; �  ,V�'&" WMFCg <8What most often distinguishes a 0 paper from a level 1 paper? Slide 34"Generic Scoring Rubrics by Bullet Reminder:Scoring Related Questions(Issues Related to Scaffolding Questions Slide 39%Issues Related to the DBQ Essay Task Slide 41 Slide 42Other Related QuestionsVWhy do some of the DBQ or Thematic essays use the phrase and/or within the question? Slide 45zHow do raters know how many examples a student should provide when responding to a particular DBQ or Thematic essay task? Slide 47Other Scoring Notesa In Global History, can we rate essay responses in which students wrote about the United States?Tools required for scoring Slide 51 Slide 52 Reminder Training Slide 55 Slide 56.Questions about scoring social studies examsYour input is important  Fonts UsedDesign Template Slide Titles:�  8@ _PID_HLINKS�A� `;http://www.nysedregents.org/testing/socstre/ushgrg.605.pdf"mailto:emscreminfo@mail.nysed.gov*http://www.p12.nysed.gov/assessment/hsgen*http://www.p12.nysed.gov/assessment/hsgenUhttp://www.nysedregents.org/GlobalHistoryGeography/Archive/20090812scoringkeyIII.pdfAhttp://www.nysedregents.org/USHistoryGov/Archive/20100618rg2.pdfKhttp://www.nysedregents.org/USHistoryGov/Archive/20090129scoringkeyIII.pdfKhttp://www.nysedregents.org/USHistoryGov/Archive/20090616scoringkeyIII.pdf@http://www.p12.nysed.gov/assessment/ss/hs/rubrics/rubrics-e.pdf@http://www.p12.nysed.gov/assessment/ss/hs/rubrics/rubrics-f.pdf=http://www.forms2.nysed.gov/emsc/osa/exameval/reexameval.cfm<�http://www.p12.nysed.gov/assessment/sam/secondary/home.htmlmailto:dmerlau@mail.nysed.govmailto:gwilsey@mail.nysed.govKhttp://www.nysedregents.org/USHist V ���thttp://www.nysedregents.org/testing/socstre/ushgrg.605.pdf�thttp://www.nysedregents.org/testing/socstre/ushgrg.605.pdf���#�4emscreminfo@mail.nysed.gov�Bmailto:emscreminfo@mail.nysed.gov���^�Dwww.p12.nysed.gov/assessment/hsgen�Rhttp://www.p12.nysed.gov/assessment/hsgen���_�Dwww.p12.nysed.gov/assessment/hsgen�Rhttp://www.p12.nysed.gov/assessment/hsgen�l�m��http://www.nysedregents.org/GlobalHistoryGeography/Archive/20090812scoringkeyIII.pdf��httpRoot Entry��������崄d汷�嗞��)��o嗚澄)@Pictures��������Y%Current User������������5SummaryInformation(�����辑     ��� !"#�%*0���������+.������/t���23456789:;<=>?@ABCDEFGHIJKLMNOPQRSTUVWXYZ[\]^_`abcdefghijklmnopqrs$uvwxyz{|}���€��������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������_缿�6��tnguyentnguyen://www.nysedregents.org/GlobalHistoryGeography/Archive/20090812scoringkeyIII.pdf��n�€http://www.nysedregents.org/USHistoryGov/Archive/20100618rg2.pdf�€http://www.nysedregents.org/USHistoryGov/Archive/20100618rg2.pdf�D�o��http://www.nysedregents.org/USHistoryGov/Archive/20090129scoringkeyIII.pdf��http://www.nysedregents.org/USHistoryGov/Archive/20090129scoringkeyIII.pdf�D�p��http://www.nysedregents.org/USHistoryGov/Archive/20090616scoringkeyIII.pdf��http://www.nysedregents.org/ ��� !"#$%&'()*+,-./0123456789:;<�=>?@ABCDEFGHIJKLMNOPQRSTUVWXYZ[\]^_`abcdefghijklmnopqrstuvwxyz{|}~€������������������������������������������������������������������1������������������������������������������������������������USHistoryGov/Archive/20090616scoringkeyIII.pdf����~http://www.p12.nysed.gov/assessment/ss/hs/rubrics/rubrics-e.pdf�~http://www.p12.nysed.gov/assessment/ss/hs/rubrics/rubrics-e.pdf����~http://www.p12.nysed.gov/assessment/ss/hs/rubrics/rubrics-f.pdf�~http://www.p12.nysed.gov/assessment/ss/hs/rubrics/rubrics-f.pdf� ���xhttp://www.forms2.nysed.gov/emsc/osa/exameval/reexameval.cfm�xhttp://www.forms2.nysed.gov/emsc/osa/exameval/reexameval.cfm����vhttp://www.p12.nysed.gov/aPowerPoint Document(������������Z�DocumentSummaryInformation8��������,������������������������# � ����thttp://www.nysedregents.org/testing/socstre/ushgrg.605.pdf�thttp://www.nysedregents.org/testing/socstre/ushgrg.605.pdf���#�4emscreminfo@mail.nysed.gov�Bmailto:emscreminfo@mail.nysed.gov���^�Dwww.p12.nysed.gov/assessment/hsgen�Rhttp://www.p12.nysed.gov/assessment/hsgen���_�Dwww.p12.nysed.gov/assessment/hsgen�Rhttp://www.p12.nysed.gov/assessment/hsgen�l�m��http://www.nysedregents.org/GlobalHistoryGeography/Archive/20090812scoringkeyIII.pdf��http://www.nysedregents.org/GlobalHistoryGeography/Archive/20090812scoringkeyIII.pdf��n�€http://www.nysedregents.org/USHistoryGov/Archive/20100618rg2.pdf�€http://www.nysedregents.org/USHistoryGov/Archive/20100618rg2.pdf�D�o��http://www.nysedregents.org/USHistoryGov/Archive/20090129scoringkeyIII.pdf��http://www.nysedregents.org/USHistoryGov/Archive/20090129scoringkeyIII.pdf�D�p��http://www.nysedregents.org/USHistoryGov/Archive/20090616scoringkeyIII.pdf��http://www.nysedregents.org/USHistoryGov/Archive/20090616scoringkeyIII.pdf����~http://www.p12.nysed.gov/assessment/ss/hs/rubrics/rubrics-e.pdf�~http://www.p12.nysed.gov/assessment/ss/hs/rubrics/rubrics-e.pdf����~http://www.p12.nysed.gov/assessment/ss/hs/rubrics/rubrics-f.pdf�~http://www.p12.nysed.gov/assessment/ss/hs/rubrics/rubrics-f.pdf� ���xhttp://www.forms2.nysed.gov/emsc/osa/exameval/reexameval.cfm�xhttp://www.forms2.nysed.gov/emsc/osa/exameval/reexameval.cfm����vhttp://www.p12.nysed.gov/assessment/sam/secondary/home.html�vhttp://www.p12.nysed.gov/assessment/sam/secondary/home.html�����,dmerlau@mail.nysed.gov�:mailto:dmerlau@mail.nysed.gov�����,gwilsey@mail.nysed.gov�:mailto:gwilsey@mail.nysed.gov�F/� 0��|�DArialgsRomanP�P�8x�貣颋0貣��DVerdanasRomanP�P�8x�貣颋0貣�" �DTimes New RomanP�P�8x�貣颋0貣�0�DWingdingsRomanP�P�8x�貣颋0貣�@�DTahomagsRomanP�P�8x�貣颋0貣�"� €A��� .�  @�n��?" d�d@���������  @@``€€ � 黏 鹄X> 21 ��  () 5  >>    :<�=C ������      tuv|}��������������������������������� �� �� � �� � � ��� �������� ���� � �    ?饎r�$�k懼W7剓詙3錞�i�$�b�$9嘳�+?e~徐.�*)��$i� �0��咥��臕�@���8�gX€�hY€�) 髆S 蕷;↑l8蕷;�g��4PdPdX蠘饢颋08�����p�pp�@ <��4dddd�@0P�x�<��4BdBd�@0P�x�� <��4!d!d�(A0P����0�___PPT10� ���f�___PPT9�H�@�}��~��u��[������/��0��1����)��m����n��@��K��G��L��H��I��<��=��f��g��8��9��:��;��^��M�� ��*��e�� �T���d����p��q��r����y��z��{��|��c�?� � %�b���h The New York State Education Department Demystifying the Holistic Scoring Process in Social Studies: �Hi$($;��lRegents Examinations in Global History and Geography and United States History and Government Spring 2013 �"mZl�{t��Holistic Scoring Overview���When scoring holistically Read thoroughly, yet quickly to gain an impression of the entire response Read the entire response before determining a score, and then promptly assign a score �J��" �" ���}���Scores must be determined based on the holistic application of the content-specific rubric provided by 秋葵视频. The anchor and practice papers serve as examples of what a student response at a particular score level should look like. The content-specific rubric is not a checklist. ��" Z��~�� Important points to keep in mind�!!"���The quality of handwriting, the use of cursive or printing, margins, editing marks, cross-outs, and overall neatness are not part of the scoring criteria, unless the response is completely illegible and nothing can be read. ���" ��|u���(It is important for each reader to set aside his/her biases in order to keep the scoring as consistent and as fair to each student as possible. You are scoring a State exam, not grading a classroom assignment, therefore, personal classroom grading practices should be set aside while scoring. �)�" Z)�_[��@The Six Primary Scoring Criteria for the Commencement-Level DBQ�AA��The extent to which students develop the task utilize higher level thinking skills use the information provided in the documents incorporate relevant outside information in the DBQ essay support ideas with facts, examples, and details organize and develop a social studies essay�*�" ��" ���7No one bullet can hold a particular score point hostage�88"��QNumber of Documents Minor Errors Outside Information Copying Document Information�R�" R�DA��Number of Documents����nCan a paper still be given a score of 5 when the student did not use the minimum number of documents required?�oo��oYes, because it is only one of the criteria on which you base a score. If fewer than the minimum number of documents are used and all other criteria of a 5 are met, then you may have a 5 paper. However, when fewer than the minimum number of documents are used, you often have other criteria that are not being met, and thus you usually end up with a 2, 3, or 4 paper.�p�" p�5/��� An example can be found on the August 2009 Global History and Geography DBQ. The Level 5B anchor paper uses 3 documents, instead of the minimum number of 4 documents. This can be found online at: http://www.nysedregents.org/GlobalHistoryGeography/Archive/20090812scoringkeyIII.pdf �P�" �" ��mc0���EC�� Minor Errors �"��60��KCan a paper be given a score of 4 or 5 if it contains a minor error or two?�LL"���If the paper clearly demonstrates that the student understood the task and meets the criteria for a score of 4 or 5 on the test specific rubric, then, the paper can be given that score. A paper does not have to be perfect to reach a score of 5. ���" ��71���<An example can be found in the June 2010 United States History and Government DBQ. In this Level 4A anchor paper, the student states that with the passage of the 18th amendment alcohol consumption was made illegal. This can be found online at: http://www.nysedregents.org/USHistoryGov/Archive/20100618rg2.pdf ��6�" Z�" Z�" Z�" ZZZ� ���nc0��5�FD��Outside Information�����How does  outside information fit into the overall scoring of the essay?�JJ"���The 4th bullet must not be overemphasized in scoring. A response may receive a 3 without outside information. However, a response with outside information is not automatically a 3.�*��" ��-)����The quantity and quality of the outside information, the relevance of the outside information to the topic, and how it has been integrated into the essay should be used when determining the score of a response. �6��" ZZZ��sm����Often outside information can improve the overall essay when it is used to make historical connections and show analytical thinking. �.��" ����"��, All papers need to be evaluated based on the rubric. If the paper demonstrates that the student minimally develops the task, is primarily descriptive with weak or isolated information, has a general plan of organization, and includes outside information, the paper is probably more of a 2 than a 3. �",�" -�tn���An example of a level 3 response that uses no outside information can be found on the June 2009 United States History and Government DBQ, Practice Paper B. This can be found online at: http://www.nysedregents.org/USHistoryGov/Archive/20090616scoringkeyIII.pdf �2�" �" ��pc0���G@���An example of a level 2 response that uses outside information can be found on the January 2009 United States History and Government DBQ, Level 2A paper. This can be found online at: http://www.nysedregents.org/USHistoryGov/Archive/20090129scoringkeyIII.pdf �D��" ZM�" ZZ��oc0���IF��Copying Document Information��� How should you rate a DBQ essay when most of the response is copied directly from the documents and little or no original work is provided? ���" �JK��"�� A distinction needs to be made between paraphrased or copied information that is used to support a specific idea within the essay (an appropriate social studies skill) and the outright copying of information from the documents in an attempted response to the DBQ. �0 �"  �KG����Generally, when most of the information is copied directly from the documents without adding anything, the response will be rated between a 0 and a 2. �0��" � �LL��MThe revised generic rubrics for the Global and USHG exams address this issue �NN�� Score of 2:  or consists primarily of relevant information copied from the documents Score of 1:  or consists primarily of relevant and irrelevant information copied from the documents Score of 0:  includes only entire documents copied from the test booklet �,�" �MH���The actual score will depend on three things: 1) the degree or extent to which the response has been copied, 2) the selection of what specific content the student chose to copy for inclusion, and 3) how the student integrated the copied material into the response. �0�"  �NI��a Can a paper still be given a score of 5 or 4 when some information is copied from the documents?�ba��xAn example of a level 4 response where the student selectively copied information from documents as well as included good historical outside information to interpret the documents can be found on the January 2009 United States History and Government DBQ, Level 4C paper. This can be found online at: http://www.nysedregents.org/USHistoryGov/Archive/20090129scoringkeyIII.pdf �6,�" L�" y�@<��(What criteria helps define a score of 5?�))"��KA 5 paper shows evaluation and/or analysis. It requires substantial outside information that is well integrated into the response. It contains historically accurate information. Document information is used to support the thesis of the response and is interwoven with outside information. It is cohesive and thoroughly developed.�L�" ZL�A=����A 5 is not a 5 just because it is the best response that exists out of all the responses being graded. A well-written response that contains numerous historical inaccuracies or repeats information over and over again is usually not a level 5 paper. The response needs to meet the criteria established by the rubric. On occasion, a particular essay question may have no papers at level 5.���" Z��lf��>What often distinguishes a level 4 paper from a level 3 paper?�??"��cA 4 paper is both analytic and descriptive. It addresses all aspects of the task but may do so unevenly. It requires outside information that is integrated into the response. It contains historically accurate information. Document information is used to support the thesis of the response and is interwoven with outside information. It is well developed. �(c�" ZZd�mg����A 3 paper is more descriptive than analytic. It usually contains some outside information but it may not be well integrated. It contains supporting facts and details, but may also have some minor inaccuracies. �"��" ��<�8��>What often distinguishes a level 3 paper from a level 2 paper?�??"��5A level 3 response contains more explanatory statements and specific details than a level 2 response. In a DBQ, the documents are used to support the thesis of the essay. A level 3 response should include outside information, but it may not. However, most solid level 3 papers do include outside information.�6�" Z6�=9����A level 2 response tends to have broad general statements. Use of supporting information and information from the documents is limited. Note: While a level 2 paper is not required to include outside information, it may contain some.���" ��>:��=What most often distinguishes a 0 paper from a level 1 paper?�>>"���If a response is solely comprised of information copied from the documents and the historical context without any information provided by the student or accurately interpreted by the student, then the response is probably a 0. ���" ��B;���A level 1 paper is NOT a paper in which the student simply  attempted an answer. It must have some appropriate, original information. �*��" r�b^��!Generic Scoring Rubrics by Bullet���Continuity of Score Points See Appendix E for Thematic Essays: http://www.p12.nysed.gov/assessment/ss/hs/rubrics/rubrics-e.pdf See Appendix F for DBQ Essays: http://www.p12.nysed.gov/assessment/ss/hs/rubrics/rubrics-f.pdf �(��" �" ����c0�?~���c0����QM�� Reminder:���The rubrics define a set of scores on a continuum between 0 and 5. A standards-based assessment system measures where the student falls on that continuum. �@��" ��*%��Scoring Related Questions����'Issues Related to Scaffolding Questions�(("��� How should you rate an open-ended question when the question asks for two reasons and the student writes two answers on the first line and a third answer on the second line, but one of the answers on the first line is incorrect? �*�� � ���?The general rule of thumb is that a rater cannot go searching for a correct answer. Disregarding incorrect information to get to a correct answer is not acceptable. The order in which correct and incorrect answers appear on the lines matters. The first two answers should be rated, even if they are on the same line. �&?�" @"�&!��$Issues Related to the DBQ Essay Task�%%"��� How do you rate an essay where the task asks a student to write about two items in the historical context and the response includes discussion of three items? ����.*���_In this situation, only the first two items that appear in the response can be evaluated. A rater cannot search the response to determine which of the three items the student wrote about were strongest. The rater must use the test specific rubric and must focus on information related to the first two items as they appear within the student response.�`�" Z`�ke���However, there may be a situation where a student has appropriately applied information about the third item in a discussion on item one or item two. In this case, if the applied information supports the discussion, it should be considered when rating the overall response. �$�" �+'��Other Related Questions�� ��UWhy do some of the DBQ or Thematic essays use the phrase and/or within the question? �:V9" " "  ��VSED has been using the phrase and/or on social studies essay questions since 1990. The use of and/or benefits students by broadening the scope of acceptable answers and providing a choice of content within the essay. And/or allows the rater to accept the broadest range of student answers as directed by the content-specific scoring rubric. ��W�" Z""." ""t"  {"����� EXAMPLE: Discuss the political, social, and/or economic causes for the Russian Revolution. By wording the question this way, a teacher can accept a response that discusses any combination of causes. If the task said  and, the student would have to discuss one correct cause from each category. If the task said  or, the student would have to focus on one type of cause only and a rater could not give credit for information on a different type of cause. �L�ZZ""�"���yHow do raters know how many examples a student should provide when responding to a particular DBQ or Thematic essay task?�zz��Look for the  S , the plural. This indicates that two or more examples must be provided. However, in the case of a DBQ, a student must also use a minimum number of documents in his/her response and support the essay with as many facts, examples, and details as he/she can. Thus, having more examples usually improves the essay. Collectively, the DBQ documents will always provide multiple examples. �@��" ZZ €�jd���(If only one cause or impact is asked for, it will usually be phrased  a or  one . Example: a cause of& or one cause of& In general, teachers should teach their students to use as many examples as they can. It adds detail to the essay. It helps show the student s knowledge. ���" F ��fb��Other Scoring Notes����` In Global History, can we rate essay responses in which students wrote about the United States?�aa���Many topics in Global and U.S. History are intertwined. (The Cold War, The Middle East, Vietnam War, etc.) Not all essays will automatically exclude the use of information on the U.S. as part of an acceptable answer. An example of this can be found on the January 2011 Global History and Geography thematic essay. This can be found online at: http://www.nysedregents.org/GlobalHistoryGeography/20110128-gh-rg1.pdf �*��" ZZ��wp��Tools required for scoring���Directions for Administering Regents Examinations www.p12.nysed.gov/assessment/hsgen H & G Information Booklet for Scoring Regents Examinations in Global History and Geography and United States History and Government www.p12.nysed.gov/assessment/hsgen School Administrator s Manual, Secondary Level Examinations http://www.p12.nysed.gov/assessment/sam/secondary/home.html �.8�" P>�" Pv��^c0�2T��_c0������c0�9t�xq����Global History and Geography and United States History and Government rating guides for specific test administrations available online �(��" �" ��yr���Test manuals should be reviewed by all administrators, teachers, and staff administering and/or scoring a New York State examination. Anyone who is involved in the scoring of a New York State examination must complete the training as specified in the test manuals and rating guides.��" Z����Reminder��2Teachers are allowed to proctor their own students, unless the district has a different policy. Teachers may not score their own students answer papers.���" ��€y�� Training ��All training should be based on the protocols established by 秋葵视频 as found in the H & G Information Booklet for Scoring Regents Examinations in Global History and Geography and United States History and Government as well as in the test specific rating guides.��" ��z����Scorers are encouraged to ask questions that relate to understanding the scoring guidelines and questionable papers, or scaffolding responses, but philosophical differences, personal preferences and biases must be set aside during the scoring process.���" ���{����The goal of scoring is to be sure the scoring criteria in the rubrics are accurately and consistently applied to each student response being rated across New York State.���" ���|��-Questions about scoring social studies exams�.."���Contact the Associates in Social Studies in the Office of State Assessment For Global History and Geography: Donna Merlau, dmerlau@mail.nysed.gov For United States History and Government: Greg Wilsey, gwilsey@mail.nysed.gov Phone: 518-474-0556 �rn�" '�" *�" %�" �" �" ��Pu2���c0�}����c0����ic��Your input is important���Feedback on State examinations is very important to the test development process. This can be done by completing our online Teacher Evaluation Forms at: http://www.forms2.nysed.gov/emsc/osa/exameval/reexameval.cfm �B��" @�" �" �A���c0����r踎�A# 穇掑��1�鶊�(€��€ #ssessment/sam/secondary/home.html�vhttp://www.p12.nysed.gov/assessment/sam/secondary/home.html�����,dmerlau@mail.nysed.gov�:mailto:dmerlau@mail.nysed.gov�����,gwilsey@mail.nysed.gov�:mailto:gwilsey@mail.nysed.gov�4���http://www.nysedregents.org/GlobalHistoryGeography/20110128-gh-rg1.pdf��http://www.nysedregents.org/GlobalHistoryGeography/20110128-gh-rg1.pdf�D���http://www.nysedregents.org/USHistoryGov/Archive/20090129scoringkeyIII.pdf��http://www.nysedregents.org/USHistoryGov/Archive/20090129scoringkeyIII.pdf�F/� 0��|�DArialgsRomanP�P�`:�貣颋0貣��DVerdanasRomanP�P�`:�貣颋0貣�" �DTimes New RomanP�P�`:�貣颋0貣�0�DWingdingsRomanP�P�`:�貣颋0貣�@�DTahomagsRomanP�P�`:�貣颋0貣�"� €A��� .�  @�n��?" d�d@���������  @@``€€ � 黏 鹄X= 21 ��  () 5  >>    :<�=C ������      tuv|}��������������������������������� �� �� � �� � � ��� �������� ���� � �    ?饎r�$�k懼W7剓詙3錞�i�$�b�$9嘳�+?e~徐.�*)��$i� �0��咥��臕�@���8�gX€�hY€�i 髆S 蕷;↑l8蕷;�g��4<�d<�dP埰饢颋0恺�����p�pp�@ <��4dddd�@0P�<:�<��4BdBd�@0P�<:�� <��4!d!d�(A0P����0�___PPT10� �����___PPT9�������@�}��~��u��[������/��0�������������������������������������������������������������������������������������������������������������������������������������1����)��m����n��@��K��G��L��H��I��<��=��f��g��8��9��:��;��^��M�� ��*��e�� �T���d����p��q��r����y��z��{��|��c�?� � %�攂���h The New York State Education Department Demystifying the Holistic Scoring Process in Social Studies: �Hi$($;��lRegents Examinations in Global History and Geography and United States History and Government Spring 2013 �"mZl�{t��Holistic Scoring Overview���When scoring holistically Read thoroughly, yet quickly to gain an impression of the entire response Read the entire response before determining a score, and then promptly assign a score �J��" �" ���}���Scores must be determined based on the holistic application of the content-specific rubric provided by 秋葵视频. The anchor and practice papers serve as examples of what a student response at a particular score level should look like. The content-specific rubric is not a checklist. ��" Z��~�� Important points to keep in mind�!!"���The quality of handwriting, the use of cursive or printing, margins, editing marks, cross-outs, and overall neatness are not part of the scoring criteria, unless the response is completely illegible and nothing can be read. ���" ��|u���(It is important for each reader to set aside his/her biases in order to keep the scoring as consistent and as fair to each student as possible. You are scoring a State exam, not grading a classroom assignment, therefore, personal classroom grading practices should be set aside while scoring. �)�" Z)�_[��@The Six Primary Scoring Criteria for the Commencement-Level DBQ�AA��The extent to which students develop the task utilize higher level thinking skills use the information provided in the documents incorporate relevant outside information in the DBQ essay support ideas with facts, examples, and details organize and develop a social studies essay�*�" ��" ���7No one bullet can hold a particular score point hostage�88"��QNumber of Documents Minor Errors Outside Information Copying Document Information�R�" R�DA��Number of Documents����nCan a paper still be given a score of 5 when the student did not use the minimum number of documents required?�oo��oYes, because it is only one of the criteria on which you base a score. If fewer than the minimum number of documents are used and all other criteria of a 5 are met, then you may have a 5 paper. However, when fewer than the minimum number of documents are used, you often have other criteria that are not being met, and thus you usually end up with a 2, 3, or 4 paper.�p�" p�5/��� An example can be found on the August 2009 Global History and Geography DBQ. The Level 5B anchor paper uses 3 documents, instead of the minimum number of 4 documents. This can be found online at: http://www.nysedregents.org/GlobalHistoryGeography/Archive/20090812scoringkeyIII.pdf �P�" �" ��mc0���EC�� Minor Errors �"��60��KCan a paper be given a score of 4 or 5 if it contains a minor error or two?�LL"���If the paper clearly demonstrates that the student understood the task and meets the criteria for a score of 4 or 5 on the test specific rubric, then, the paper can be given that score. A paper does not have to be perfect to reach a score of 5. ���" ��71���<An example can be found in the June 2010 United States History and Government DBQ. In this Level 4A anchor paper, the student states that with the passage of the 18th amendment alcohol consumption was made illegal. This can be found online at: http://www.nysedregents.org/USHistoryGov/Archive/20100618rg2.pdf ��6�" Z�" Z�" Z�" ZZZ� ���nc0��5�FD��Outside Information�����How does  outside information fit into the overall scoring of the essay?�JJ"���The 4th bullet must not be overemphasized in scoring. A response may receive a 3 without outside information. However, a response with outside information is not automatically a 3.�*��" ��-)����The quantity and quality of the outside information, the relevance of the outside information to the topic, and how it has been integrated into the essay should be used when determining the score of a response. �6��" ZZZ��sm����Often outside information can improve the overall essay when it is used to make historical connections and show analytical thinking. �.��" ����"��, All papers need to be evaluated based on the rubric. If the paper demonstrates that the student minimally develops the task, is primarily descriptive with weak or isolated information, has a general plan of organization, and includes outside information, the paper is probably more of a 2 than a 3. �",�" -�tn���An example of a level 3 response that uses no outside information can be found on the June 2009 United States History and Government DBQ, Practice Paper B. This can be found online at: http://www.nysedregents.org/USHistoryGov/Archive/20090616scoringkeyIII.pdf �2�" �" ��pc0���G@���An example of a level 2 response that uses outside information can be found on the January 2009 United States History and Government DBQ, Level 2A paper. This can be found online at: http://www.nysedregents.org/USHistoryGov/Archive/20090129scoringkeyIII.pdf �D��" ZM�" ZZ��oc0���IF��Copying Document Information��� How should you rate a DBQ essay when most of the response is copied directly from the documents and little or no original work is provided? ���" �JK��"�� A distinction needs to be made between paraphrased or copied information that is used to support a specific idea within the essay (an appropriate social studies skill) and the outright copying of information from the documents in an attempted response to the DBQ. �0 �"  �KG����Generally, when most of the information is copied directly from the documents without adding anything, the response will be rated between a 0 and a 2. �0��" � �LL��MThe revised generic rubrics for the Global and USHG exams address this issue �NN�� Score of 2:  or consists primarily of relevant information copied from the documents Score of 1:  or consists primarily of relevant and irrelevant information copied from the documents Score of 0:  includes only entire documents copied from the test booklet �,�" �MH���The actual score will depend on three things: 1) the degree or extent to which the response has been copied, 2) the selection of what specific content the student chose to copy for inclusion, and 3) how the student integrated the copied material into the response. �0�"  �NI��a Can a paper still be given a score of 5 or 4 when some information is copied from the documents?�ba��xAn example of a level 4 response where the student selectively copied information from documents as well as included good historical outside information to interpret the documents can be found on the January 2009 United States History and Government DBQ, Level 4C paper. This can be found online at: http://www.nysedregents.org/USHistoryGov/Archive/20090129scoringkeyIII.pdf �6,�" L�" y�-J��c0�-w�@<��(What criteria helps define a score of 5?�))"��KA 5 paper shows evaluation and/or analysis. It requires substantial outside information that is well integrated into the response. It contains historically accurate information. Document information is used to support the thesis of the response and is interwoven with outside information. It is cohesive and thoroughly developed.�L�" ZL�A=����A 5 is not a 5 just because it is the best response that exists out of all the responses being graded. A well-written response that contains numerous historical inaccuracies or repeats information over and over again is usually not a level 5 paper. The response needs to meet the criteria established by the rubric. On occasion, a particular essay question may have no papers at level 5.���" Z��lf��>What often distinguishes a level 4 paper from a level 3 paper?�??"��cA 4 paper is both analytic and descriptive. It addresses all aspects of the task but may do so unevenly. It requires outside information that is integrated into the response. It contains historically accurate information. Document information is used to support the thesis of the response and is interwoven with outside information. It is well developed. �(c�" ZZd�mg����A 3 paper is more descriptive than analytic. It usually contains some outside information but it may not be well integrated. It contains supporting facts and details, but may also have some minor inaccuracies. �"��" ��<�8��>What often distinguishes a level 3 paper from a level 2 paper?�??"��5A level 3 response contains more explanatory statements and specific details than a level 2 response. In a DBQ, the documents are used to support the thesis of the essay. A level 3 response should include outside information, but it may not. However, most solid level 3 papers do include outside information.�6�" Z6�=9����A level 2 response tends to have broad general statements. Use of supporting information and information from the documents is limited. Note: While a level 2 paper is not required to include outside information, it may contain some.���" ��>:��=What most often distinguishes a 0 paper from a level 1 paper?�>>"���If a response is solely comprised of information copied from the documents and the historical context without any information provided by the student or accurately interpreted by the student, then the response is probably a 0. ���" ��B;���A level 1 paper is NOT a paper in which the student simply  attempted an answer. It must have some appropriate, original information. �*��" r�b^��!Generic Scoring Rubrics by Bullet���Continuity of Score Points See Appendix E for Thematic Essays: http://www.p12.nysed.gov/assessment/ss/hs/rubrics/rubrics-e.pdf See Appendix F for DBQ Essays: http://www.p12.nysed.gov/assessment/ss/hs/rubrics/rubrics-f.pdf �(��" �" ����c0�?~���c0����QM�� Reminder:���The rubrics define a set of scores on a continuum between 0 and 5. A standards-based assessment system measures where the student falls on that continuum. �@��" ��*%��Scoring Related Questions����'Issues Related to Scaffolding Questions�(("��� How should you rate an open-ended question when the question asks for two reasons and the student writes two answers on the first line and a third answer on the second line, but one of the answers on the first line is incorrect? �*�� � ���?The general rule of thumb is that a rater cannot go searching for a correct answer. Disregarding incorrect information to get to a correct answer is not acceptable. The order in which correct and incorrect answers appear on the lines matters. The first two answers should be rated, even if they are on the same line. �&?�" @"�&!��$Issues Related to the DBQ Essay Task�%%"��� How do you rate an essay where the task asks a student to write about two items in the historical context and the response includes discussion of three items? ����.*���_In this situation, only the first two items that appear in the response can be evaluated. A rater cannot search the response to determine which of the three items the student wrote about were strongest. The rater must use the test specific rubric and must focus on information related to the first two items as they appear within the student response.�`�" Z`�ke���However, there may be a situation where a student has appropriately applied information about the third item in a discussion on item one or item two. In this case, if the applied information supports the discussion, it should be considered when rating the overall response. �$�" �+'��Other Related Questions�� ��UWhy do some of the DBQ or Thematic essays use the phrase and/or within the question? �:V9" " "  ��VSED has been using the phrase and/or on social studies essay questions since 1990. The use of and/or benefits students by broadening the scope of acceptable answers and providing a choice of content within the essay. And/or allows the rater to accept the broadest range of student answers as directed by the content-specific scoring rubric. ��W�" Z""." ""t"  {"����� EXAMPLE: Discuss the political, social, and/or economic causes for the Russian Revolution. By wording the question this way, a teacher can accept a response that discusses any combination of causes. If the task said  and, the student would have to discuss one correct cause from each category. If the task said  or, the student would have to focus on one type of cause only and a rater could not give credit for information on a different type of cause. �L�ZZ""�"���yHow do raters know how many examples a student should provide when responding to a particular DBQ or Thematic essay task?�zz��Look for the  S , the plural. This indicates that two or more examples must be provided. However, in the case of a DBQ, a student must also use a minimum number of documents in his/her response and support the essay with as many facts, examples, and details as he/she can. Thus, having more examples usually improves the essay. Collectively, the DBQ documents will always provide multiple examples. �@��" ZZ €�jd���(If only one cause or impact is asked for, it will usually be phrased  a or  one . Example: a cause of& or one cause of& In general, teachers should teach their students to use as many examples as they can. It adds detail to the essay. It helps show the student s knowledge. ���" F ��fb��Other Scoring Notes����` In Global History, can we rate essay responses in which students wrote about the United States?�aa���Many topics in Global and U.S. History are intertwined. (The Cold War, The Middle East, Vietnam War, etc.) Not all essays will automatically exclude the use of information on the U.S. as part of an acceptable answer. An example of this can be found on the January 2011 Global History and Geography thematic essay. This can be found online at: http://www.nysedregents.org/GlobalHistoryGeography/20110128-gh-rg1.pdf �*��" ZZ���c0�W��wp��Tools required for scoring���Directions for Administering Regents Examinations www.p12.nysed.gov/assessment/hsgen H & G Information Booklet for Scoring Regents Examinations in Global History and Geography and United States History and Government www.p12.nysed.gov/assessment/hsgen School Administrator s Manual, Secondary Level Examinations http://www.p12.nysed.gov/assessment/sam/secondary/home.html �.8�" P>�" Pv��^c0�2T��_c0������c0�9t�xq����Global History and Geography and United States History and Government rating guides for specific test administrations available online �(��" �" ��yr���Test manuals should be reviewed by all administrators, teachers, and staff administering and/or scoring a New York State examination. Anyone who is involved in the scoring of a New York State examination must complete the training as specified in the test manuals and rating guides.��" Z����Reminder��2Teachers are allowed to proctor their own students, unless the district has a different policy. Teachers may not score their own students answer papers.���" ��€y�� Training ��All training should be based on the protocols established by 秋葵视频 as found in the H & G Information Booklet for Scoring Regents Examinations in Global History and Geography and United States History and Government as well as in the test specific rating guides.��" ��z����Scorers are encouraged to ask questions that relate to understanding the scoring guidelines and questionable papers, or scaffolding responses, but philosophical differences, personal preferences and biases must be set aside during the scoring process.���" ���{����The goal of scoring is to be sure the scoring criteria in the rubrics are accurately and consistently applied to each student response being rated across New York State.���" ���|��-Questions about scoring social studies exams�.."���Contact the Associates in Social Studies in the Office of State Assessment For Global History and Geography: Donna Merlau, dmerlau@mail.nysed.gov For United States History and Government: Greg Wilsey, gwilsey@mail.nysed.gov Phone: 518-474-0556 �rn�" '�" *�" %�" �" �" ��Pu2���c0�}����c0����ic��Your input is important���Feedback on State examinations is very important to the test development process. This can be done by completing our online Teacher Evaluation Forms at: http://www.forms2.nysed.gov/emsc/osa/exameval/reexameval.cfm �B��" @�" �" �A���c0������� X€0 �饞� ���*�( � ��餽" �� S �€d,�������`���  � � �饃 �� c �$€Tつ����Pe��� � � �餒 �� � �0���師��藿h�� ?� ���3fff�ff3烫櫶�3f虣������___PPT10�i�.:嗲P拦y+D�='� 7����=� @B� +��� X€0�癗0 �黏����<�( � ��饉 �� s �*€��������`���  � � �饉 �� s �*€监������Pe���� � � �餒 �� � �0���師��藿h�� ?� �€€€���f��3���櫶���y�___PPT10�Y+D�='� 7����=� @B� +r棋RqN莕�I# ㈠鱯��1���(€��€ # f ���thttp://www.nysedregents.org/testing/socstre/ushgrg.605.pdf�thttp://www.nysedregents.org/testing/socstre/ushgrg.605.pdf���#�4emscreminfo@mail.nysed.gov�Bmailto:emscoryGov/Archive/20090129scoringkeyIII.pdfKhttp://www.nysedregents.org/GlobalHistoryGeography/611/20110615-gh-rg1.pdfreminfo@mail.nysed.gov���^�Dwww.p12.nysed.gov/assessment/hsgen�Rhttp://www.p12.nysed.gov/assessment/hsgen���_�Dwww.p12.nysed.gov/assessment/hsgen�Rhttp://www.p12.nysed.gov/assessment/hsgen�l�m��http://www.nysedregents.org/GlobalHistoryGeography/Archive/20090812scoringkeyIII.pdf��http://www.nysedregents.org/GlobalHistoryGeography/Archive/20090812scoringkeyIII.pdf��n�€http://www.nysedregents.org/USHistoryGov/Archive/20100618rg2.pdf�€http://www.nysedregents.org/USHistoryGov/Archive/20100618rg2.pdf�D�o��http://www.nysedregents.org/USHistoryGov/Archive/20090129scoringkeyIII.pdf��http://www.nysedregents.org/USHistoryGov/Archive/20090129scoringkeyIII.pdf�D�p��http://www.nysedregents.org/USHistoryGov/Archive/20090616scoringkeyIII.pdf��http://www.nysedregents.org/USHistoryGov/Archive/20090616scoringkeyIII.pdf����~http://www.p12.nysed.gov/assessment/ss/hs/rubrics/rubrics-e.pdf�~http://www.p12.nysed.gov/assessment/ss/hs/rubrics/rubrics-e.pdf����~http://www.p12.nysed.gov/assessment/ss/hs/rubrics/rubrics-f.pdf�~http://www.p12.nysed.gov/assessment/ss/hs/rubrics/rubrics-f.pdf� ���xhttp://www.forms2.nysed.gov/emsc/osa/exameval/reexameval.cfm�xhttp://www.forms2.nysed.gov/emsc/osa/exameval/reexameval.cfm����vhttp://www.p12.nysed.gov/assessment/sam/secondary/home.html�vhttp://www.p12.nysed.gov/assessment/sam/secondary/home.html�����,dmerlau@mail.nysed.gov�:mailto:dmerlau@mail.nysed.gov�����,gwilsey@mail.nysed.gov�:mailto:gwilsey@mail.nysed.gov�D���http://www.nysedregents.org/USHistoryGov/Archive/20090129scoringkeyIII.pdf��http://www.nysedregents.org/USHistoryGov/Archive/20090129scoringkeyIII.pdf�D���http://www.nysedregents.org/GlobalHistoryGeography/611/20110615-gh-rg1.pdf��http://www.nysedregents.org/GlobalHistoryGeography/611/20110615-gh-rg1.pdf�F/� 0��|�DArialgsRomanP�P�hu�貣颋0貣�"�DVerdanasRomanP�P�hu�貣颋0貣�" �DTimes New RomanP�P�hu�貣颋0貣�0�DWingdingsRomanP�P�hu�貣颋0貣�@�DTahomagsRomanP�P�hu�貣颋0貣�"� €A��� .�  @�n��?" d�d@���������  @@``€€ � 黏 鹄X= 21 ��  () 5  >>    :<�=C ������      tuv|}��������������������������������� �� �� � �� � � ��� �������� ���� � �    ?饎r�$�k懼W7剓詙3錞�i�$�b�$9嘳�+?e~徐.�*)��$i� �0��咥��臕�@���8�gX€�hY€�K 髆S 蕷;↑l8蕷;�g��4<�d<�d`茦饢颋0恺�����p�pp�@ <��4dddd�@0P�Du�<��4BdBd�@0P�Du�� <��4!d!d�(A0P����0�___PPT10� �����___PPT9�j���B�}��~��u��[������/��0��1����)��m����n��@��K��G��L��H��I��<��=��f��g��8��9��:��;��^��M�� ��*��e�� �T���d���€���p��q��r����y��z��{��|��c�?� � %�舃���h The New York State Education Department Demystifying the Holistic Scoring Process in Social Studies: �Hi$($;��lRegents Examinations in Global History and Geography and United States History and Government Spring 2013 �"mZl�{t��Holistic Scoring Overview���When scoring holistically Read thoroughly, yet quickly to gain an impression of the entire response Read the entire response before determining a score, and then promptly assign a score �J��" �" ���}���Scores must be determined based on the holistic application of the content-specific rubric provided by 秋葵视频. The anchor and practice papers serve as examples of what a student response at a particular score level should look like. The content-specific rubric is not a checklist. ��" Z��~�� Important points to keep in mind�!!"���The quality of handwriting, the use of cursive or printing, margins, editing marks, cross-outs, and overall neatness are not part of the scoring criteria, unless the response is completely illegible and nothing can be read. ���" ��|u���(It is important for each reader to set aside his/her biases in order to keep the scoring as consistent and as fair to each student as possible. You are scoring a State exam, not grading a classroom assignment, therefore, personal classroom grading practices should be set aside while scoring. �)�" Z)�_[��@The Six Primary Scoring Criteria for the Commencement-Level DBQ�AA��The extent to which students develop the task utilize higher level thinking skills use the information provided in the documents incorporate relevant outside information in the DBQ essay support ideas with facts, examples, and details organize and develop a social studies essay�*�" ��" ���7No one bullet can hold a particular score point hostage�88"��QNumber of Documents Minor Errors Outside Information Copying Document Information�R�" R�DA��Number of Documents����nCan a paper still be given a score of 5 when the student did not use the minimum number of documents required?�oo��oYes, because it is only one of the criteria on which you base a score. If fewer than the minimum number of documents are used and all other criteria of a 5 are met, then you may have a 5 paper. However, when fewer than the minimum number of documents are used, you often have other criteria that are not being met, and thus you usually end up with a 2, 3, or 4 paper.�p�" p�5/��� An example can be found on the August 2009 Global History and Geography DBQ. The Level 5B anchor paper uses 3 documents, instead of the minimum number of 4 documents. This can be found online at: http://www.nysedregents.org/GlobalHistoryGeography/Archive/20090812scoringkeyIII.pdf �P�" �" ��mc0���EC�� Minor Errors �"��60��KCan a paper be given a score of 4 or 5 if it contains a minor error or two?�LL"���If the paper clearly demonstrates that the student understood the task and meets the criteria for a score of 4 or 5 on the test specific rubric, then, the paper can be given that score. A paper does not have to be perfect to reach a score of 5. ���" ��71���<An example can be found in the June 2010 United States History and Government DBQ. In this Level 4A anchor paper, the student states that with the passage of the 18th amendment alcohol consumption was made illegal. This can be found online at: http://www.nysedregents.org/USHistoryGov/Archive/20100618rg2.pdf ��6�" Z�" Z�" Z�" ZZZ� ���nc0��5�FD��Outside Information�����How does  outside information fit into the overall scoring of the essay?�JJ"���The 4th bullet must not be overemphasized in scoring. A response may receive a 3 without outside information. However, a response with outside information is not automatically a 3.�*��" ��-)����The quantity and quality of the outside information, the relevance of the outside information to the topic, and how it has been integrated into the essay should be used when determining the score of a response. �6��" ZZZ��sm����Often outside information can improve the overall essay when it is used to make historical connections and show analytical thinking. �.��" ����"��, All papers need to be evaluated based on the rubric. If the paper demonstrates that the student minimally develops the task, is primarily descriptive with weak or isolated information, has a general plan of organization, and includes outside information, the paper is probably more of a 2 than a 3. �",�" -�tn���An example of a level 3 response that uses no outside information can be found on the June 2009 United States History and Government DBQ, Practice Paper B. This can be found online at: http://www.nysedregents.org/USHistoryGov/Archive/20090616scoringkeyIII.pdf �2�" �" ��pc0���G@���An example of a level 2 response that uses outside information can be found on the January 2009 United States History and Government DBQ, Level 2A paper. This can be found online at: http://www.nysedregents.org/USHistoryGov/Archive/20090129scoringkeyIII.pdf �D��" ZM�" ZZ��oc0���IF��Copying Document Information��� How should you rate a DBQ essay when most of the response is copied directly from the documents and little or no original work is provided? ���" �JK��"�� A distinction needs to be made between paraphrased or copied information that is used to support a specific idea within the essay (an appropriate social studies skill) and the outright copying of information from the documents in an attempted response to the DBQ. �0 �"  �KG����Generally, when most of the information is copied directly from the documents without adding anything, the response will be rated between a 0 and a 2. �0��" � �LL��MThe revised generic rubrics for the Global and USHG exams address this issue �NN�� Score of 2:  or consists primarily of relevant information copied from the documents Score of 1:  or consists primarily of relevant and irrelevant information copied from the documents Score of 0:  includes only entire documents copied from the test booklet �,�" �MH���The actual score will depend on three things: 1) the degree or extent to which the response has been copied, 2) the selection of what specific content the student chose to copy for inclusion, and 3) how the student integrated the copied material into the response. �0�"  �NI��a Can a paper still be given a score of 5 or 4 when some information is copied from the documents?�ba��xAn example of a level 4 response where the student selectively copied information from documents as well as included good historical outside information to interpret the documents can be found on the January 2009 United States History and Government DBQ, Level 4C paper. This can be found online at: http://www.nysedregents.org/USHistoryGov/Archive/20090129scoringkeyIII.pdf �6,�" L�" y��c0�-w�@<��(What criteria helps define a score of 5?�))"��KA 5 paper shows evaluation and/or analysis. It requires substantial outside information that is well integrated into the response. It contains historically accurate information. Document information is used to support the thesis of the response and is interwoven with outside information. It is cohesive and thoroughly developed.�L�" ZL�A=����A 5 is not a 5 just because it is the best response that exists out of all the responses being graded. A well-written response that contains numerous historical inaccuracies or repeats information over and over again is usually not a level 5 paper. The response needs to meet the criteria established by the rubric. On occasion, a particular essay question may have no papers at level 5.���" Z��lf��>What often distinguishes a level 4 paper from a level 3 paper?�??"��cA 4 paper is both analytic and descriptive. It addresses all aspects of the task but may do so unevenly. It requires outside information that is integrated into the response. It contains historically accurate information. Document information is used to support the thesis of the response and is interwoven with outside information. It is well developed. �(c�" ZZd�mg����A 3 paper is more descriptive than analytic. It usually contains some outside information but it may not be well integrated. It contains supporting facts and details, but may also have some minor inaccuracies. �"��" ��<�8��>What often distinguishes a level 3 paper from a level 2 paper?�??"��5A level 3 response contains more explanatory statements and specific details than a level 2 response. In a DBQ, the documents are used to support the thesis of the essay. A level 3 response should include outside information, but it may not. However, most solid level 3 papers do include outside information.�6�" Z6�=9����A level 2 response tends to have broad general statements. Use of supporting information and information from the documents is limited. Note: While a level 2 paper is not required to include outside information, it may contain some.���" ��>:��=What most often distinguishes a 0 paper from a level 1 paper?�>>"���If a response is solely comprised of information copied from the documents and the historical context without any information provided by the student or accurately interpreted by the student, then the response is probably a 0. ���" ��B;���A level 1 paper is NOT a paper in which the student simply  attempted an answer. It must have some appropriate, original information. �*��" r�b^��!Generic Scoring Rubrics by Bullet���Continuity of Score Points See Appendix E for Thematic Essays: http://www.p12.nysed.gov/assessment/ss/hs/rubrics/rubrics-e.pdf See Appendix F for DBQ Essays: http://www.p12.nysed.gov/assessment/ss/hs/rubrics/rubrics-f.pdf �(��" �" ����c0�?~���c0����QM�� Reminder:���The rubrics define a set of scores on a continuum between 0 and 5. A standards-based assessment system measures where the student falls on that continuum. �@��" ��*%��Scoring Related Questions����'Issues Related to Scaffolding Questions�(("��� How should you rate an open-ended question when the question asks for two reasons and the student writes two answers on the first line and a third answer on the second line, but one of the answers on the first line is incorrect? �*�� � ���?The general rule of thumb is that a rater cannot go searching for a correct answer. Disregarding incorrect information to get to a correct answer is not acceptable. The order in which correct and incorrect answers appear on the lines matters. The first two answers should be rated, even if they are on the same line. �&?�" @"�&!��$Issues Related to the DBQ Essay Task�%%"��� How do you rate an essay where the task asks a student to write about two items in the historical context and the response includes discussion of three items? ����.*���_In this situation, only the first two items that appear in the response can be evaluated. A rater cannot search the response to determine which of the three items the student wrote about were strongest. The rater must use the test specific rubric and must focus on information related to the first two items as they appear within the student response.�`�" Z`�ke���However, there may be a situation where a student has appropriately applied information about the third item in a discussion on item one or item two. In this case, if the applied information supports the discussion, it should be considered when rating the overall response. �$�" �+'��Other Related Questions�� ��UWhy do some of the DBQ or Thematic essays use the phrase and/or within the question? �:V9" " "  ��VSED has been using the phrase and/or on social studies essay questions since 1990. The use of and/or benefits students by broadening the scope of acceptable answers and providing a choice of content within the essay. And/or allows the rater to accept the broadest range of student answers as directed by the content-specific scoring rubric. ��W�" Z""." ""t"  {"����� EXAMPLE: Discuss the political, social, and/or economic causes for the Russian Revolution. By wording the question this way, a teacher can accept a response that discusses any combination of causes. If the task said  and, the student would have to discuss one correct cause from each category. If the task said  or, the student would have to focus on one type of cause only and a rater could not give credit for information on a different type of cause. �L�ZZ""�"���yHow do raters know how many examples a student should provide when responding to a particular DBQ or Thematic essay task?�zz��Look for the  S , the plural. This indicates that two or more examples must be provided. However, in the case of a DBQ, a student must also use a minimum number of documents in his/her response and support the essay with as many facts, examples, and details as he/she can. Thus, having more examples usually improves the essay. Collectively, the DBQ documents will always provide multiple examples. �@��" ZZ €�jd���(If only one cause or impact is asked for, it will usually be phrased  a or  one . Example: a cause of& or one cause of& In general, teachers should teach their students to use as many examples as they can. It adds detail to the essay. It helps show the student s knowledge. ���" F ��fb��Other Scoring Notes����` In Global History, can we rate essay responses in which students wrote about the United States?�aa���Many topics in Global and U.S. History are intertwined. (The Cold War, The Middle East, Vietnam War, etc.) Not all essays will automatically exclude the use of information on the U.S. as part of an acceptable answer. An example of this can be found on the June 2011 Global History and Geography thematic essay. This can be found online at: http://www.nysedregents.org/GlobalHistoryGeography/611/20110615-gh-rg1.pdf. �>��" PPTK�6PJ��c0�T��wp��Tools required for scoring���Directions for Administering Regents Examinations www.p12.nysed.gov/assessment/hsgen H & G Information Booklet for Scoring Regents Examinations in Global History and Geography and United States History and Government www.p12.nysed.gov/assessment/hsgen School Administrator s Manual, Secondary Level Examinations http://www.p12.nysed.gov/assessment/sam/secondary/home.html �.8�" P>�" Pv��^c0�2T��_c0������c0�9t�xq����Global History and Geography and United States History and Government rating guides for specific test administrations available online �(��" �" ��yr���Test manuals should be reviewed by all administrators, teachers, and staff administering and/or scoring a New York State examination. Anyone who is involved in the scoring of a New York State examination must complete the training as specified in the test manuals and rating guides.��" Z����Reminder��2Teachers are allowed to proctor their own students, unless the district has a different policy. Teachers may not score their own students answer papers.���" ��€y�� Training ��All training should be based on the protocols established by 秋葵视频 as found in the H & G Information Booklet for Scoring Regents Examinations in Global History and Geography and United States History and Government as well as in the test specific rating guides.��" ��z����Scorers are encouraged to ask questions that relate to understanding the scoring guidelines and questionable papers, or scaffolding responses, but philosophical differences, personal preferences and biases must be set aside during the scoring process.���" ���{����The goal of scoring is to be sure the scoring criteria in the rubrics are accurately and consistently applied to each student response being rated across New York State.���" ���|��-Questions about scoring social studies exams�.."���Contact the Associates in Social Studies in the Office of State Assessment For Global History and Geography: Donna Merlau, dmerlau@mail.nysed.gov For United States History and Government: Greg Wilsey, gwilsey@mail.nysed.gov Phone: 518-474-0556 �rn�" '�" *�" %�" �" �" ��Pu2���c0�}����c0����ic��Your input is important���Feedback on State examinations is very important to the test development process. This can be done by completing our online Teacher Evaluation Forms at: http://www.forms2.nysed.gov/emsc/osa/exameval/reexameval.cfm �B��" @�" �" �A���c0������� X€0�癗0 �黏����<�( � ��饉 �� s �*€@U6�������`���  6 � �饉 �� s �*€霳6�����Pe���� 6 � �餒 �� � �0���師��藿h�� ?� �€€€���f��3���櫶���y�___PPT10�Y+D�='� �����=� @B� +r;t_��# t��1�迗�(€��€ # f ���thttp://www.nysedregents.org/testing/socstre/ushgrg.605.pdf�thttp://www.nysedregents.org/testing/socstre/ushgrg.605.pdf���#�4emscreminfo@mail.nysed.gov�Bmailto:e      !"#$%&'()*+,-./0123456789:;<=>?@AB�������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������mscreminfo@mail.nysed.gov���^�Dwww.p12.nysed.gov/assessment/hsgen�Rhttp://www.p12.nysed.gov/assessment/hsgen���_�Dwww.p12.nysed.gov/assessment/hsgen�Rhttp://www.p12.nysed.gov/assessment/hsgen�l�m��http://www.nysedregents.org/GlobalHistoryGeography/Archive/20090812scoringkeyIII.pdf��http://www.nysedregents.org/GlobalHistoryGeography/Archive/20090812scoringkeyIII.pdf��n�€http://www.nysedregents.org/USHistoryGov/Archive/20100618rg2.pdf�€http://www.nysedregents.org/USHistoryGov/Archive/20100618rg2.pdf�D�o��http://www.nysedregents.org/USHistoryGov/Archive/20090129scoringkeyIII.pdf��http://www.nysedregents.org/USHistoryGov/Archive/20090129scoringkeyIII.pdf�D�p��http://www.nysedregents.org/USHistoryGov/Archive/20090616scoringkeyIII.pdf��http://www.nysedregents.org/USHistoryGov/Archive/20090616scoringkeyIII.pdf����~http://www.p12.nysed.gov/assessment/ss/hs/rubrics/rubrics-e.pdf�~http://www.p12.nysed.gov/assessment/ss/hs/rubrics/rubrics-e.pdf����~http://www.p12.nysed.gov/assessment/ss/hs/rubrics/rubrics-f.pdf�~http://www.p12.nysed.gov/assessment/ss/hs/rubrics/rubrics-f.pdf� ���xhttp://www.forms2.nysed.gov/emsc/osa/exameval/reexameval.cfm�xhttp://www.forms2.nysed.gov/emsc/osa/exameval/reexameval.cfm����vhttp://www.p12.nysed.gov/assessment/sam/secondary/home.html�vhttp://www.p12.nysed.gov/assessment/sam/secondary/home.html�����,dmerlau@mail.nysed.gov�:mailto:dmerlau@mail.nysed.gov�����,gwilsey@mail.nysed.gov�:mailto:gwilsey@mail.nysed.gov�D���http://www.nysedregents.org/USHistoryGov/Archive/20090129scoringkeyIII.pdf��http://www.nysedregents.org/USHistoryGov/Archive/20090129scoringkeyIII.pdf�D���http://www.nysedregents.org/GlobalHistoryGeography/611/20110615-gh-rg1.pdf��http://www.nysedregents.org/GlobalHistoryGeography/611/20110615-gh-rg1.pdf�F/� 0��|�DArialgsRomanP�P�hu�貣颋0貣�"�DVerdanasRomanP�P�hu�貣颋0貣�" �DTimes New RomanP�P�hu�貣颋0貣�0�DWingdingsRomanP�P�hu�貣颋0貣�@�DTahomagsRomanP�P�hu�貣颋0貣�"� €A��� .�  @�n��?" d�d@���������  @@``€€ � 黏 鹄X= 21 ��  () 5  >>    :<�=C ������      tuv|}��������������������������������� �� �� � �� � � ��� �������� ���� � �    ?饎r�$�k懼W7剓詙3錞�i�$�b�$9嘳�+?e~徐.�*)��$i� �0��咥��臕�@���8�gX€�hY€�K 髆S 蕷;↑l8蕷;�g��4<�d<�d`茦饢颋0恺�����p�pp�@ <��4dddd�@0P�Du�<��4BdBd�@0P�Du�� <��4!d!d�(A0P����0�___PPT10� �����___PPT9�j���B�}��~��u��[������/��0��1����)��m����n��@��K��G��L��H��I��<��=��f��g��8��9��:��;��^��M�� ��*��e�� �T���d���€���p��q��r����y��z��{��|��c�?� � %�嘼���h The New York State Education Department Demystifying the Holistic Scoring Process in Social Studies: �Hi$($;��lRegents Examinations in Global History and Geography and United States History and Government Spring 2013 �"mZl�{t��Holistic Scoring Overview���When scoring holistically Read thoroughly, yet quickly to gain an impression of the entire response Read the entire response before determining a score, and then promptly assign a score �J��" �" ���}���Scores must be determined based on the holistic application of the content-specific rubric provided by 秋葵视频. The anchor and practice papers serve as examples of what a student response at a particular score level should look like. The content-specific rubric is not a checklist. ��" Z��~�� Important points to keep in mind�!!"���The quality of handwriting, the use of cursive or printing, margins, editing marks, cross-outs, and overall neatness are not part of the scoring criteria, unless the response is completely illegible and nothing can be read. ���" ��|u���(It is important for each reader to set aside his/her biases in order to keep the scoring as consistent and as fair to each student as possible. You are scoring a State exam, not grading a classroom assignment, therefore, personal classroom grading practices should be set aside while scoring. �)�" Z)�_[��@The Six Primary Scoring Criteria for the Commencement-Level DBQ�AA��The extent to which students develop the task utilize higher level thinking skills use the information provided in the documents incorporate relevant outside information in the DBQ essay support ideas with facts, examples, and details organize and develop a social studies essay�*�" ��" ���7No one bullet can hold a particular score point hostage�88"��QNumber of Documents Minor Errors Outside Information Copying Document Information�R�" R�DA��Number of Documents����nCan a paper still be given a score of 5 when the student did not use the minimum number of documents required?�oo��oYes, because it is only one of the criteria on which you base a score. If fewer than the minimum number of documents are used and all other criteria of a 5 are met, then you may have a 5 paper. However, when fewer than the minimum number of documents are used, you often have other criteria that are not being met, and thus you usually end up with a 2, 3, or 4 paper.�p�" p�5/��� An example can be found on the August 2009 Global History and Geography DBQ. The Level 5B anchor paper uses 3 documents, instead of the minimum number of 4 documents. This can be found online at: http://www.nysedregents.org/GlobalHistoryGeography/Archive/20090812scoringkeyIII.pdf �P�" �" ��mc0���EC�� Minor Errors �"��60��KCan a paper be given a score of 4 or 5 if it contains a minor error or two?�LL"���If the paper clearly demonstrates that the student understood the task and meets the criteria for a score of 4 or 5 on the test specific rubric, then, the paper can be given that score. A paper does not have to be perfect to reach a score of 5. ���" ��71���<An example can be found in the June 2010 United States History and Government DBQ. In this Level 4A anchor paper, the student states that with the passage of the 18th amendment alcohol consumption was made illegal. This can be found online at: http://www.nysedregents.org/USHistoryGov/Archive/20100618rg2.pdf ��6�" Z�" Z�" Z�" ZZZ� ���nc0��5�FD��Outside Information�����How does  outside information fit into the overall scoring of the essay?�JJ"���The 4th bullet must not be overemphasized in scoring. A response may receive a 3 without outside information. However, a response with outside information is not automatically a 3.�*��" ��-)����The quantity and quality of the outside information, the relevance of the outside information to the topic, and how it has been integrated into the essay should be used when determining the score of a response. �6��" ZZZ��sm����Often outside information can improve the overall essay when it is used to make historical connections and show analytical thinking. �.��" ����"��, All papers need to be evaluated based on the rubric. If the paper demonstrates that the student minimally develops the task, is primarily descriptive with weak or isolated information, has a general plan of organization, and includes outside information, the paper is probably more of a 2 than a 3. �",�" -�tn���An example of a level 3 response that uses no outside information can be found on the June 2009 United States History and Government DBQ, Practice Paper B. This can be found online at: http://www.nysedregents.org/USHistoryGov/Archive/20090616scoringkeyIII.pdf �2�" �" ��pc0���G@���An example of a level 2 response that uses outside information can be found on the January 2009 United States History and Government DBQ, Level 2A paper. This can be found online at: http://www.nysedregents.org/USHistoryGov/Archive/20090129scoringkeyIII.pdf �D��" ZM�" ZZ��oc0���IF��Copying Document Information��� How should you rate a DBQ essay when most of the response is copied directly from the documents and little or no original work is provided? ���" �JK��"�� A distinction needs to be made between paraphrased or copied information that is used to support a specific idea within the essay (an appropriate social studies skill) and the outright copying of information from the documents in an attempted response to the DBQ. �0 �"  �KG����Generally, when most of the information is copied directly from the documents without adding anything, the response will be rated between a 0 and a 2. �0��" � �LL��MThe revised generic rubrics for the Global and USHG exams address this issue �NN�� Score of 2:  or consists primarily of relevant information copied from the documents Score of 1:  or consists primarily of relevant and irrelevant information copied from the documents Score of 0:  includes only entire documents copied from the test booklet �,�" �MH���The actual score will depend on three things: 1) the degree or extent to which the response has been copied, 2) the selection of what specific content the student chose to copy for inclusion, and 3) how the student integrated the copied material into the response. �0�"  �NI��a Can a paper still be given a score of 5 or 4 when some information is copied from the documents?�ba��xAn example of a level 4 response where the student selectively copied information from documents as well as included good historical outside information to interpret the documents can be found on the January 2009 United States History and Government DBQ, Level 4C paper. This can be found online at: http://www.nysedregents.org/USHistoryGov/Archive/20090129scoringkeyIII.pdf �6,�" L�" y��c0�-w�@<��(What criteria helps define a score of 5?�))"��KA 5 paper shows evaluation and/or analysis. It requires substantial outside information that is well integrated into the response. It contains historically accurate information. Document information is used to support the thesis of the response and is interwoven with outside information. It is cohesive and thoroughly developed.�L�" ZL�A=����A 5 is not a 5 just because it is the best response that exists out of all the responses being graded. A well-written response that contains numerous historical inaccuracies or repeats information over and over again is usually not a level 5 paper. The response needs to meet the criteria established by the rubric. On occasion, a particular essay question may have no papers at level 5.���" Z��lf��>What often distinguishes a level 4 paper from a level 3 paper?�??"��cA 4 paper is both analytic and descriptive. It addresses all aspects of the task but may do so unevenly. It requires outside information that is integrated into the response. It contains historically accurate information. Document information is used to support the thesis of the response and is interwoven with outside information. It is well developed. �(c�" ZZd�mg����A 3 paper is more descriptive than analytic. It usually contains some outside information but it may not be well integrated. It contains supporting facts and details, but may also have some minor inaccuracies. �"��" ��<�8��>What often distinguishes a level 3 paper from a level 2 paper?�??"��5A level 3 response contains more explanatory statements and specific details than a level 2 response. In a DBQ, the documents are used to support the thesis of the essay. A level 3 response should include outside information, but it may not. However, most solid level 3 papers do include outside information.�6�" Z6�=9����A level 2 response tends to have broad general statements. Use of supporting information and information from the documents is limited. Note: While a level 2 paper is not required to include outside information, it may contain some.���" ��>:��=What most often distinguishes a 0 paper from a level 1 paper?�>>"���If a response is solely comprised of information copied from the documents and the historical context without any information provided by the student or accurately interpreted by the student, then the response is probably a 0. ���" ��B;���A level 1 paper is NOT a paper in which the student simply  attempted an answer. It must have some appropriate, original information. �*��" r�b^��!Generic Scoring Rubrics by Bullet���Continuity of Score Points See Appendix E for Thematic Essays: http://www.p12.nysed.gov/assessment/ss/hs/rubrics/rubrics-e.pdf See Appendix F for DBQ Essays: http://www.p12.nysed.gov/assessment/ss/hs/rubrics/rubrics-f.pdf �(��" �" ����c0�?~���c0����QM�� Reminder:���The rubrics define a set of scores on a continuum between 0 and 5. A standards-based assessment system measures where the student falls on that continuum. �@��" ��*%��Scoring Related Questions����'Issues Related to Scaffolding Questions�(("��� How should you rate an open-ended question when the question asks for two reasons and the student writes two answers on the first line and a third answer on the second line, but one of the answers on the first line is incorrect? �*�� � ���?The general rule of thumb is that a rater cannot go searching for a correct answer. Disregarding incorrect information to get to a correct answer is not acceptable. The order in which correct and incorrect answers appear on the lines matters. The first two answers should be rated, even if they are on the same line. �&?�" @"�&!��$Issues Related to the DBQ Essay Task�%%"��� How do you rate an essay where the task asks a student to write about two items in the historical context and the response includes discussion of three items? ����.*���_In this situation, only the first two items that appear in the response can be evaluated. A rater cannot search the response to determine which of the three items the student wrote about were strongest. The rater must use the test specific rubric and must focus on information related to the first two items as they appear within the student response.�`�" Z`�ke���However, there may be a situation where a student has appropriately applied information about the third item in a discussion on item one or item two. In this case, if the applied information supports the discussion, it should be considered when rating the overall response. �$�" �+'��Other Related Questions�� ��UWhy do some of the DBQ or Thematic essays use the phrase and/or within the question? �:V9" " "  ��VSED has been using the phrase and/or on social studies essay questions since 1990. The use of and/or benefits students by broadening the scope of acceptable answers and providing a choice of content within the essay. And/or allows the rater to accept the broadest range of student answers as directed by the content-specific scoring rubric. ��W�" Z""." ""t"  {"����� EXAMPLE: Discuss the political, social, and/or economic causes for the Russian Revolution. By wording the question this way, a teacher can accept a response that discusses any combination of causes. If the task said  and, the student would have to discuss one correct cause from each category. If the task said  or, the student would have to focus on one type of cause only and a rater could not give credit for information on a different type of cause. �L�ZZ""�"���yHow do raters know how many examples a student should provide when responding to a particular DBQ or Thematic essay task?�zz��Look for the  S , the plural. This indicates that two or more examples must be provided. However, in the case of a DBQ, a student must also use a minimum number of documents in his/her response and support the essay with as many facts, examples, and details as he/she can. Thus, having more examples usually improves the essay. Collectively, the DBQ documents will always provide multiple examples. �@��" ZZ €�jd���(If only one cause or impact is asked for, it will usually be phrased  a or  one . Example: a cause of& or one cause of& In general, teachers should teach their students to use as many examples as they can. It adds detail to the essay. It helps show the student s knowledge. ���" F ��fb��Other Scoring Notes����` In Global History, can we rate essay responses in which students wrote about the United States?�aa���Many topics in Global and U.S. History are intertwined. (The Cold War, The Middle East, Vietnam War, etc.) Not all essays will automatically exclude the use of information on the U.S. as part of an acceptable answer. An example of this can be found on the June 2011 Global History and Geography thematic essay. This can be found online at: http://www.nysedregents.org/GlobalHistoryGeography/611/20110615-gh-rg1.pdf. �>��" PPTK��c0�T��wp��Tools required for scoring���Directions for Administering Regents Examinations www.p12.nysed.gov/assessment/hsgen H & G Information Booklet for Scoring Regents Examinations in Global History and Geography and United States History and Government www.p12.nysed.gov/assessment/hsgen School Administrator s Manual, Secondary Level Examinations http://www.p12.nysed.gov/assessment/sam/secondary/home.html �.8�" P>�" Pv��^c0�2T��_c0������c0�9t�xq����Global History and Geography and United States History and Government rating guides for specific test administrations available online �(��" �" ��yr���Test manuals should be reviewed by all administrators, teachers, and staff administering and/or scoring a New York State examination. Anyone who is involved in the scoring of a New York State examination must complete the training as specified in the test manuals and rating guides.��" Z����Reminder��2Teachers are allowed to proctor their own students, unless the district has a different policy. Teachers may not score their own students answer papers.���" ��€y�� Training ��All training should be based on the protocols established by 秋葵视频 as found in the H & G Information Booklet for Scoring Regents Examinations in Global History and Geography and United States History and Government as well as in the test specific rating guides.��" ��z����Scorers are encouraged to ask questions that relate to understanding the scoring guidelines and questionable papers, or scaffolding responses, but philosophical differences, personal preferences and biases must be set aside during the scoring process.���" ���{����The goal of scoring is to be sure the scoring criteria in the rubrics are accurately and consistently applied to each student response being rated across New York State.���" ���|��-Questions about scoring social studies exams�.."���Contact the Associates in Social Studies in the Office of State Assessment For Global History and Geography: Donna Merlau, dmerlau@mail.nysed.gov For United States History and Government: Greg Wilsey, gwilsey@mail.nysed.gov Phone: 518-474-0556 �rn�" '�" *�" %�" �" �" ��Pu2���c0�}����c0����ic��Your input is important���Feedback on State examinations is very important to the test development process. This can be done by completing our online Teacher Evaluation Forms at: http://www.forms2.nysed.gov/emsc/osa/exameval/reexameval.cfm �B��" @�" �" �A���c0����r@�# &���1Root Entry��������崄d汷�嗞��)�蠵���H@Pictures��������Y%Current User������������ SummaryInformation(�����辑      !"#$%&'()*+,-./0123456789:;<=>?@AB���0�������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������     ��� !"#�%*����������������+.������/t���23456789:;<=>?@ABCDEFGHIJKLMNOPQRSTUVWXYZ[\]^_`abcdefghijklmnopqrs$uvwxyz{|}����€��������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������_缿�6��� yentnguyen