《科学素养测评 (7).ppt》由会员分享，可在线阅读，更多相关《科学素养测评 (7).ppt（29页珍藏版）》请在taowenge.com淘文阁网|工程机械CAD图纸|机械工程制图|CAD装配图下载|SolidWorks_CaTia_CAD_UG_PROE_设计图分享下载上搜索。
1、AssessingSocio-ScientificReasoningEvidenceCenteredDesign(ECD)Systematicapproachfordesigningassessmentsthatfocusesonevidenceofcompetenciesasthebasisforconstructingassessmenttasks.ProvidesaframeworkfordevelopingcoherentassessmentsCanbeappliedtomultipleassessmenttypesDevelopedbyRobertMislevy,LindaStein
2、berg&RusssellAlmondattheEducationalTestingServicein1997SowhatECDoffersasystematicapproachforbuildingacompellingcasetolinkstudentcompetencieswithassessmentitems/tasksECDisparticularlyimportantwhentheconstructsbeingassessedarecomplexSSRECDlinks3“models”Studentmodeltargetcompetencieswearetryingtoassess
3、EvidencemodelaplanforhowtomakesenseofstudentcompetenciesinlightofwhattheydointheassessmentTaskmodeltheitemsortaskspresentedandtheartifactsgeneratedthroughtheassessmentVisualrepresentationofECDECDimages:http:/myweb.fsu.edu/vshute/ECD.pdfStudentModelEvidenceModelTaskModelStudentModel:Whatknowledgeands
4、killsarewetryingtoassess?ThegreencirclesrepresentdifferentvariableswearetryingtoassessForSSR,thevariablesareSSRdimensionsComplexity,Inquiry,Perspective-taking&SkepticismWecanhypothesizerelationshipsamongthevariablesVisualrepresentationofECDECDimages:http:/myweb.fsu.edu/vshute/ECD.pdfStudentModelEvid
5、enceModelTaskModelTaskModel:Whatitemsortasksshouldbeusedtogenerateevidence?Thismodelincludesconsiderationoftheprompts,items,andresponsesthatrespondentswouldprovide.ForSSR,wewanttoseehowstudentsrespondtosocio-scientificissues,sowepresentlearnerswithanarrativescenariothatdescribesanissue.TaskModel1.Na
6、rrativescenario(ex:Usingantibioticsinagriculture)2.ItemsthattargetspecificSSRdimensionsComplexity:Q1.Imaginethatyouareinchargeofresolvingtheantibioticsinagricultureissue.Wouldthisbeadifficultissuetoresolve?Q2a.Whataspectsofthisissuemakeitdifficulttoresolve?Q2b.Whydoyouthinkthisissueiseasilyresolved?
7、3.Expectedresponseartifacts-shortanswers(1-5sentencesthataddressadimensionofSSR.)TaskModel1.Narrativescenario(ex:Usingantibioticsinagriculture)2.ItemsthattargetspecificSSRdimensionsComplexity:Q1.Imaginethatyouareinchargeofresolvingtheantibioticsinagricultureissue.Wouldthisbeadifficultissuetoresolve?
8、Q2a.Whataspectsofthisissuemakeitdifficulttoresolve?Q2b.Whydoyouthinkthisissueiseasilyresolved?3.Expectedresponseartifacts-shortanswers(1-5sentencesthataddressadimensionofSSR.)VisualrepresentationofECDECDimages:http:/myweb.fsu.edu/vshute/ECD.pdfStudentModelEvidenceModelTaskModelEvidenceModel:Howdowem
9、akesenseofresponses/behaviorsintermsofthetargetcompetencies?TheEvidenceModelincludesEvidenceRulesandaStatisticalModelEvidencerulesprovideguidelinesforhowtointerprettheworkproductRUBRICStatisticalmodeloffersarelationshipbetweenthetargetcompetenciesandtheobservedvariablesCanbeassimpleasspecifyingthatt
10、henumberofcorrectitemsbecomesthescoreEvidenceModelforSSRStudentresponsestotheSSRprompts1-5sentencenarratives.Rulesformakingsenseofstudentresponses:RubricsforeachitemModelforhowtointerpretrubricscoresrelativetoSSRdimensionsSSRScenario:ANTIBIOTICSINAGRICULTUREForwellover50years,farmersandranchershaveg
11、ivenantibioticstotheanimalstheyraiseforhumanfoodproduction.Atthispointintime,mostanimalsraisedforfoodproductionintheU.S.likecows,pigsandchickensreceiveantibiotics.Antibioticsgiventofarmanimalscanpromotegrowthandreducedisease.Thismakesitpossibleforfarmersandrancherstoproducelargeranimalswithfewerheal
12、thproblems.Recently,groupsinterestedinhumanhealthcareissuesandtheenvironmenthaveraisedconcernsaboutwidespreaduseofantibioticsinagriculture.Oneoftheseconcernsisthatnaturallyoccurringbacteriawilldevelopresistancetotheantibioticsthathavebeenapplied.Ifbacteriaareresistanttoaparticularantibiotic,thenthat
13、antibioticwillnotbeeffectiveintreatingdiseasecausedbythatbacteriainanimalsorhumans.Healthcaregroupshavewarnedthatantibioticresistantbacteriageneratedonfarmscanbetransmittedtohumansthroughmeatandpoultryproducts.Environmentalgroupshavealsonotedthattherearehigherlevelsofantibioticresistantbacteriainsoi
14、landwateraroundlargeanimalproductionfacilitiesandthatthesechangescancreatenewenvironmentalproblems.Supportersofcurrentfarmingpracticesarguethatantibioticuseisimportantforthehumanetreatmentoffarmanimalsandthatsomeoftheantibioticsusedinagriculturearenotevenusedwithhumans.Theyalsosuggestthatmostdocumen
15、tedproblemswithantibioticresistantbacteriacanbetiedtotheoveruseofantibioticsinhumans,notanimals.TheUSDA(U.S.DepartmentofAgriculture)isconsideringcreationofnewregulationsfortheuseofantibioticsinagriculture.SSRItemsforAntibioticsinAgricultureComplexity:Q1.Imaginethatyouareinchargeofresolvingtheantibio
16、ticsinagricultureissue.Wouldthisbeadifficultissuetoresolve?Q2a.Whataspectsofthisissuemakeitdifficulttoresolve?Q2b.Whydoyouthinkthisissueiseasilyresolved?Onlinesurveytoolthatallowsforautomateddirectionoflearnerstotheappropriatefollow-upprompt.SSRItemsforAntibioticsinAgriculture+ScoringGuidanceComplex
17、ity:Q1.Imaginethatyouareinchargeofresolvingtheantibioticsinagricultureissue.Wouldthisbeadifficultissuetoresolve?Q2a.Whataspectsofthisissuemakeitdifficulttoresolve?Q2b.Whydoyouthinkthisissueiseasilyresolved?0=NOnotacomplexissue0=Yes,butillogicalanswer1=Yes,onesourceofcomplexityw/outanyexplanation2=Ye
18、s,Onesourcesofcomplexity+Explanation3=Yes,Onesourcesofcomplexitywithexplanation;secondsource4=Yes,Twoormoresourcesofcomplexitywithanexplanationforeach.SampleresponsesOveruseofantibioticsiscausingobviousproblemsforhumanhealthsoweshouldstopwidespreaduseoftheminagriculture.Thisisdifficulttosolvebecause
19、therewillbedifficulteconomicimplicationsforfarmers.Thisistrickybecauseanytimeyoudealwiththeinteractionofhumanhealthandtheenvironmenttherecanbecomplicatingfactorsthataredifficulttoanticipate.Wehaveahistoryofunderestimatingcomplexhealthinteractions.Wealsodontreallyknowhowthemosquitosmightaffectotheror
20、ganisms.0=NO not a complex issue0=Yes,but illogical answer1=Yes,one source of complexity w/out any explanation2=Yes,One sources of complexity+Explanation3=Yes,One sources of complexity with explanation;second source 4=Yes,Two or more sources of complexity with an explanation for each.Sampleresponses
21、0Overuseofantibioticsiscausingobviousproblemsforhumanhealthsoweshouldstopwidespreaduseoftheminagriculture.1Thisisdifficulttosolvebecausetherewillbedifficulteconomicimplicationsforfarmers.3Thisistrickybecausewedontcompletelyknowhowbacteriaevolvinginresponsetotheantibioticsappliedtolivestockmightimpac
22、thumans.Itseemslikelythatthebacteriawillevolveinwaysthatcouldimpactlivestockbutwedontknowtheimplicationsforhumans.Therearealsoimportanteconomicimplicationsforfarmers.Notacomplexissue.OnesourceofcomplexitywithoutanexplanationOnesourceofcomplexitywithoutanexplanationOnesourceofcomplexitywithanexplanat
23、ionThisPhotobyUnknownAuthorislicensedunderCCBY-SATakeafewminutestoreadthroughanotherSSRscenario,promptsandscoringguides.Thisscenariodealswiththepotentialuseofgeneticengineeringtechnologiestolimitthespreadofamosquito-carrieddisease.GMOsquitoPrompt:ReflectionsThisissuewasveryprominentinUS2015-2016,but
24、lesssonowHowoftendopromptsneedtochange?Weworkedwithateamof5researcherstodeveloptherubrics.Initially,SSRdimensionrubricsvariedbutbecamemoresimilarovertime.LargetimeinvestmentearlyintheprocessInter-raterreliabilityamongthegroupraisedovertime(to90%consistencyImagecredit:https:/www.sciencenews.org/artic
25、le/gene-drives-spread-their-wingsCurrentstateofSSRassessmentdevelopmentandresearchDevelopedseveralscenarios&commonsetofitemsandscoringguidelinesAntibioticsinagriculture,GMOsquitoWindfarm,Fracking,Installationofadam,Nuclearpower,RaccoonRiver,LakeNothan,BranvilleBayBottleneck:ScoringresponsesPotential
26、SolutionsUseofnaturallanguageprocessingandautomatedcomputerscoringprotocolstogeneratealgorithmsthatcancoderesponsesTransitionfromopen-endedresponsestomultiplechoiceitemsMultiple-choiceoptionQuantitativeAssessmentofSocio-ScientificReasoning(QuASSR)Socio-scientificscenarioYes/Noquestiontodirectrespond
27、entstoafollow-upitemOrderedmultiple-choicemodelwithpartialcreditFrackingScenarioPavilionisatowninWyominglocatedinthewestcentralpartofthestate.Pavilionhasapopulationof240people,andissituatednearasitewherehydraulicfracturing(or“fracking”)ofnaturalgastakesplace.Infracking,pressurizedwatermixedwithchemi
28、calsandparticleslikesandareforcedintolayersofshale(arockcomposedofsheetsofhardmudwhichlayontopofeachotherlikethepagesinabook),openingfractureswhichallowlargeamountsofnaturalgastobeextracted.Aftercrackingtherocks,theliquidthenreturnstothesurfacewhereitisstoredinasealedcontainerorpond,andthesandremain
29、sinthecrackstokeepthemopen.Proponentsoffrackingconsideritabreakthroughintheenergyindustry.Frackingallowsextractionofmuchlargerquantitiesofnaturalgasthantraditionalnaturalgasextractionmethods,andallowsustotapintoreservesthatwerepreviouslyimpossibletoreach.TheoilandgasindustryisanimportantpartofWyomin
30、gseconomy,bringingbillionsofdollarsintothestate.Recently,however,theaquiferfromwhichtheresidentsofPaviliongettheirwaterhasbeenfoundtobecontaminatedwithhighlevelsofdissolvedorganicgaseslikemethane,ethane,andpropane,whichhasrenderedthewaterunsafe.Residentsofthearea,aswellasscientistsfromtheEnvironment
31、alProtectionAgency(EPA)andtheUnitedStatesGeologySurvey(USGS)whocollectedthedata,pointoutthatfrackingintheareaispossiblytoblame.Thedatafromthesetestsgoagainstclaimsbythedrillingindustry,whichreportsthatinjectingwater,sand,andchemicalsundergroundhasneverledtogroundwatercontamination.Thecompanydeniesth
32、atthepollutionintheaquiferisrelatedtoitsoperations.TheyciteasimilarincidentthattookplaceintheMarcellusShaleregionofPennsylvania;similarwatercontaminationtherewasfoundtobearesultofagasreserveneartheresidentswaterwell,andnotduetonearbyfrackingactivities.Whatshouldbedoneaboutthissituation?Scenario:Frac
33、king(hydraulicfracturing)Complexityprompts:Istheissueoffrackingacomplexissue?YES/NONO:Selecttheresponsebelowthatbestexplainswhythefrackingissueisafairlystraightforwardissue.YES:Selecttheresponsebelowthatbestexplainswhythefrackingissueiscomplex.Scenario:FrackingComplexityprompts:Istheissueoffrackinga
34、complexissue?YES/NONO:Selecttheresponsebelowthatbestexplainswhythefrackingissueisafairlystraightforwardissue.YES:Selecttheresponsebelowthatbestexplainswhythefrackingissueiscomplex.a.Theworldneedsenergy,andfrackingprovidesaccesstonewsourcesofrelativelycleanenergy.Therefore,frackingisapositivedevelopm
35、entforoursociety.0ptsb.Frackingcontaminatesfreshwatersupplieswithtoxicchemicals.Therefore,frackingshouldnotbeusedtoextractnaturalgas.0ptsScenario:Fracking(hydraulicfracturing)Complexityprompts:Istheissueoffrackingacomplexissue?YES/NONO:Selecttheresponsebelowthatbestexplainswhythefrackingissueisafair
36、lystraightforwardissue.YES:Selecttheresponsebelowthatbestexplainswhythefrackingissueiscomplex.a.Thefrackingissueiscomplexbecauseitpresentsmultipletradeoffsrelatedtosupplyofenergyandtheenvironment.2ptsb.Thefrackingissueiscomplexbecausewedonotknowalltheconsequences(positiveand/ornegative)oftheprocess.
37、1ptThisPhotobyUnknownAuthorislicensedunderCCBY-SATakeafewminutestoreadthroughQuASSRscenarios,promptsandscoringguides.1)Fracking2)BranvilleBayWrappingupSSRisaneducationallyrelevantconstruct,butitiscomplexandthereforedifficulttoassess.Systematicprocesses,likeEvidenceCenteredDesign,canbeusedtobuildanargumentforacoherentassessmentevenwhenthetheconstructiscomplex.OurteamusedECDtodesignassessmentsofSSRopen-endedpromptsandmultiplechoice(QuASSR)UsingtheseassessmentshasmadeitpossibletoexplorehowtheSSRdimensionsrelatetooneanotherandhowlearnerscanimproveSSRovertime