<?xml version="1.0" encoding="ISO-8859-1"?>
<GmsArticle>
  <MetaData>
    <Identifier>zma000187</Identifier>
    <ArticleType>Kurzfassung Vortrag</ArticleType>
    <TitleGroup>
      <Title language="en">A comparison of scoring algorithms for multiple answer MC-exams</Title>
      <TitleAlternative/>
    </TitleGroup>
    <CreatorList>
      <Creator>
        <PersonNames>
          <Lastname>Fischer</Lastname>
          <LastnameHeading>Fischer</LastnameHeading>
          <Firstname>Martin</Firstname>
          <Initials>M</Initials>
          <AcademicTitle>Dr. med.</AcademicTitle>
        </PersonNames>
        <Address>Medizinische Klinik Innenstadt der Universität München, Schwerpunkt Medizindidaktik, Ziemssenstrasse 1, 80336 München, Deutschland, Tel.: 089/5160-2159<Affiliation>Medizinische Klinik Innenstadt der Universität München, Schwerpunkt Medizindidaktik, München, Deutschland</Affiliation>
</Address>
        <Email>fischer.martin@med.uni-muenchen.de</Email>
        <Creatorrole corresponding="yes" presenting="yes">author</Creatorrole>
      </Creator>
      <Creator>
        <PersonNames>
          <Lastname>Bauer</Lastname>
          <LastnameHeading>Bauer</LastnameHeading>
          <Firstname>Daniel</Firstname>
          <Initials>D</Initials>
        </PersonNames>
        <Creatorrole corresponding="no" presenting="no">author</Creatorrole>
      </Creator>
      <Creator>
        <PersonNames>
          <Lastname>Kopp</Lastname>
          <LastnameHeading>Kopp</LastnameHeading>
          <Firstname>Veronika</Firstname>
          <Initials>V</Initials>
        </PersonNames>
        <Creatorrole corresponding="no" presenting="no">author</Creatorrole>
      </Creator>
    </CreatorList>
    <PublisherList>
      <Publisher>
        <Corporation>
          <Corporatename>German Medical Science</Corporatename>
          <CorporateHeading/>
        </Corporation>
        <Address>Düsseldorf, Köln</Address>
      </Publisher>
    </PublisherList>
    <SubjectGroup>
      <SubjectheadingDDB>610</SubjectheadingDDB>
      <SectionHeading language="de">Humanmedizin</SectionHeading>
    </SubjectGroup>
    <Comment/>
    <DateReceived>20050715</DateReceived>
    <DatePublishedList>
<DatePublished>20051118</DatePublished>
</DatePublishedList>
    <Language>engl</Language>
    <SourceGroup>
      <Journal>
        <ISSN>1860-3572</ISSN>
        <Volume>22</Volume>
        <Issue>4</Issue>
        <JournalTitle>GMS Zeitschrift für Medizinische Ausbildung</JournalTitle>
        <JournalTitleAbbr>GMS Z Med Ausbild</JournalTitleAbbr>
      </Journal>
    </SourceGroup>
    <ArticleNo>187</ArticleNo>
  </MetaData>
  <OrigData>
    <TextBlock name="Workshop" linked="yes">
      <MainHeadline>Workshop</MainHeadline>
<Pgraph>
<Mark1>Objectives:</Mark1> To compare different scoring algorithms usually employed in determining students scores in multiple correct answer multiple-choice (MC) exams regarding performance, reliability, selectivity, and item difficulty.</Pgraph>
<Pgraph>
<Mark1>Methods:</Mark1> Data from 420 3rd year medical students' end of term exam in internal medicine in February 2005 at Munich University were analysed (30 MC questions; up to 15 possible answers, up to 6 correct answers per question, at least as many distractors as true answers).</Pgraph>
<Pgraph>Scoring Algorithms: Each question scored a maximum of one point. No negative scores were applied. We compared:</Pgraph>
<Pgraph>- "Dichotomous" (D): One point if all true and no wrong answers were chosen.</Pgraph>
<Pgraph>- "Partial 1" (P1): One point for 100% true answers; 0.5 points for 50% or more true answers; zero points for less than 50% true answers. </Pgraph>
<Pgraph>- "Partial 2" (P2): A fraction of one point depending on the total number of possible answers was given for each correct decision (picking a right or ignoring a wrong answer); for each wrong decision one such fraction was subtracted.</Pgraph>
<Pgraph>
<Mark1>Results:</Mark1> The P1-algorithm showed best results concerning item selectivity, item difficulties, and internal consistency (Cronbach's alpha), respectively.</Pgraph>
<Pgraph>
<Mark1>Conclusions:</Mark1> The P1-algorithm seems to be the preferable method for the scoring of multiple answer MC-exams.  </Pgraph>
</TextBlock>
    <Media>
      <Tables>
        <NoOfTables>0</NoOfTables>
      </Tables>
      <Figures>
        <NoOfPictures>0</NoOfPictures>
      </Figures>
      <InlineFigures>
        <NoOfPictures>0</NoOfPictures>
      </InlineFigures>
      <Attachments>
        <NoOfAttachments>0</NoOfAttachments>
      </Attachments>
    </Media>
  </OrigData>
</GmsArticle>
