mibe000101 10.3205/mibe000101 urn:nbn:de:0183-mibe0001015 Research Article E-Learning-Kurse in Biometrie und Epidemiologie Ziegler Ziegler Andreas A Prof. Dr.

Institut für Medizinische Biometrie und Statistik, Universität zu Lübeck, Universitätsklinikum Schleswig-Holstein, Campus Lübeck, Maria-Goeppert-Str. 1, 23562 Lübeck, Deutschland, Tel.: +49 (451) 500-2780, Fax: +49 (451) 500-2999Institut für Medizinische Biometrie und Statistik, Universität zu Lübeck, Germany

ziegler@imbs.uni-luebeck.de author Pahlke Pahlke Friedrich F

Institut für Medizinische Biometrie und Statistik, Universität zu Lübeck, Germany

author German Medical Science GMS Publishing House

Düsseldorf

610 blended learning distance learning e-learning self-learning computergestütztes Lernen e-Didaktik e-Lernen Fernunterricht Kombilernen Online-Lernen Selbst-Lernen 20100113 engl 1860-9171 6 1 GMS Medizinische Informatik, Biometrie und Epidemiologie GMS Med Inform Biom Epidemiol 01 Ausbildung ist ein integraler Bestandteil unserer Profession. Während Master- und Promotionsmöglichkeiten in Biostatistik und Epidemiologie in verschiedenen Ländern auf hohem Niveau angeboten werden, gibt es andere Regionen, die eine adäquate spezifische Ausbildung erfordern. E-Lernen könnte eine Alternative zur Präsenzlehre sein, da Reisekosten vermieden werden und die Verfügbarkeit eines Dozenten durch die Verwendung geeigneter e-Lernen-Programme unbegrenzt erhöht werden könnte. In einer systematischen Literaturrecherche und einer Suche in Datenbanken wird die Verfügbarkeit von Angeboten aus den Bereichen e-Lernen in den Gebieten Statistik, Biometrie, Biostatistik, Epidemiologie und Genetische Epidemiologie untersucht. Insgesamt haben wir 25 Kurse identifiziert. Diese unterscheiden sich erheblich im Hinblick auf Zielgruppe, Inhalt, Umfang und Qualität. Die meisten Kurse wurden zu einer Zeit entwickelt, als die technischen Aspekte die größte Herausforderung bei der Entwicklung eines Angebots waren. Wichtige Hygiene- und Motivationsfaktoren waren zu diesem Zeitpunkt unbekannt und wurden daher nicht berücksichtigt. In Konsequenz wird den Studierenden in keinem der Kurse eine individuelle Rückmeldung gegeben. Es werden keine unterschiedlichen Schwierigkeitsgrade in Abhängigkeit des Kenntnisstands abgebildet. Viele Kurse erfüllen daher nicht die Anforderungen, die heutzutage an e-Lernen gestellt werden. Die Entwicklung moderner e-Lernen Angebote, die relevante didaktische Konzepte integrieren ist zwingend erforderlich. Die Nachhaltigkeit dieser Kurse ist wichtig und kann am besten durch die Verwendung von Plattformen gelöst werden, die spezifisch für diesen Zweck entwickelt wurden. Diese erlauben den Einsatz allgemein anerkannter didaktischer Prinzpien, sowie robuster und zuverlässiger Programme. Education is an integral component of increasing our profession’s profile. While master and PhD level education in biostatistics and epidemiology is provided at high levels in several regions, there are parts of the world deserving proper specialized education. E-learning may be one option because traveling costs can be avoided, and the capacity of teachers can be multiplied by making appropriate use of e-learning tools. The aim of this work was to explore the availability of e-learning approaches in the areas of statistics, biometry, biostatistics, epidemiology, and genetic epidemiology by a systematic literature search and a search in databases. We identified a total of 25 courses. They differ with respect to target audience, content, amount and quality. Many of them had been developed at a time when technical aspects were the main hurdle at the stage of course development. Important hygiene and motivation factors were generally unknown at that time, and, subsequently, ignored. As a result, none of the courses provides exercises that generate individual feedback to motivate the student, and no varying degree of complexity is observed. Many courses do not fulfill modern needs for e-learning. In conclusion, the development of modern e-learning following recent didactical concepts is urgently required. Sustainability of these courses is crucial and can be best guaranteed by using available technological platforms. These allow the use of common didactical principles, robust and reliable technology. Introduction Education is an integral component of increasing our profession’s profile. While master and PhD level education in the interdisciplinary subjects biometry, biostatistics, epidemiology and genetic epidemiology is provided at high levels in several regions, there are parts of the world where biostatisticians and epidemiologists have to fight hard to have their discipline recognized as one deserving proper specialized education . Further enhancement of the biometric, biostatistical, epidemiological and genetic epidemiological professions will be most efficient if both the profession itself as well as its many scientific partners receive appropriate initial, graduate and continuing training. A part of this training can take place in satellite meetings and educational sessions at conferences, short courses or summer schools. These activities are, however, expensive because they require traveling of teachers and/or students, and they are fixated on a specific time point or period. The traveling costs can be avoided and the capacity of teachers can be multiplied by making appropriate use of e-learning tools. Different definitions have been given for the term e-learning. For example, some authors require that e-learning only means web-based systems (, p. 28), while others mean computer-based teaching and learning. The latter is a combination of a phase of attendance, i.e., classical ex-cathedra teaching plus autonomous teaching by use of a teaching software . This combined form of teaching usually is termed blended learning and combines the advantages of both teaching forms. In this report, we allow for both definitions, i.e., self-learning e-learning courses as well as blended learning approaches that combined an online phase with a phase of attendance. The quality of the available e-learning depends on the extent to which they meet important hygiene and motivation factors (for details and definitions, see next section). Some of the most important hygiene factors concerning e-learning include the unlimited technical operational capability of the learning object, a consistent, integrative and intuitive navigation, a precise and clearly arranged structure of contents and pages, consistency of topics as well as the adequate consideration of the heterogeneity of the target audience . The most important motivation factors are a high grade of interactivity as well as demanding and at the same time motivating learning items [5]. These criteria are not fulfilled for webinars and video tapes of seminar talks and lectures, and we therefore explicitly exclude these courses from further consideration. However, we absolutely agree with colleagues (see, e.g. ) that this form of distance learning can be very helpful, especially for special topics which are usually taught in continuing education. Because we excluded this important strand of distance learning from this survey, we refer to http://www.pitt.edu/~super1/ for a collection of more than 2000 epidemiology presentations and to the world wide web virtual libraries for statistics and epidemiology. The aim of this paper is to explore the availability of e-learning approaches in the areas of statistics, biometry, biostatistics, epidemiology, and genetic epidemiology by a systematic literature search and a search in databases. To this end, we conducted a systematic literature search, a systematic search in the databases Web of Science (WoS), Google Scholar (GS) and in the world wide web virtual library of statistics. First, we examined e-learning courses which focus on learning topics in the field statistics, biostatistics and biometry. We specifically included statistics because the contents of courses in biostatistics and genetic epidemiology are strongly influenced by statistics (see, e.g. , , ). Furthermore, the term biometry is primarily used in the area of pattern recognition, thus sometimes not related to biometry as defined by the German Society of Medical Informatics, Biometry and Epidemiology and the International Biometric Society. We also investigated the areas of epidemiology and genetic epidemiology. After a brief description of the search strategy we discuss the identified courses in detail. For each e-learning course we firstly give a short description of the product, and, if necessary, of the project behind as well as the target group. This is followed by a short but critical discussion on the didactical aspects regarding the e-learning material. We expect to identify many courses that have been developed at a time, i.e., three to ten years ago, when technical aspects of the course were the main hurdle at the stage of course development. It is important to note that the importance of hygiene and motivation factors was generally unknown in the context of e-learning at this time. Furthermore, the technical prerequisites for implementing these important factors were not available at this time. Therefore, we expect that many courses do not fulfill modern needs for e-learning. And the deviation from these high demands is expected to be higher for older courses. Methods Motivation and hygiene In the late 1950’s, Herzberg derived the two factor motivation hygiene theory for satisfaction at a workplace . Identifying satisfiers and dissatisfiers led Herzberg to determine motivation and hygiene factors that employers could apply to improve employee satisfaction in the workplace. The motivation factors are those that increase satisfaction if they are present but generally do not lead to dissatisfaction if they are absent. Hygiene factors however cannot motivate but cause dissatisfaction if they are absent. Today, Herzberg’s motivation and hygiene principle finds an interesting application in eLearning practice. Exchanging employment for education and employees for students, the following motivation and hygiene factors are proposed : Motivation factors: enthusiasm and commitment of educators feedback and academic mentoring from tutors serendipity a sense of community Hygiene factors: clear expectations prompt assignment return reliable learning management system technology flexibility and control institutional policies and procedures If the proposed motivation and hygiene factors are accurate, the following generalizations can be made about e-learning : The online tutor and his or her activity is key to satisfaction in e-learning. The establishment of online community is a vital element of e-learning. The actual technology used in e-learning cannot satisfy. However, a poor choice can cause dissatisfaction. Providing students with flexible learning opportunities does not motivate them. However, its absence would cause dissatisfaction. Exclusion criteria An e-learning course can only be used at any institution if it is without commercial interest. Furthermore, it needs to transfer theoretical knowledge in addition to content that is relevant in applications. E-learning tools not fulfilling this important criterion or which are only available through a high license fee were excluded from this investigation. This exclusion criterion was fulfilled, e.g., when the audience consisted in companies of when the e-learning tool was designed for teaching a specific statistical software package. Furthermore, we restricted this study to projects available in English and/or German. A reviewer has noted that a restriction to English courses would be reasonable. However, prior to our literature search we were aware of the funding initiative for e-learning courses by the German Ministry of Education and Research which led to the development of several courses of questionable quality. Because some of these courses can serve as examples how e-learning courses should not be constructed, we decided to include the German language in our literature search. Literature search in the Web of Science Aim was a systematic literature search for identifying e-learning courses in statistics for use without phase of attendance, and e-learning courses in these areas based on a teaching and learning concept that includes a phase of attendance. The systematic literature search was conducted on July 8, 2009 in the ISI Web of Knowledge, Web of Science (WoS): http://apps.isiknowledge.com/ without restrictions with respect to the time period. The databases searched were SCI-EXPANDED, SSCI and A&HCI, CPCI-S, and CPCI-SSH. The topics searched are given column 1 of Table 1 . Literature search in the World Wide Web Virtual Library: Statistics The search was conducted on July 8, 2009 in the category “on-line educational resources” at http://www.stat.ufl.edu/vlib/statistics.html. Literature search in the World Wide Web Virtual Library: Medicine and Health: Epidemiology The search was conducted on July 11, 2009 in the category “on-line educational resources” at http://www.epibiostat.ucsf.edu/epidem/epidem.html. Literature search in Google Scholar The search was conducted on July 13, 2009 in the Scholar advanced search mode on http://scholar.google.de/. The period was restricted to 2000–2009, and the search terms are given in column 1 of Table 2 . Literature search on egms.de Finally, we performed a search for e-learning topics on http://www.egms.de/ using the terms ‘biometrie e-learning’ and ‘epidemiologie e-learning’. The use of the English terms gave the same findings. Results Search hits Web of Science The search in the WoS for ‘statistic* AND e-learning’ and for ‘statistic* AND “distance learning”’ revealed by far the most hits (Table 1 ). In total, 119 and 101 articles, respectively, were identified using these terms. Many false positive hits were related to the statistical analysis of the underlying technologies, the didactical methods or the comparison of a specific course with another one. Other hits included e-learning topics but were unrelated or only marginally related to statistics. Most hits for the term ‘Biomet’ were related to the web authentication of students. The WoS search gave no hits for four searches, and combinations with the term ‘blended learning’ were the least frequent found. In total, 262 different references were found, and 16 references describing online courses for statistics, biostatistics, and epidemiology were identified. Two of the courses were related to specific software , , and two courses are not available anymore , . Two references refer to one specific course which was not investigated in detail because the e-learning module is on business statistics , . Furthermore, it is unavailable to the public; thus, we excluded it from further considerations. One reference described a retro-looking computer game to explain the normal distribution , and it thus is not a complete online course. It was therefore excluded from further considerations. Another paper describes the architecture for distance learning to support statistics training by a tutor system . It is therefore not a complete course, and thus not considered further. The Dynamic Virtual Learning Networks , available at http://umberto.policlinico.unina.it/, are available in Italian, and were therefore excluded from further consideration. The material of Viehmann and Jöckel has been presented at a conference and is available as an abstract only. The course material is not accessible to the public, and it contains additional material to the lectures and exercises. It is not a complete course and therefore excluded from further considerations. Lee and Lee described the e-StatEdu System which was not found on the web. However, a short description of the course can be provided because of the detailed information given in . Larreamendy-Joerns et al. summarized 6 online statistics courses, and they will be described below in greater detail. Krause et al. describe the e-learning environment on correlation analysis Koralle. Through Härdle et al. , , we identified the course MM*Stat, EMILeA-stat, which is the acronym for Eine multimediale, internetbasierte und interaktive Lehr- und Lernumgebung in der angewandten Statistik, the examination preparation system Q&A, the abbreviation for questions and answers (http://mars.wiwi.hu-berlin.de/qa/), DoLStat@d, the data oriented learning system of statistics, and several e-books on statistics. Q&A does not provide a complete course, and it is therefore not considered further. Similarly, the e-books are excluded from further review. Finally, the authors of kindly provided the information that their course, entitled Epidemiology for Advanced Nursing Practice (NU.625), is in use. However, the material cannot be accessed from outside of the Thomas Jefferson University, and the course therefore had to be excluded from further considerations. World Wide Web Virtual Library: Statistics The search in the World Wide Web Virtual Library: Statistics revealed seven hits which are displayed in Table 3 . All but the last hit listed are material, e.g., text, figures or animations, on a very specific topic in statistics that can be used for teaching purposes and exercises. None of the available material is a complete e-learning course or complete e-learning module. The last hit listed is HyperStat (http://www.davidmlane.com/hyperstat/, see Figure 1 ). It is an internet platform with considerable information and links on statistics. Integrative part of the page are the introductory text book and the online tutorial. In 2005, Larreamendy-Jones et al. described and reviewed six online statistics courses, and all but one are still available (Table 4 ). Some of the described courses are freely available or for a small fee, while others have a high tuition fee. For example, the Psychology 3000 Online course is available for 770 US $ (July 11, 2009). World Wide Web Virtual Library: Medicine and Health: Epidemiology This search revealed no hits. Google Scholar The first hit for the search term ‘statistik biometrie “e learning”’ was Kladobra , who compared the courses Statistik: Beschreibende Statistik und explorative Datenanalyse (Descriptive Statistics and Exploratory Data Analysis), Neue Statistik II (New Statistics), PC-Statistik-Trainer 1.0 (PC Statistics Trainer), LernSTATS, and EMILeA-stat. The second hit referred to JUMBO. No other courses were identified with this search term. One further course was identified with the search terms ‘statistics biometry e-learning’. It describes the comparison of an introductory course to biostatistics held in the traditional form and as distance learning. The material for the distance learning course was, however, standard material, including video lectures and powerpoint presentation slides. The potential of e-learning tools was used by no means. Therefore, the course is excluded from further consideration. Literature search on egms.de Eight and 7 hits were observed for the search using the terms ‘biometrie e-learning’ and ‘epidemiologie e-learning’, respectively, and this search revealed one important additional reference on both search terms. Muche compared the courses EMILeA-stat, Neue Statistik (New Statistics), ActivStats, AST (Adaptive Statistics Tutor), Grundbegriffe der Biostatistik (Basic Terms of Biostatistics), Rice Virtual Lab in Statistics, JUMBO – standing for the Java-unterstützte Münsteraner Biometrie-Oberfläche (Java supported biometry interface from Münster) &#8211;,</PlainText></TextGroup> <Mark2>LernSTATS</Mark2> which meanwhile has been modernized and integrated in the Methodology toolbox, the multimedia learning software of the FernUniversit&#228;t in Hagen, <Mark2>Visual Bayes</Mark2>, <Mark2>VisualStat</Mark2>, <Mark2>ROBISYS</Mark2> &#8211; <Mark2>R</Mark2>ostocker <Mark2>Bio</Mark2>metrie<Mark2>sys</Mark2>tem &#8211;, <Mark2>NUMAS</Mark2> &#8211; <Mark2>Nu</Mark2>merical <Mark2>M</Mark2>athematics <Mark2>A</Mark2>nd <Mark2>S</Mark2>tatistics. The Rice Virtual Lab in Statistics hosts the <Mark2>HyperStat</Mark2> course which has been identified in the WoS search.</Pgraph> <Pgraph></Pgraph> <SubHeadline>Summary of search results</SubHeadline> <Pgraph>In total, we identified 25 different e-learning courses for statistics in the field medicine, biostatistics, biometry and epidemiology:</Pgraph> <Pgraph> <OrderedList> <ListItem level="1" levelPosition="1" numString="1."><Mark2>ActivStats</Mark2> (<Hyperlink href="http:&#47;&#47;www.pearsonhighered.com&#47;activstats&#47;">http:&#47;&#47;www.pearsonhighered.com&#47;activstats&#47;</Hyperlink>)</ListItem> <ListItem level="1" levelPosition="2" numString="2."><Mark2>AST</Mark2> (Adaptive Statistics Tutor); not available anymore</ListItem> <ListItem level="1" levelPosition="3" numString="3."><Mark2>CyberStats</Mark2> (<Hyperlink href="http:&#47;&#47;media.duxbury.com&#47;duxbury&#47;cyberstats&#47;cyberstats&#95;demo.html">http:&#47;&#47;media.duxbury.com&#47;duxbury&#47;cyberstats&#47;cyberstats&#95;demo.html</Hyperlink>), see Table 4 <ImgLink imgNo="4" imgType="table"/></ListItem> <ListItem level="1" levelPosition="4" numString="4."><Mark2>DoLStat&#64;d</Mark2> (<Hyperlink href="http:&#47;&#47;mo161.soci.ous.ac.jp&#47;&#64;d&#47;DoLStat&#47;">http:&#47;&#47;mo161.soci.ous.ac.jp&#47;&#64;d&#47;DoLStat&#47;</Hyperlink>)</ListItem> <ListItem level="1" levelPosition="5" numString="5."><Mark2>EMILeA-stat</Mark2> (<Hyperlink href="http:&#47;&#47;emilea-stat.rwth-aachen.de&#47;">http:&#47;&#47;emilea-stat.rwth-aachen.de&#47;</Hyperlink>, <Hyperlink href="http:&#47;&#47;www.emilea.de&#47;">http:&#47;&#47;www.emilea.de&#47;</Hyperlink>)</ListItem> <ListItem level="1" levelPosition="6" numString="6."><Mark2>Grundbegriffe der Biostatistik</Mark2> (Basic Terms of Biostatistics)</ListItem> <ListItem level="1" levelPosition="7" numString="7."><Mark2>HyperStat</Mark2> &#47; <Mark2>Rice Virtual Lab in Statistics</Mark2> (<Hyperlink href="http:&#47;&#47;www.davidmlane.com&#47;hyperstat&#47;">http:&#47;&#47;www.davidmlane.com&#47;hyperstat&#47;</Hyperlink>, <Hyperlink href="http:&#47;&#47;www.onlinestatbook.com&#47;rvls.html">http:&#47;&#47;www.onlinestatbook.com&#47;rvls.html</Hyperlink>)</ListItem> <ListItem level="1" levelPosition="8" numString="8."><Mark2>Introductory Statistics: Concepts, models, and applications</Mark2> (<Hyperlink href="http:&#47;&#47;www.psychstat.missouristate.edu&#47;introbook&#47;sbk00.htm">http:&#47;&#47;www.psychstat.missouristate.edu&#47;introbook&#47;sbk00.htm</Hyperlink>), see Table 4 <ImgLink imgNo="4" imgType="table"/> </ListItem> <ListItem level="1" levelPosition="9" numString="9."><Mark2>Investigating Statistics</Mark2> (unavailable), see Table 4 <ImgLink imgNo="4" imgType="table"/> </ListItem> <ListItem level="1" levelPosition="10" numString="10."><Mark2>JUMBO</Mark2> (<Hyperlink href="http:&#47;&#47;www.campus.uni-muenster.de&#47;fileadmin&#47;einrichtung&#47;imib&#47;lehre&#47;skripte&#47;biomathe&#47;jumbo.html">http:&#47;&#47;www.campus.uni-muenster.de&#47;fileadmin&#47;einrichtung&#47;imib&#47;lehre&#47;skripte&#47;biomathe&#47;jumbo.html</Hyperlink>)</ListItem> <ListItem level="1" levelPosition="11" numString="11."><Mark2>Koralle</Mark2> (<Hyperlink href="http:&#47;&#47;www.uni-saarland.de&#47;fak5&#47;stark&#47;">http:&#47;&#47;www.uni-saarland.de&#47;fak5&#47;stark&#47;</Hyperlink>)</ListItem> <ListItem level="1" levelPosition="12" numString="12."><Mark2>LernSTATS</Mark2>; old, integrated into Methodenlehre-Baukasten</ListItem> <ListItem level="1" levelPosition="13" numString="13."><Mark2>Methodenlehre-Baukasten</Mark2>, Fachrichtung Medizin (Methodology toolbox, field medicine) (<Hyperlink href="http:&#47;&#47;www.methodenlehre-baukasten.de&#47;web&#47;php&#47;kurs.php&#63;fach&#61;medizin">http:&#47;&#47;www.methodenlehre-baukasten.de&#47;web&#47;php&#47;kurs.php&#63;fach&#61;medizin</Hyperlink>)</ListItem> <ListItem level="1" levelPosition="14" numString="14."><Mark2>MM&#42;Stat</Mark2> &#47; Statistik &#8211; Wissenschaftliche Datenanalyse leicht gemacht (Statistics &#8211; Scientific Data Analysis Made Simple)</ListItem> <ListItem level="1" levelPosition="15" numString="15.">Multimedia-Projekt &#8220;Neue Statistik&#8221; (<Hyperlink href="http:&#47;&#47;www.fernuni-hagen.de&#47;stat&#47;">http:&#47;&#47;www.fernuni-hagen.de&#47;stat&#47;</Hyperlink>)</ListItem> <ListItem level="1" levelPosition="16" numString="16."><Mark2>Neue Statistik II</Mark2> (New Statistics) (<Hyperlink href="http:&#47;&#47;www.neuestatistik.de&#47;">http:&#47;&#47;www.neuestatistik.de&#47;</Hyperlink>)</ListItem> <ListItem level="1" levelPosition="17" numString="17."><Mark2>NUMAS</Mark2> (<Hyperlink href="http:&#47;&#47;www.numas.de&#47;">http:&#47;&#47;www.numas.de&#47;</Hyperlink>)</ListItem> <ListItem level="1" levelPosition="18" numString="18."><Mark2>PC-Statistik-Trainer</Mark2> 1.0 (PC Statistics Trainer)</ListItem> <ListItem level="1" levelPosition="19" numString="19."><Mark2>ROBISYS</Mark2> (<Hyperlink href="http:&#47;&#47;www.imib.med.uni-rostock.de&#47;IMIB&#47;HTML&#47;elearning&#47;elearning&#95;start.php">http:&#47;&#47;www.imib.med.uni-rostock.de&#47;IMIB&#47;HTML&#47;elearning&#47;elearning&#95;start.php</Hyperlink>)</ListItem> <ListItem level="1" levelPosition="20" numString="20."><Mark2>Seeing Statistic</Mark2>s (<Hyperlink href="http:&#47;&#47;www.seeingstatistics.com&#47;">http:&#47;&#47;www.seeingstatistics.com&#47;</Hyperlink>), see Table 4 <ImgLink imgNo="4" imgType="table"/> </ListItem> <ListItem level="1" levelPosition="21" numString="21."><Mark2>Statistik: Beschreibende Statistik und explorative Datenanalyse</Mark2> (Descriptive Statistics and Exploratory Data Analysis); offline available via CD</ListItem> <ListItem level="1" levelPosition="22" numString="22."><Mark2>StatCenter Psych 3000 Online</Mark2> (<Hyperlink href="http:&#47;&#47;www.psych.utah.edu&#47;stat&#47;">http:&#47;&#47;www.psych.utah.edu&#47;stat&#47;</Hyperlink>), see Table 4 <ImgLink imgNo="4" imgType="table"/> </ListItem> <ListItem level="1" levelPosition="23" numString="23."><Mark2>SurfStat</Mark2> (<Hyperlink href="http:&#47;&#47;surfstat.anu.edu.au&#47;surfstat-home&#47;surfstat-main.html">http:&#47;&#47;surfstat.anu.edu.au&#47;surfstat-home&#47;surfstat-main.html</Hyperlink>), see Table 4 <ImgLink imgNo="4" imgType="table"/> </ListItem> <ListItem level="1" levelPosition="24" numString="24."><Mark2>Visual Bayes</Mark2> (<Hyperlink href="http:&#47;&#47;www.imbi.uni-freiburg.de&#47;medinf&#47;projekte&#47;vbayes&#95;e.htm">http:&#47;&#47;www.imbi.uni-freiburg.de&#47;medinf&#47;projekte&#47;vbayes&#95;e.htm</Hyperlink>)</ListItem> <ListItem level="1" levelPosition="25" numString="25."><Mark2>VisualStat</Mark2> (<Hyperlink href="http:&#47;&#47;www.visualstat.com&#47;">http:&#47;&#47;www.visualstat.com&#47;</Hyperlink>)</ListItem> </OrderedList> </Pgraph> <Pgraph>All courses but those identified from the review paper <TextLink reference="23"></TextLink> (see Table 4 <ImgLink imgNo="4" imgType="table"/>) are now discussed with respect to motivation and hygiene factors in alphabetical order.</Pgraph> <SubHeadline>Specific courses</SubHeadline> <SubHeadline2>1. ActivStats</SubHeadline2> <Pgraph>ActivStats is an e-learning software for PC and MAC available as student version in bookstores <TextLink reference="33"></TextLink>. ActivStats is available since 1999, and version 7 was released early in 2008. It covers the topics descriptive statistics, random experiments, testing hypotheses, regression, and analysis of variance. A voluminous ActivStats Teachers Guide is offered in addition to the software, which enables the lecturer to apply the product in a didactically reasonable way (online available via <Hyperlink href="http:&#47;&#47;www.datadesk.com&#47;support&#47;guide&#47;">http:&#47;&#47;www.datadesk.com&#47;support&#47;guide&#47;</Hyperlink>).</Pgraph> <SubHeadline2>Discussion</SubHeadline2> <Pgraph>At the latest by examining the wrapping, it becomes obvious that ActivStats is dedicated to users of specific software products; on the front page you find &#8220;Learn how to use Data Desk, JMP, Excel, MINITAB and SPSS&#8221;. A noticeably more expensive version of ActivStats is available at the manufacturer of Data Desk in addition to the student version. With this, it is said: &#8220;ActivStats is an innovative multimedia education product that teaches introductory college-level statistics and the use of our Data Desk data exploration package&#8221; (<Hyperlink href="http:&#47;&#47;www.datadesk.com&#47;products&#47;mediadx&#47;activstats&#47;">http:&#47;&#47;www.datadesk.com&#47;products&#47;mediadx&#47;activstats&#47;</Hyperlink>). The intention therefore seems to be to learn the handling of the software Data Desk. Therefore, we do not examine this e-learning course further.</Pgraph> <SubHeadline2>2. AST (Adaptive Statistics Tutor)</SubHeadline2> <Pgraph>The website is unavailable, and an extended web search did not reveal any search results.</Pgraph> <SubHeadline2>3. CyberStats</SubHeadline2> <Pgraph>CyberStats (Table 4 <ImgLink imgNo="4" imgType="table"/>) is described in <TextLink reference="23"></TextLink>, and therefore not described here.</Pgraph> <SubHeadline2>4. DoLStat&#64;d</SubHeadline2> <Pgraph>DoLStat&#64;d &#8211; <Mark2>Data oriented Learning System of Statistics</Mark2> was developed from 2002 to 2006, and it was published as html-based online course. Only 9 of the planned 21 chapters have been realized. The learning system is not maintained for some time, and the links to the few realized chapters are not working. Therefore, we refrain from describing this course in detail.</Pgraph> <SubHeadline2>5. EMILeA-stat</SubHeadline2> <Pgraph>EMILeA-stat is an internet based teaching and learning environment for applied statistics <TextLink reference="34"></TextLink>. EMILeA-stat emerged of the project e-stat, which was funded by the German Ministry of Education and Research from 2001 to 2004 within the program New Media in Education from April 2001 to December 2004 with a total budget of 2.9 Mio. Euro. Thirteen principal investigators and 70 researchers took part in this project. The teaching system is available online through the project page (<Hyperlink href="http:&#47;&#47;www.emilea.de&#47;">http:&#47;&#47;www.emilea.de&#47;</Hyperlink>, Figure 2 <ImgLink imgNo="2" imgType="figure"/>). On the start page, the user can choose between different alternatives to get access to the learning contents and items. For example, it is possible to get direct access to learning units for specific topics (Figure 3 <ImgLink imgNo="3" imgType="figure"/>), or the user can select courses where contents and learning units are arranged according to functional aspects. The following learning units are available in EMILeA-stat: official statistics, association, descriptive statistics, entropy, exploratory data analysis, finance mathematics, linear structural equations, machine learning, basic calculus, critical review of PISA 2000, numerical methods, quality optimization, robust statistics, inferential statistics, sequential methods, statistics of finance markets, stochastics in school, stochastic processes, generalized linear models, actuarial mathematics, probability calculus, econometrics and demography, and time series analysis.</Pgraph> <SubHeadline2>Discussion</SubHeadline2> <Pgraph>EMILeA-stat is a voluminous collection of learning material for statistics. Even though the content was provided by several different authors, the presentation of the content and learning units is homogeneous and very consistent. The database using Content Management System is created in an attractive and modern way. It consistently follows the didactical concept which is described on the project web site and in <TextLink reference="34"></TextLink>.</Pgraph> <Pgraph>Running over the pages, we noticed that the construction has the character of an electronic textbook. For example, no directly integrated interactions to illustrate complex contents were used. Beside some exceptions, no learning units or exercises are available, and only a few problems and solutions are available. A direct online solution is not possible. As a result, the student does not receive any feedback by the teaching system. The didactical additional benefit compared to a textbook can be found in the clear structure, in the linking of content, and in the simple navigation across topics. The actual content mainly consists in text, formulae, and tables. In addition, some figures and very few Java Applets are available for some topics. However, the latter are not directly linked to the content but have to be accessed by a sub-menu.</Pgraph> <Pgraph>H&#228;rdle et al. <TextLink reference="26"></TextLink> criticized the project as follows: &#8220;The e-stat project mainly suffered from technical and content issues. The complicated structure of modules requires a certain amount of knowledge, especially of XML. Furthermore the different modules are diverse, in their quality and amount. For some modules there are extensive descriptions at all levels, for a large proportion of modules there are only information at one of three levels.&#8221;</Pgraph> <SubHeadline2>6. Grundbegriffe der Biostatistik (Basic Terms of Biostatistics)</SubHeadline2> <Pgraph>Grundbegriffe der Biostatistik (Basic Terms of Biostatistics) is an interactive pdf document (<Hyperlink href="http:&#47;&#47;www.biostat.uzh.ch&#47;teaching&#47;lecturenotes&#47;online&#47;olscriptku.pdf">http:&#47;&#47;www.biostat.uzh.ch&#47;teaching&#47;lecturenotes&#47;online&#47;olscriptku.pdf</Hyperlink>) which is meant to support the students of Z&#252;rich University in learning the basics of biostatistics. The learning environment can be compared with an electronic textbook which is equipped with basical navigation buttons on the right (forward, back, jump to, etc.). The document provides several exercises with yes&#47;no answers. The learner can check his&#47;her solutions for each item by mouse clicks. The content covers descriptive statistics, probability, testing hypotheses and regression.</Pgraph> <SubHeadline2>Discussion</SubHeadline2> <Pgraph>Several animations and interactions (Java applets) are linked to the content. It was the intention of the author that they pop up in a separate window of the web browser after mouse click on the respective hyperlink. The most recent version of the course was released in 2004 and was not adapted to the rearrangement of the content management system of the university. As a result, the links to the animations do not work anymore. They can only be used with direct links from the &#8220;funpark with statistical simulations&#8221;, a loose collection of animations (<Hyperlink href="http:&#47;&#47;www.biostat.uzh.ch&#47;teaching&#47;lecturenotes&#47;online.html">http:&#47;&#47;www.biostat.uzh.ch&#47;teaching&#47;lecturenotes&#47;online.html</Hyperlink>). The yes&#47;no exercises are of a low complexity level and can contribute only in part to the learning success. No feedback is provided to the learner in addition to the number of correct answers.</Pgraph> <SubHeadline2>7. HyperStat &#47; Rice Virtual Lab in Statistics</SubHeadline2> <Pgraph>&#8220;HyperStat Online Statistics Textbook&#8221; (Figure 1 <ImgLink imgNo="1" imgType="figure"/>) is an English internet platform, containing a wide range of information and links referring to statistics. The central component of this site is the introductive statistic textbook and online-tutorial by Prof. David Lane, Rice University, Houston (TX), USA (<Hyperlink href="http:&#47;&#47;www.davidmlane.com&#47;hyperstat&#47;">http:&#47;&#47;www.davidmlane.com&#47;hyperstat&#47;</Hyperlink>). The following contents are linked on the web site: univariate and bivariate data, probability, distributions, point estimator, confidence intervals, testing hypothesis, power, analysis of variance, regression, distribution-free tests, and measuring effect sizes. HyperStat is also available via the &#8220;Rice Virtual Lab in Statistics&#8221; web site (<Hyperlink href="http:&#47;&#47;www.onlinestatbook.com&#47;rvls.html">http:&#47;&#47;www.onlinestatbook.com&#47;rvls.html</Hyperlink>), where further teaching material for statistics can be found.</Pgraph> <SubHeadline2>Discussion</SubHeadline2> <Pgraph>In essence, HyperStat can be used as an e-learning course although it has the character of a textbook. Thus, it is a collection of content, and not an integrated e-learning course with a clear didactical e-learning concept. The web page HyperStat is online since 1993, and by viewing the pages it becomes clear that no adaptations to new ergonomic and design standards have been implemented since. For example, many pages include a &#8220;next&#8221; button, which is replaced by a &#8220;prev&#8221; button at the end of a chapter. Thus, it is impossible to navigate from chapter to chapter. The learner has to change to the table of contents each time instead. The content is predominantly made up of text with only a few illustrations. Exercises are not available. In summary, many of the motivation and hygiene factors discussed above are not taken into account. The didactical additional benefit compared to a pure textbook can be found only in the quicker navigation through the contents and in the quicker tracing of cross references by hyperlinks.</Pgraph> <SubHeadline2>8. Introductory Statistics: Concepts, models, and applications</SubHeadline2> <Pgraph>This course is described in detail in <TextLink reference="23"></TextLink>, and therefore not discussed here.</Pgraph> <SubHeadline2>9. Investigating Statistics</SubHeadline2> <Pgraph>This course is described in detail in <TextLink reference="23"></TextLink>, but is not available anymore. It is therefore not discussed here.</Pgraph> <SubHeadline2>10. JUMBO</SubHeadline2> <Pgraph>The &#8220;Java-unterst&#252;tzte M&#252;nsteraner Biometrie-Oberfl&#228;che&#8221; (JUMBO), Java supported M&#252;nster biometry interface, is an html-based learning environment for the basics of biometry (Figure 4 <ImgLink imgNo="4" imgType="figure"/>). The learning environment can be used online, but it is also available as CD from the authors. The use of JUMBO is free of charge. This e-learning course covers descriptive statistics, probability calculus, random variable, testing hypotheses, distributions, and design of experiments. A precursor of JUMBO was first presented in 1997, and the complete course was published in 2001 <TextLink reference="35"></TextLink>. The most recent version of JUMBO (Version 6.8) dates of 2002.</Pgraph> <SubHeadline2>Discussion</SubHeadline2> <Pgraph>The development of JUMBO&#8217;s user interface started more than a decade ago, and it has never been adapted to newer standards. For example, the screaming colors which were frequently used for private web sites in the 90&#8217;s are catching the eye at once. On every page, there are blinking buttons and cliparts in the gif file format which are known to appear distracting for many users and deflect from the content (Figure 5 <ImgLink imgNo="5" imgType="figure"/>). They can even be demotivating (<Hyperlink href="http:&#47;&#47;www.heise.de&#47;kiosk&#47;archiv&#47;ct&#47;2000&#47;05&#47;246">http:&#47;&#47;www.heise.de&#47;kiosk&#47;archiv&#47;ct&#47;2000&#47;05&#47;246</Hyperlink>). Each chapter was placed on a single HTML page. As a result, the chapter on descriptive statistics I requires 22 screen pages at a resolution of 1280 &#215; 1024 and has to be scrolled with the mouse or the keyboard very often for reading. A very pleasant feature of the course is the large number of interactions (Java applets). However, they open in a new window each time. At the end of each chapter, a Java applet with multiple choice problems is available. Unfortunately, we were not able to start these problems neither with the Firefox Browser nor with the Internet Explorer in testing.</Pgraph> <SubHeadline2>11. Koralle</SubHeadline2> <Pgraph>The computer-based learning environment for correlation analysis is an html-based online course developed in 2002. It is not a complete course because it only covers correlation analysis. It is therefore not considered here.</Pgraph> <SubHeadline2>12. LernSTATS; old, integrated into Methodenlehre-Baukasten</SubHeadline2> <Pgraph>LernSTATS is an html-based learning environment, and the target audience is psychology students. With a total of 11 chapters, the following topics are covered: scales, frequency distributions, measures of location and of variability, standardization, correlation, regression, and factor analysis. Small interactions (Adobe Flash Format) are integrated periodically within the learning pages to illustrate the theoretical knowledge (Figure 6 <ImgLink imgNo="6" imgType="figure"/>).</Pgraph> <Pgraph>LernSTATS was developed as an innovation project at Hamburg University. It has been integrated into the Methodenlehre-Baukasten (MLBK), and this further development was funded by the German Ministry of Education and Research within the program &#8220;New Media in Education&#8221;.</Pgraph> <SubHeadline2>Discussion</SubHeadline2> <Pgraph>In the literature, it is said about LernSTATS that &#8220;it is a little doubtable if the program really is appropriate for autonomous learning of the basics of statistics ... &#91;since&#93; the very lean theoretical explanations ... mostly do not exceed the niveau of a fomulary&#8221; (<TextLink reference="30"></TextLink>, p. 337). Because it has been integrated into MLBK, an in-depth discussion of LernSTATS is not required.</Pgraph> <SubHeadline2>13. Methodenlehre-Baukasten, Fachrichtung Medizin</SubHeadline2> <Pgraph>MLBK (Figure 7 <ImgLink imgNo="7" imgType="figure"/>) is the further development of LernSTATS, and it has been adapted to the subjects psychology, educational science, sociology, economics and medicine. In addition, the module statistics II has been released, covering sample and universe, testing hypotheses, and analysis of variance. Flash interactions are used in addition to Java Applets. Additional modules are from reality to data, data collection methods, specific methods, and experimental methods. Access to the Methodenlehre-Baukasten is charged with a license fee of &#8364; 12.00 per person and year.</Pgraph> <SubHeadline2>Discussion</SubHeadline2> <Pgraph>LernSTATS has been criticized in the literature <TextLink reference="30"></TextLink>. The concerns also count for MLBK at least to some extent, because every learning page was revised and extended, but in most of the cases only from a didactical and not from a technical point of view.</Pgraph> <Pgraph>The graphical user interface of the MLBK appears neat and modern; the navigation through the contents is simple and intuitive. Within the modules there is a wide range of exercises that, unfortunately, are suitable only for practicing. They are not appropriate for individual evaluation of the learning success because the problems offer only a minor grade of complexity; the exercise types are multiple choice and drag and drop. Furthermore, the solutions of the learners are not directly corrected and evaluated. As a result, the learner does not receive any feedback concerning his&#47;her individual knowledge, which is of great importance for the learning success. We therefore conclude that MLBK is not suitable for self-learning.</Pgraph> <SubHeadline2>14. MM&#42;Stat &#47; Statistik &#8211; Wissenschaftliche Datenanalyse leicht gemacht (Statistics &#8211; Scientific Data Analysis Made Simple)</SubHeadline2> <Pgraph>MM&#42;STAT <TextLink reference="36"></TextLink> is an e-learning course that is available on CD-ROM <TextLink reference="37"></TextLink>. Technically, this course is built up of static html pages (Figure 8 <ImgLink imgNo="8" imgType="figure"/>). Thus, it can be used both online and offline. The course is provided in German, English, French and Spanish, and it covers the following topcis: basic statistics, one-dimensional frequency distribution, probability calculus, combinatorial methods, random variable, distributions, sampling theory, estimation, statistical tests, two-dimensional frequency distribution, regression, and time series analysis.</Pgraph> <SubHeadline2>Discussion</SubHeadline2> <Pgraph>MM&#42;STAT basically is an electronic textbook, i.e., the content is provided in a digital form. The interactivity of this module is limited to the navigation between the sections. The didactical potential of technology supported teaching is not used at all. True interaction to visualize complex statistical topics are lacking, so are learning units. The course has smaller technical problems (see, e.g., hidden scroll bars in Figure 9 <ImgLink imgNo="9" imgType="figure"/>), and we were not able to use it with the Firefox browser.</Pgraph> <SubHeadline2>15. Multimedia-Projekt &#8220;Neue Statistik&#8221;</SubHeadline2> <Pgraph>The learning modules are only available to students of the Fernuniversit&#228;t in Hagen. However, it seems that the contents of the New Statistics and New Statistics II are used.</Pgraph> <SubHeadline2>16. Neue Statistik II (New Statistics)</SubHeadline2> <Pgraph>Neue Statistik II (New Statistics) is a further development of the project Neue Statistik (New Statistics), and it was funded within the program New Media in Education by the German Ministry of Education and Research. It is based on the e-learning course Statistik interaktiv that is available in book shops <TextLink reference="38"></TextLink> and described below. &#8220;Neue Statistik II&#8221; promises an online overall curriculum for the interactive transfer of statistical teaching learning (<Hyperlink href="http:&#47;&#47;www.neuestatistik.de&#47;">http:&#47;&#47;www.neuestatistik.de&#47;</Hyperlink>). The project was developed in cooperation of the Statistics Departments at 10 German universities. The learning units are edited in learning modules and cover the following topics: descriptive statistics, probability calculus, point estimation, testing hypotheses, regression, sampling theory, and survival analysis.</Pgraph> <Pgraph>More than 80 teaching modules are available, and they contain texts from classical textbooks, short animated lectures (Adobe Flash Format), interactive Java applets, formulae, case studies, and exercises with solutions for the statistics lab (<Hyperlink href="http:&#47;&#47;www.statistiklabor.de&#47;">http:&#47;&#47;www.statistiklabor.de&#47;</Hyperlink>; <TextLink reference="39"></TextLink>). Online access is restricted to members and partners of the consortium and their students, including the use of the statistic lab, the individual adaptation of the overall curriculum, and the support to conduct digital examinations. Non-members have access only to the statistics lab, few examples, and demonstrations of the learning environment Neue Statistik. For a more detailed description, the reader may refer to <TextLink reference="30"></TextLink>.</Pgraph> <SubHeadline2>Discussion</SubHeadline2> <Pgraph>The graphical user interface is designed in an appealing fashion, the navigation is consistent and intuitive (Figure 10 <ImgLink imgNo="10" imgType="figure"/>). The learning content predominantly consists of classic text which often extends to several pages. Therefore, the learner has to scroll while working through the content. The flash animations and Java applets within the learning environment seem to be a little detached from the content because they can be selected only via a separate media gallery. Exercises with sample solutions are found at the end of some pages. However, these are pure math problems and written exercises, and no interactivity or online evaluation with feedback is provided.</Pgraph> <SubHeadline2>17. NUMAS</SubHeadline2> <Pgraph>NUMAS is a web-based teaching and learning system on Numeric Mathematics and Statistics. The project was funded by the German Ministry of Education and Science in the program New Media in Education. It can be used free of charge after registration via <Hyperlink href="http:&#47;&#47;www.numas.de&#47;">http:&#47;&#47;www.numas.de&#47;</Hyperlink>. Several modules on numerical mathematics, statistics, and medical statistics are available, and they cover the topics: distributions, descriptive statistics, analytical statistics, survival analysis, diagnostic tests, and study design.</Pgraph> <SubHeadline2>Discussion</SubHeadline2> <Pgraph>The handling of the learning environment is not always intuitive. For example, the navigation of the different learning modules is designed in a way that the topics are highlighted by mouse roll over, but the topic cannot be selected by a mouse click. Instead, the learner has to move to the subsection &#8220;zu den Lernobjekten&#8221; (to learning objects) first. Software ergonomic guidelines are ignored with respect to navigation and most of the hyperlinks: Predominantly, a click on a link does not result in changing the page or the state but a new window is opened. The intensive use of the learning environment can quickly result in getting lost in the many open windows. The appearance of the interface is heterogeneous: Both type face and color range are not standardized. For example, the start page of NUMAS appears in dark blue, whereas the content pages turn up in mellow lavender and pink. In contrast to this, the sitemap is designed in green and yellow, and the search window is light blue. According to the start page of NUMAS, the system still is in the stage of development. However, the last update of the system was done more than 5 years ago.</Pgraph> <Pgraph>The effectiveness of the learning concept has to be doubted. For example, the description of the histogram is presented on one learning page without any visual aids (Figure 11 <ImgLink imgNo="11" imgType="figure"/>). Only by clicking on &#8220;Beispiel&#8221; (example), a window pops up which also shows the histograms. Frequent scrolling is required when working through the content. The learning unit statistics contains only very few interactive examples, and the pages include text and formulae only, except of very few exceptions. The exercises only consist of text without interaction. Often, the problems are made up in a way that the learner has to use pencil and paper to solve the problem. For example, &#8220;Draw a histogram and a circle diagram.&#8221; Solutions exist but the learner no feedback is provided concerning his&#47;her solutions.</Pgraph> <SubHeadline2>18. PC-Statistik-Trainer 1.0</SubHeadline2> <Pgraph>The PC-Statistik-Trainer 1.0 is an independent program based on the operating system Windows, and it is available in bookshops <TextLink reference="40"></TextLink>. The program includes exercises from the area of descriptive and inductive statistics for students of economics. It is not a complete learning environment but a software program for the practice of statistical problems. Most of the problems are restricted to the mere calculation. The methodology and theoretical background are not explained. In summary, the PC-Statistik-Trainer 1.0 is not useful for autonomous learning of statistics <TextLink reference="30"></TextLink>, and we therefore refrain from describing this program in greater detail.</Pgraph> <SubHeadline2>19. ROBISYS</SubHeadline2> <Pgraph>The &#8220;Rostocker Biometriesystem&#8221; (ROBISYS) is an e-learning course developed by Rostock University covering the topics descriptive statistics (module 1), validation of diagnostic procedures (module 2), and randomization methods for controlled clinical trials (module 3). The two last modules were developed within the project MLBK. Thus, they were also funded by the German Ministry of Education and Research in the program New Media in Education.</Pgraph> <SubHeadline2>Discussion</SubHeadline2> <Pgraph>The first module consists of static html pages which exclusively work with Microsoft&#8217;s Internet Explorer. The user interface appears out of date and disregards didactically important functions, e.g., there is no progress bar (Figure 12 <ImgLink imgNo="12" imgType="figure"/>). The course includes a page with multiple choice exercises. The learner can validate each problem by mouse click, and the feedback is of the kind &#8220;C is wrong, A is correct&#33;&#8221; The second and third modules are small programs, and they are completely provided in Adobe Flash Format. This has a substantial drawback: In both modules, each content text is automatically smoothed by Flash. This is fine with short texts, but reading of longer texts can lead to unnecessary strains and tiredness of the eyes. Furthermore, the navigation through the chapters is unfavorably designed. For example, the user is forced to move step by step through the different content pages and cannot skip already known content (Figure 13 <ImgLink imgNo="13" imgType="figure"/>). Moreover, subsequent pages are directly linked in the text and thus cannot be selected by a forward button.</Pgraph> <SubHeadline2>20. Seeing Statistics</SubHeadline2> <Pgraph>This course has been described in detail in <TextLink reference="23"></TextLink>, and it is therefore not considered here.</Pgraph> <SubHeadline2>21. Statistik: Beschreibende Statistik und explorative Datenanalyse (Descriptive Statistics and Exploratory Data Analysis)</SubHeadline2> <Pgraph>This e-learning course is available in book shops <TextLink reference="38"></TextLink>. It technically uses static html pages that have been generated using Microsoft FrontPage 2.02. Frontpage is an html editor using the WYSIWYG principle. The course can be used both online and offline. Topics covered are one-dimensional and multi-dimensional distributions, location, dispersion and disparity measures, measures of association, regression, theory of price indices, and time series. A detailed description of this course has been given in <TextLink reference="30"></TextLink>.</Pgraph> <SubHeadline2>Discussion</SubHeadline2> <Pgraph>The course has a clear didactical concept. Each chapter starts with a short text in which the learner is introduced to the topic. Through the hyperlinks theory, example, training, the user is connected to the multimedia content of the learning unit. Theory and practice always consist in a short movie that requires a browser plugin to play real video format. In the training area, content is demonstrated interactively although the title suggest examples requiring calculations. The course has been developed for a screen resolution of 800 &#215; 600 dpi (Figure 14 <ImgLink imgNo="14" imgType="figure"/>) which is out-of-date. The course has been developed with FrontPage 2.02, which was available with Microsoft Office in 1996. This indicates that is has not been updated and adapted to current technological standards for a longer time period. This may also explain crashing of both the Firefox browser and the Internet Explorer at those parts of the course where multimedia content was embedded.</Pgraph> <Pgraph>In summary, the learning program follows a clear didactical concept. However, it does not take into account important hygiene and motivation factors because it is out-of-date. Specifically, we criticize the lack of learning tasks. As a result, the learner cannot train specific content and cannot control his&#47;her progress. </Pgraph> <SubHeadline2>22. StatCenter Psych 3000 Online</SubHeadline2> <Pgraph>This course has been described in detail in <TextLink reference="23"></TextLink>, and it is therefore not considered here.</Pgraph> <SubHeadline2>23. SurfStat</SubHeadline2> <Pgraph>SurfStat is an online course is the evolution of an existing set of course notes, translated to html to implement hypertext links. Java applets have been added to replace statistical tables and to illustrate concepts. Some units have &#8220;progress checks&#8221; (i.e., multiple-choice items with feedback). In summary, it is an html-based course that looks like an electronic textbook (Figure 15 <ImgLink imgNo="15" imgType="figure"/>). It is described in detail in <TextLink reference="23"></TextLink>, and it is therefore not discussed further here.</Pgraph> <SubHeadline2>24. Visual Bayes</SubHeadline2> <Pgraph>Visual Bayes is an interactive learning program which imparts basic methods for the interpretation and validation of diagnostic tests in a graphic way. It is an independent program which was originally developed for the system software MS-DOS and adapted and newly compiled to Windows in 2003. Ten short chapters cover the topics <TextGroup><PlainText>2 &#215; 2</PlainText></TextGroup> tables, test statistics, Bayes formula, predictive values, combination of tests, distributions, sampling, cut-off value, ROC curve, and cost function.</Pgraph> <SubHeadline2>Discussion</SubHeadline2> <Pgraph>The learning program is structured clearly, and it is easy to handle. It contains small exercises which are directly evaluated and commented. Each problem can be repeated arbitrarily often because solutions are not saved. Thus, the problems serve for training in the first place. The graphical user interface of Visual Bayes was originally developed for MS-DOS, and it appears out-of-date. Specifically, the screen resolution is only 640 &#215; 480 dpi and cannot be changed (Figure 16 <ImgLink imgNo="16" imgType="figure"/>).</Pgraph> <SubHeadline2>25. VisualStat</SubHeadline2> <Pgraph>VisualStat is a small internet platform of Freiburg University. Its aim is the dynamic interactive visualization for selected fields of statistics. It provides four Java applets in addition to useful links to statistics. The applets cover the topics arithmetic mean in the linear model, one-way analysis of variance with two or three groups, and t-test. Thematically seen VisualStat covers just a small field of statistics. The aim is not to provide a complete e-learning course, and we therefore refrain from a detailed discussion.</Pgraph> </TextBlock> <TextBlock linked="yes" name="Discussion"> <MainHeadline>Discussion</MainHeadline> <Pgraph>In a systematic literature search, we have identified 25 different e-learning tools for statistics covering many different aspects of the field. It is surprising that German projects published in international peer-reviewed journals have been identified predominantly. The difference between the many German projects and the relatively few e-learning courses in English can probably be explained by the funding initiative &#8220;New Media in Education&#8221; of the German Ministry of Education and Research. Five of the identified projects have been developed within this program. The financial volume was 2.9 million EUR, and the funding period was April 2001 until December 2004. There were 13 partners and more than 70 scientists involved in the project so that a large number of publications inevitably is the consequence of this project structure <TextLink reference="34"></TextLink>.</Pgraph> <Pgraph>The e-learning offers differ substantially with respect to target audience, content, amount and quality. The range is from very little interactive content, like <Mark2>VisualStat</Mark2>, to extensive learning systems covering all important basics of statistics as <Mark2>EMILeA-stat</Mark2> or <Mark2>Neue Statistik II</Mark2>. The learning modules that have focused on little content generally have a higher degree of interactivity, e.g., <Mark2>ROBISYS</Mark2>.</Pgraph> <Pgraph>E-learning courses not meeting basic hygiene factors are expected to be less successful. For example, if the system does not operate flawless, in extreme cases, the demotivation of students can be so big that he&#47;she is not using the learning offer anymore. Hygiene factors for e-learning courses, like a consistent, integrative and intuitive navigation or a precise and clearly arranged structure of contents and pages are important for generating a positive basic attitude in students. These hygiene factors are not met in some of the courses.</Pgraph> <Pgraph>One of the most important motivating factors of e-learning courses are demanding and, at the same time, motivating learning tasks <TextLink reference="2"></TextLink>, <TextLink reference="3"></TextLink>, <TextLink reference="4"></TextLink>. Nevertheless, some of the investigated courses come without any learning tasks. If exercises are available, most of them are provided as text, and the solution is linked to the exercise. This is not different from a presentation in a textbook. None of the exercises gives individual feedback to motivate the student, and no varying degree of complexity has been found. Furthermore, the level obtained at the end of a specific exercise is not recorded. This means that no information is provided to the student about his&#47;her progress, and the results cannot be used for a continuing control of the learning progress. It always reflects a snapshot of the learning success.</Pgraph> <Pgraph>We have expected to identify many courses that are prone to this critique because they have been developed at a time when technical aspects of the course were the main hurdle at the stage of course development. For example, the oncampus factory (<Hyperlink href="http:&#47;&#47;www.oncampus.de&#47;">http:&#47;&#47;www.oncampus.de&#47;</Hyperlink>), a portal providing a learning platform for the Virtual University of Applied Sciences and the Baltic Sea Virtual Campus offers contracts to external course developers only since the beginning of 2007. Subsequently, the most difficult part now is the storyboard which needs to be written either by an author or a professional storyboard writer. The author does not need to take care of any technical aspects. They are provided and adapted according to current standards within the system. This can guarantee sustainability of a course to a greater extent compared to courses which do not make use of such a platform with integrated didactical structure. Platforms like the one provided by oncampus were not available at the time when the courses were implemented that have been compared in this review. It is therefore important to note that some of the courses have been very successful despite the general concerns and have been updated from previous versions (<Mark2>Neue Statistik II</Mark2>, <Mark2>Interaktive Multimedia Software</Mark2>). Thus, sustainability of these courses is guaranteed.</Pgraph> <Pgraph>In our systematic literature search, we have not been able to identify a single freely available e-learning course for epidemiology or genetic epidemiology. Only few web sites covering some aspects of this area have been found, and only a portion of the available material is suited for self-learning. Because of our involvement in the area of genetic epidemiology, we know that only little online material is available in this area. Specifically, we know of three courses which are based on talks which are linked to the respective slides. These are simple and cheap to produce. The idea to present teaching material in this form is not new, and the Henry Stewart group (<Hyperlink href="http:&#47;&#47;www.henrystewart.com&#47;">http:&#47;&#47;www.henrystewart.com&#47;</Hyperlink>) produces and sells this kind of learning material for more than 25 years. However, there is the general question whether this form of teaching should be called e-learning and whether this offer is suitable for self-learning. The recording of lectures is not suitable for thorough self-learning because many didactical aspects, hygiene and motivation factors are not fulfilled. Furthermore, the degree of complexity is rather limited because no learning tasks are available, the navigation is rudimentary, the content can be chosen only roughly, and the speed in the presentations is fixed. To summarize, the didactical possibilities are not used at all.</Pgraph> <Pgraph>Despite this critique, it can be of great importance making available digital recordings of lectures to students and interested researchers. If huge distances between lecturer and audience have to be overcome, students and researchers might be able to follow a talk while this would not be possible otherwise. However, we recommend not calling such video recordings e-learning.</Pgraph> <Pgraph>The use of electronic media for courses requires adjustments in the way how students learn, they only accept such a technology if they have real advantages. H&#228;rdle et al. made the experience that students rarely use forums; even in lectures with a large audience more than 99&#37; of the entries came from the lecturer himself. They also observed a tendency to use inappropriate language, and several forums had to be closed because of insulting postings from the students <TextLink reference="26"></TextLink>. Furthermore, the teaching time and effort in the corresponding e-learning environments takes more time than teaching in a face-to-face environment <TextLink reference="41"></TextLink>. Specifically, the cost for developing an appropriate e-learning course fulfilling the standard hygiene and motivation factors are very high. Although some colleagues have made bad experiences with e-learning, this method of teaching can reduce the fear of students which is a significant barrier to learning statistics <TextLink reference="18"></TextLink>. For example, employing videogame aesthetics can reduce sensations of fear. Another aspect which is important for some of the students is how collaborative learning can be established in an e-learning environment. This again will demand a higher effort from the teacher, who will have to supervise all the discussions among the learners, so that they do not deviate from the intended topic for the lesson <TextLink reference="42"></TextLink>.</Pgraph> <Pgraph>In conclusion, a few years ago, there was hype for e-learning in statistics and biostatistics for the modern education of students. Subsequently, several projects were positively reviewed by funding agencies for developing respective courses. However, as pointed out by H&#228;rdle et al. <TextLink reference="26"></TextLink>, developers were interested in the technically most sophisticated solutions, the lecturers in the proliferation of their materials and the students in an easy way to achieve enough knowledge to pass the exam. Thus, different groups had different goals. The adaptation of existing courses to modern standards has been followed only to a small portion, and sustainability is an important issue. Very few courses have been newly developed, pointing to the fact that the hype is not continuing. Available platforms should be used so that technological development is avoided. These allow the use of common didactical principles, robust and reliable technology.</Pgraph> </TextBlock> <TextBlock linked="yes" name="Notes"> <MainHeadline>Notes</MainHeadline> <SubHeadline>Acknowledgements</SubHeadline> <Pgraph>This work was supported by the German Ministry of Education and Science, grant 01 GR 0466 (AZ). It is part of FP&#8217;s dissertation. This work originated in the remits of the Education Committee of the International Biometric Society, which is entitled &#8220;web-based and distance learning&#8221;.</Pgraph> <SubHeadline>Conflicts of interest</SubHeadline> <Pgraph>The authors declare that they have no conflicts of interest. They have created an e-learning course for Genetic Epidemiology which has been integrated in the 2<Superscript>nd</Superscript> edition of the book &#8220;A Statistical Approach to Genetic Epidemiology: Concepts and Applications&#8221; by Andreas Ziegler and Inke R. K&#246;nig, Wiley-VCH, ISBN-13: 978-3-527-32389-0.</Pgraph> </TextBlock> <References linked="yes"> <Reference refNo="1"> <RefAuthor>Molenberghs G</RefAuthor> <RefAuthor>Davidian M</RefAuthor> <RefTitle></RefTitle> <RefYear>2003</RefYear> <RefBookTitle>Strategic plan document, version 8</RefBookTitle> <RefPage></RefPage> <RefTotal>Molenberghs G, Davidian M. Strategic plan document, version 8. 2003. Available from: http:&#47;&#47;www.tibs.org&#47;WorkArea&#47;downloadasset.aspx&#63;id&#61;718 &#91;accessed on July 11, 2009&#93;.</RefTotal> <RefLink>http:&#47;&#47;www.tibs.org&#47;WorkArea&#47;downloadasset.aspx&#63;id&#61;718</RefLink> </Reference> <Reference refNo="2"> <RefAuthor>Rosenberg MJ</RefAuthor> <RefTitle></RefTitle> <RefYear>2000</RefYear> <RefBookTitle>E-Learning: Strategies for Delivering Knowledge in the Digital Age</RefBookTitle> <RefPage></RefPage> <RefTotal>Rosenberg MJ. E-Learning: Strategies for Delivering Knowledge in the Digital Age. McGraw-Hill: New York; 2000.</RefTotal> </Reference> <Reference refNo="3"> <RefAuthor>Hiemstra R</RefAuthor> <RefAuthor>Rau O</RefAuthor> <RefAuthor>Pelz D</RefAuthor> <RefTitle>Statistik-Unterricht mit eLearning</RefTitle> <RefYear>2002</RefYear> <RefBookTitle>14. Tagung DVFFA, Sektion Forstliche Biometrie und Informatik</RefBookTitle> <RefPage>15-21</RefPage> <RefTotal>Hiemstra R, Rau O, Pelz D. Statistik-Unterricht mit eLearning. In: K&#246;hl M, Quednau H, editors. 14. Tagung DVFFA, Sektion Forstliche Biometrie und Informatik. Tharandt: Deutscher Verband Forstlicher Forschungsanstalten; 2002. p. 15-21.</RefTotal> </Reference> <Reference refNo="4"> <RefAuthor>Reinmann-Rothmeier G</RefAuthor> <RefTitle></RefTitle> <RefYear>2003</RefYear> <RefBookTitle>Didaktische Innovation durch Blended Learning: Leitlinien anhand eines Beispiels aus der Hochschule</RefBookTitle> <RefPage></RefPage> <RefTotal>Reinmann-Rothmeier G. Didaktische Innovation durch Blended Learning: Leitlinien anhand eines Beispiels aus der Hochschule. Huber: Bern; 2003.</RefTotal> </Reference> <Reference refNo="5"> <RefAuthor>Schulmeister R</RefAuthor> <RefTitle>Diversit&#228;t von Studierenden und die Konsequenzen f&#252;r eLearning</RefTitle> <RefYear>2004</RefYear> <RefBookTitle>Campus 2004. Kommen die digitalen Medien in die Jahre&#63;</RefBookTitle> <RefPage>133-44</RefPage> <RefTotal>Schulmeister R. Diversit&#228;t von Studierenden und die Konsequenzen f&#252;r eLearning. In: Carstensen D, Barrios B, editors. Campus 2004. Kommen die digitalen Medien in die Jahre&#63; M&#252;nster: Waxmann; 2004. p. 133-44.</RefTotal> </Reference> <Reference refNo="6"> <RefAuthor>Zelen M</RefAuthor> <RefTitle>Biostatisticians, biostatistical science and the future</RefTitle> <RefYear>2006</RefYear> <RefJournal>Stat Med</RefJournal> <RefPage>3409-14</RefPage> <RefTotal>Zelen M. Biostatisticians, biostatistical science and the future. Stat Med. 2006;25:3409-14. DOI: 10.1002&#47;sim.2658</RefTotal> <RefLink>http:&#47;&#47;dx.doi.org&#47;10.1002&#47;sim.2658</RefLink> </Reference> <Reference refNo="7"> <RefAuthor>Ziegler A</RefAuthor> <RefAuthor>K&#246;nig IR</RefAuthor> <RefTitle></RefTitle> <RefYear>2006</RefYear> <RefBookTitle>A Statistical Approach to Genetic Epidemiology: Concepts and Applications</RefBookTitle> <RefPage></RefPage> <RefTotal>Ziegler A, K&#246;nig IR. A Statistical Approach to Genetic Epidemiology: Concepts and Applications. Weinheim: Wiley-VCH; 2006.</RefTotal> </Reference> <Reference refNo="8"> <RefAuthor>Thomas DC</RefAuthor> <RefTitle></RefTitle> <RefYear>2004</RefYear> <RefBookTitle>Statistical Methods in Genetic Epidemiology</RefBookTitle> <RefPage></RefPage> <RefTotal>Thomas DC. Statistical Methods in Genetic Epidemiology. New York: Oxford University Press; 2004.</RefTotal> </Reference> <Reference refNo="9"> <RefAuthor>Sokal RR</RefAuthor> <RefAuthor>Rohlf FJ</RefAuthor> <RefTitle></RefTitle> <RefYear>1994</RefYear> <RefBookTitle>Biometry: The Principles and Practices of Statistics in Biological Research</RefBookTitle> <RefPage></RefPage> <RefTotal>Sokal RR, Rohlf FJ. Biometry: The Principles and Practices of Statistics in Biological Research. New York: Freeman; 1994.</RefTotal> </Reference> <Reference refNo="10"> <RefAuthor>Herzberg F</RefAuthor> <RefAuthor>Mausner B</RefAuthor> <RefAuthor>Snyderman BB</RefAuthor> <RefTitle></RefTitle> <RefYear>1959</RefYear> <RefBookTitle>The Motivation to Work</RefBookTitle> <RefPage></RefPage> <RefTotal>Herzberg F, Mausner B, Snyderman BB. The Motivation to Work. New York: John Wiley &#38; Sons; 1959.</RefTotal> </Reference> <Reference refNo="11"> <RefAuthor>Nichols M</RefAuthor> <RefTitle>Motivation and hygiene as a framework for eLearning practice</RefTitle> <RefYear>2004</RefYear> <RefJournal>Educat Technol Soc</RefJournal> <RefPage>1-4</RefPage> <RefTotal>Nichols M. Motivation and hygiene as a framework for eLearning practice. Educat Technol Soc. 2004;7:1-4.</RefTotal> </Reference> <Reference refNo="12"> <RefAuthor>Macfarlane SB</RefAuthor> <RefAuthor>Cuevas LE</RefAuthor> <RefAuthor>Moody JB</RefAuthor> <RefAuthor>Russell WB</RefAuthor> <RefAuthor>Schlecht BJ</RefAuthor> <RefTitle>Epidemiology training for primary health care: The use of computer-assisted distance learning</RefTitle> <RefYear>1996</RefYear> <RefJournal>J Roy Soc Health</RefJournal> <RefPage>317-21</RefPage> <RefTotal>Macfarlane SB, Cuevas LE, Moody JB, Russell WB, Schlecht BJ. Epidemiology training for primary health care: The use of computer-assisted distance learning. J Roy Soc Health. 1996;116:317-21.</RefTotal> </Reference> <Reference refNo="13"> <RefAuthor>Kavaliauskiene G</RefAuthor> <RefAuthor>Anusiene L</RefAuthor> <RefAuthor>Kaunas Univ Technology P</RefAuthor> <RefTitle>Electronic language portfolio for lifelong learning</RefTitle> <RefYear>2008</RefYear> <RefBookTitle>3rd International Conference on Nation and Language &#8211; Modern Aspects of Socio-Linguistic Development</RefBookTitle> <RefPage>54-7</RefPage> <RefTotal>Kavaliauskiene G, Anusiene L, Kaunas Univ Technology P. Electronic language portfolio for lifelong learning. In: 3rd International Conference on Nation and Language &#8211; Modern Aspects of Socio-Linguistic Development; Kaunas, Lithuania; 2008. p. 54-7.</RefTotal> </Reference> <Reference refNo="14"> <RefAuthor>Bruce JC</RefAuthor> <RefAuthor>Bond ST</RefAuthor> <RefAuthor>Jones ME</RefAuthor> <RefTitle>Teaching epidemiology and statistics by distance learning</RefTitle> <RefYear>2002</RefYear> <RefJournal>Stat Med</RefJournal> <RefPage>1009-20</RefPage> <RefTotal>Bruce JC, Bond ST, Jones ME. Teaching epidemiology and statistics by distance learning. Stat Med. 2002;21(7):1009-20. DOI: 10.1002&#47;sim.1133</RefTotal> <RefLink>http:&#47;&#47;dx.doi.org&#47;10.1002&#47;sim.1133</RefLink> </Reference> <Reference refNo="15"> <RefAuthor>Priselac NJ</RefAuthor> <RefTitle>Distance learning and introductory statistics</RefTitle> <RefYear>1995</RefYear> <RefBookTitle>1995 Proceedings of the Section on Statistical Education</RefBookTitle> <RefPage>262-7</RefPage> <RefTotal>Priselac NJ. Distance learning and introductory statistics. In: American Statistical Association. 1995 Proceedings of the Section on Statistical Education. ASA; 1995. p. 262-7.</RefTotal> </Reference> <Reference refNo="16"> <RefAuthor>Suanpang P</RefAuthor> <RefAuthor>Santijanyaporn J</RefAuthor> <RefTitle>E-learning in Thailand: An analysis and case study</RefTitle> <RefYear>2005</RefYear> <RefBookTitle>3rd International Conference on Education and Information Systems</RefBookTitle> <RefPage>413-22</RefPage> <RefTotal>Suanpang P, Santijanyaporn J. E-learning in Thailand: An analysis and case study. In: Malpica F, Welsch F, Tremante A, editors. 3rd International Conference on Education and Information Systems. Orlando, FL; 2005. p. 413-22.</RefTotal> </Reference> <Reference refNo="17"> <RefAuthor>Suanpang P</RefAuthor> <RefAuthor>Petocz P</RefAuthor> <RefAuthor>Kalceff W</RefAuthor> <RefTitle>Student attitudes to learning business statistics: Comparison of online and traditional methods</RefTitle> <RefYear>2004</RefYear> <RefJournal>Educ Technol Soc</RefJournal> <RefPage>9-20</RefPage> <RefTotal>Suanpang P, Petocz P, Kalceff W. Student attitudes to learning business statistics: Comparison of online and traditional methods. Educ Technol Soc. 2004;7:9-20.</RefTotal> </Reference> <Reference refNo="18"> <RefAuthor>Nte S</RefAuthor> <RefAuthor>Stephens R</RefAuthor> <RefTitle>Videogame aesthetics and e-learning: A retro-looking computer game to explain the normal distribution in statistics teaching</RefTitle> <RefYear>2008</RefYear> <RefBookTitle>2nd European Conference on Games-Bases Learning</RefBookTitle> <RefPage>341-8</RefPage> <RefTotal>Nte S, Stephens R. Videogame aesthetics and e-learning: A retro-looking computer game to explain the normal distribution in statistics teaching. In: Connolly T, Stansfield M, editors. 2nd European Conference on Games-Bases Learning. Barcelona, Spain; 2008. p. 341-8.</RefTotal> </Reference> <Reference refNo="19"> <RefAuthor>Gomes RGS</RefAuthor> <RefAuthor>de Moraes RM</RefAuthor> <RefAuthor>Machado LDS</RefAuthor> <RefTitle>An architecture for distance learning to support statistics teaching</RefTitle> <RefYear>2005</RefYear> <RefBookTitle>Proceedings of the Eighth IASTED International Conference on Computers and Advanced Technology in Education</RefBookTitle> <RefPage>260-5</RefPage> <RefTotal>Gomes RGS, de Moraes RM, Machado LDS. An architecture for distance learning to support statistics teaching. In: Uskov V. Proceedings of the Eighth IASTED International Conference on Computers and Advanced Technology in Education. Oranjestad, Aruba; 2005. p. 260-5.</RefTotal> </Reference> <Reference refNo="20"> <RefAuthor>Giani U</RefAuthor> <RefAuthor>Romano A</RefAuthor> <RefAuthor>Bruzzese D</RefAuthor> <RefTitle>An epidemiological model of knowledge diffusion in virtual learning networks: An application to learning statistics in medicine</RefTitle> <RefYear>2005</RefYear> <RefJournal>Cybernet Syst</RefJournal> <RefPage>445-56</RefPage> <RefTotal>Giani U, Romano A, Bruzzese D. An epidemiological model of knowledge diffusion in virtual learning networks: An application to learning statistics in medicine. Cybernet Syst. 2005;36(5):445-56. DOI: 10.1080&#47;01969720490929373</RefTotal> <RefLink>http:&#47;&#47;dx.doi.org&#47;10.1080&#47;01969720490929373</RefLink> </Reference> <Reference refNo="21"> <RefAuthor>Viehmann A</RefAuthor> <RefAuthor>Hoffmann B</RefAuthor> <RefAuthor>Jockel KH</RefAuthor> <RefTitle>E-Learning Angebot in der biometrischen, epidemiologischen und informatischen Ausbildung am Universit&#228;tsklinikum Essen &#91;E-learning offers for biometric, epidemiologic and informatics in university hospital in Essen&#93;</RefTitle> <RefYear>2008</RefYear> <RefJournal>Gesundheitswesen</RefJournal> <RefPage>455-6</RefPage> <RefTotal>Viehmann A, Hoffmann B, Jockel KH. E-Learning Angebot in der biometrischen, epidemiologischen und informatischen Ausbildung am Universit&#228;tsklinikum Essen &#91;E-learning offers for biometric, epidemiologic and informatics in university hospital in Essen&#93;. Gesundheitswesen. 2008;70:455-6. DOI: 10.1055&#47;s-0028-1086283</RefTotal> <RefLink>http:&#47;&#47;dx.doi.org&#47;10.1055&#47;s-0028-1086283</RefLink> </Reference> <Reference refNo="22"> <RefAuthor>Lee T</RefAuthor> <RefAuthor>Lee J</RefAuthor> <RefTitle>Quality assurance of web based e-Learning for statistical education</RefTitle> <RefYear>2006</RefYear> <RefBookTitle>17th Symposium on Computational Statistics (COMSTAT 2006)</RefBookTitle> <RefPage>429-38</RefPage> <RefTotal>Lee T, Lee J. Quality assurance of web based e-Learning for statistical education. In: Rizzi A, Vichi M, editors. 17th Symposium on Computational Statistics (COMSTAT 2006). Rome, Italy; 2006. p. 429-38.</RefTotal> </Reference> <Reference refNo="23"> <RefAuthor>Larreamendy-Joerns J</RefAuthor> <RefAuthor>Leinhardt G</RefAuthor> <RefAuthor>Corredor J</RefAuthor> <RefTitle>Six online statistics courses: Examination and review</RefTitle> <RefYear>2005</RefYear> <RefJournal>Am Stat</RefJournal> <RefPage>240-51</RefPage> <RefTotal>Larreamendy-Joerns J, Leinhardt G, Corredor J. Six online statistics courses: Examination and review. Am Stat. 2005;59(3):240-51. DOI: 10.1198&#47;000313005x54162</RefTotal> <RefLink>http:&#47;&#47;dx.doi.org&#47;10.1198&#47;000313005x54162</RefLink> </Reference> <Reference refNo="24"> <RefAuthor>Krause UM</RefAuthor> <RefAuthor>Stark R</RefAuthor> <RefAuthor>Mandl H</RefAuthor> <RefTitle>The effects of cooperative learning and feedback on e-learning in statistics</RefTitle> <RefYear>2009</RefYear> <RefJournal>Learn Instruct</RefJournal> <RefPage>158-70</RefPage> <RefTotal>Krause UM, Stark R, Mandl H. The effects of cooperative learning and feedback on e-learning in statistics. Learn Instruct. 2009;19(2):158-70. DOI: 10.1016&#47;j.learninstruc.2008.03.003</RefTotal> <RefLink>http:&#47;&#47;dx.doi.org&#47;10.1016&#47;j.learninstruc.2008.03.003</RefLink> </Reference> <Reference refNo="25"> <RefAuthor>H&#228;rdle W</RefAuthor> <RefAuthor>Klinke S</RefAuthor> <RefAuthor>Ziegenhagen U</RefAuthor> <RefTitle>On the utility of E-learning in statistics</RefTitle> <RefYear>2007</RefYear> <RefJournal>Int Stat Rev</RefJournal> <RefPage>355-64</RefPage> <RefTotal>H&#228;rdle W, Klinke S, Ziegenhagen U. On the utility of E-learning in statistics. Int Stat Rev. 2007;75:355-64.</RefTotal> </Reference> <Reference refNo="26"> <RefAuthor>H&#228;rdle W</RefAuthor> <RefAuthor>Klinke S</RefAuthor> <RefAuthor>Ziegenhagen U</RefAuthor> <RefTitle>e-Learning statistics &#8211; a selective review</RefTitle> <RefYear>2006</RefYear> <RefBookTitle>17th Symposium on Computational Statistics (COMSTAT 2006)</RefBookTitle> <RefPage>417-28</RefPage> <RefTotal>H&#228;rdle W, Klinke S, Ziegenhagen U. e-Learning statistics &#8211; a selective review. In: Rizzi A, Vichi M, editors. 17th Symposium on Computational Statistics (COMSTAT 2006). Rome, Italy; 2006. p. 417-28.</RefTotal> </Reference> <Reference refNo="27"> <RefAuthor>Klinke S</RefAuthor> <RefTitle>Q&#38;A &#8211; Variable multiple choice exercises with commented answers</RefTitle> <RefYear>2004</RefYear> <RefBookTitle>COMPSTAT: Proceedings in Computational Statistics &#8211; 16th Symposium held in Prague</RefBookTitle> <RefPage>1299-304</RefPage> <RefTotal>Klinke S. Q&#38;A &#8211; Variable multiple choice exercises with commented answers. In: Antoch J, editor. COMPSTAT: Proceedings in Computational Statistics &#8211; 16th Symposium held in Prague. Heidelberg: Physica; 2004. p. 1299-304.</RefTotal> </Reference> <Reference refNo="28"> <RefAuthor>Rose MA</RefAuthor> <RefAuthor>Frisby AJ</RefAuthor> <RefAuthor>Hamlin MD</RefAuthor> <RefAuthor>Jones SS</RefAuthor> <RefTitle>Evaluation of the effectiveness of a Web-based graduate epidemiology course</RefTitle> <RefYear>2000</RefYear> <RefJournal>Comput Nurs</RefJournal> <RefPage>162-7</RefPage> <RefTotal>Rose MA, Frisby AJ, Hamlin MD, Jones SS. Evaluation of the effectiveness of a Web-based graduate epidemiology course. Comput Nurs. 2000;18:162-7.</RefTotal> </Reference> <Reference refNo="29"> <RefAuthor>Lane DM</RefAuthor> <RefTitle></RefTitle> <RefYear>1999</RefYear> <RefBookTitle>Hyperstat</RefBookTitle> <RefPage></RefPage> <RefTotal>Lane DM. Hyperstat. 2nd ed. Mason: Atomic Dog; 1999.</RefTotal> </Reference> <Reference refNo="30"> <RefAuthor>Kladobra A</RefAuthor> <RefTitle>E-learning in der Statistik &#8211; Ein Vergleich verschiedener Lernsoftwareangebote</RefTitle> <RefYear>2006</RefYear> <RefJournal>Allg Stat Arch</RefJournal> <RefPage>323-40</RefPage> <RefTotal>Kladobra A. E-learning in der Statistik &#8211; Ein Vergleich verschiedener Lernsoftwareangebote. Allg Stat Arch. 2006;90(2):323-40. DOI: 10.1007&#47;s10182-006-0236-y</RefTotal> <RefLink>http:&#47;&#47;dx.doi.org&#47;10.1007&#47;s10182-006-0236-y</RefLink> </Reference> <Reference refNo="31"> <RefAuthor>Evans SR</RefAuthor> <RefAuthor>Wang R</RefAuthor> <RefAuthor>Yeh TM</RefAuthor> <RefAuthor>Anderson J</RefAuthor> <RefAuthor>Haija R</RefAuthor> <RefAuthor>McBratney-Owen PM</RefAuthor> <RefAuthor>Peeples L</RefAuthor> <RefAuthor>Sinha S</RefAuthor> <RefAuthor>Xanthakis V</RefAuthor> <RefAuthor>Rajicic N</RefAuthor> <RefAuthor>Zhang J</RefAuthor> <RefTitle>Evaluation of distance learning in an &#34;Introduction to Biostatistics&#34; class: A case study</RefTitle> <RefYear>2007</RefYear> <RefJournal>Stat Educ Res J</RefJournal> <RefPage>59-77</RefPage> <RefTotal>Evans SR, Wang R, Yeh TM, Anderson J, Haija R, McBratney-Owen PM, Peeples L, Sinha S, Xanthakis V, Rajicic N, Zhang J. Evaluation of distance learning in an &#34;Introduction to Biostatistics&#34; class: A case study. Stat Educ Res J. 2007;6:59-77.</RefTotal> </Reference> <Reference refNo="32"> <RefAuthor>Muche R</RefAuthor> <RefTitle>Auswahl und Einsatz eines Standard-E-Learning-Systems im Lehrprojekt Biometrie an der Uni Ulm &#91;Selection and application of a standard E-learning system in a teaching project for biometry at the University of Ulm &#93;</RefTitle> <RefYear>2006</RefYear> <RefJournal>GMS Med Inform Biom Epidemiol</RefJournal> <RefArticleNo>Doc21</RefArticleNo> <RefTotal>Muche R. Auswahl und Einsatz eines Standard-E-Learning-Systems im Lehrprojekt Biometrie an der Uni Ulm &#91;Selection and application of a standard E-learning system in a teaching project for biometry at the University of Ulm &#93;. GMS Med Inform Biom Epidemiol. 2006;2(3):Doc21. Available from: http:&#47;&#47;www.egms.de&#47;static&#47;en&#47;journals&#47;mibe&#47;2006-2&#47;mibe000040.shtml</RefTotal> <RefLink>http:&#47;&#47;www.egms.de&#47;static&#47;en&#47;journals&#47;mibe&#47;2006-2&#47;mibe000040.shtml</RefLink> </Reference> <Reference refNo="33"> <RefAuthor>Velleman PF</RefAuthor> <RefTitle></RefTitle> <RefYear>2008</RefYear> <RefBookTitle>ActivStats Software (CD-ROM)</RefBookTitle> <RefPage></RefPage> <RefTotal>Velleman PF. ActivStats Software (CD-ROM). 7th ed. New York: Addison-Wesley; 2008.</RefTotal> </Reference> <Reference refNo="34"> <RefAuthor>Moebus C</RefAuthor> <RefAuthor>Albers B</RefAuthor> <RefAuthor>Hartmann S</RefAuthor> <RefAuthor>Thole HJ</RefAuthor> <RefAuthor>Zurborg J</RefAuthor> <RefTitle>Towards a specification of distributed and intelligent web based training systems</RefTitle> <RefYear>2002</RefYear> <RefBookTitle>6th International Conference on Intelligent Tutoring Systems</RefBookTitle> <RefPage>291-300</RefPage> <RefTotal>Moebus C, Albers B, Hartmann S, Thole HJ, Zurborg J. Towards a specification of distributed and intelligent web based training systems. In: Cerri SA, Gouarderes G, Paraguacu F, editors. 6th International Conference on Intelligent Tutoring Systems. San Sebastian, Spain; 2002. p. 291-300.</RefTotal> </Reference> <Reference refNo="35"> <RefAuthor>K&#246;pcke W</RefAuthor> <RefAuthor>Heinecke A</RefAuthor> <RefTitle>JUMBO &#8211; Java unterst&#252;tzte M&#252;nsteraner Biometrie Oberfl&#228;che</RefTitle> <RefYear>2001</RefYear> <RefBookTitle>JCHL-Computer gesch&#252;tzte Hochschullehre M&#252;nster</RefBookTitle> <RefPage>157-64</RefPage> <RefTotal>K&#246;pcke W, Heinecke A. JUMBO &#8211; Java unterst&#252;tzte M&#252;nsteraner Biometrie Oberfl&#228;che. In: Grob H, editor. JCHL-Computer gesch&#252;tzte Hochschullehre M&#252;nster. M&#252;nster: LITVerlag; 2001. p. 157-64.</RefTotal> </Reference> <Reference refNo="36"> <RefAuthor>R&#246;nz B</RefAuthor> <RefAuthor>M&#252;ller M</RefAuthor> <RefAuthor>Ziegenhagen U</RefAuthor> <RefTitle>The multimedia project MM&#42;STAT for teaching statistics</RefTitle> <RefYear>2000</RefYear> <RefBookTitle>COMPSTAT 2000 &#8211; Proceedings in Computational Statistics</RefBookTitle> <RefPage>409-15</RefPage> <RefTotal>R&#246;nz B, M&#252;ller M, Ziegenhagen U. The multimedia project MM&#42;STAT for teaching statistics. In: Bethlehem JG, van der Heijden PG, editors. COMPSTAT 2000 &#8211; Proceedings in Computational Statistics. Heidelberg: Physica; 2000. p. 409-15.</RefTotal> </Reference> <Reference refNo="37"> <RefAuthor>H&#228;rdle W</RefAuthor> <RefAuthor>R&#246;nz B</RefAuthor> <RefTitle></RefTitle> <RefYear>2003</RefYear> <RefBookTitle>Statistik, CD-ROM Wissenschaftliche Datenanalyse leicht gemach;</RefBookTitle> <RefPage></RefPage> <RefTotal>H&#228;rdle W, R&#246;nz B. Statistik, CD-ROM Wissenschaftliche Datenanalyse leicht gemach;. Deutsch-Englisch-Spanisch-Franz&#246;sisch; F&#252;r Windows 98&#47;Me&#47;2000&#47;NT&#47;XP. Berlin: MHSG; 2003.</RefTotal> </Reference> <Reference refNo="38"> <RefAuthor>Mittag HJ</RefAuthor> <RefAuthor>Stemann D</RefAuthor> <RefTitle></RefTitle> <RefYear>2004</RefYear> <RefBookTitle>Statistik: Interaktive Multimedia-Software; CD-ROM; Beschreibende Statistik und explorative Datenanalyse</RefBookTitle> <RefPage></RefPage> <RefTotal>Mittag HJ, Stemann D. Statistik: Interaktive Multimedia-Software; CD-ROM; Beschreibende Statistik und explorative Datenanalyse. 5th ed. Leipzig: Fachbuchverlag; 2004.</RefTotal> </Reference> <Reference refNo="39"> <RefAuthor>Schlittgen R</RefAuthor> <RefTitle></RefTitle> <RefYear>2004</RefYear> <RefBookTitle>Das Statistiklabor: Einf&#252;hrung und Benutzerhandbuch</RefBookTitle> <RefPage></RefPage> <RefTotal>Schlittgen R. Das Statistiklabor: Einf&#252;hrung und Benutzerhandbuch. Heidelberg: Springer; 2004.</RefTotal> </Reference> <Reference refNo="40"> <RefAuthor>Bourier G</RefAuthor> <RefTitle></RefTitle> <RefYear>2002</RefYear> <RefBookTitle>PC-Statistiktrainer: Eine interaktive Lernsoftware Software</RefBookTitle> <RefPage></RefPage> <RefTotal>Bourier G. PC-Statistiktrainer: Eine interaktive Lernsoftware Software. Herne: Verlag neue Wirtschafts-Briefe; 2002.</RefTotal> </Reference> <Reference refNo="41"> <RefAuthor>Worley WL</RefAuthor> <RefAuthor>Tesdell LS</RefAuthor> <RefTitle>Instructor time and effort in online and face-to-face teaching: Lessons learned</RefTitle> <RefYear>2009</RefYear> <RefJournal>IEEE Trans Prof Comm</RefJournal> <RefPage>138-51</RefPage> <RefTotal>Worley WL, Tesdell LS. Instructor time and effort in online and face-to-face teaching: Lessons learned. IEEE Trans Prof Comm. 2009;52(2):138-51. DOI: 10.1109&#47;tpc.2009.2017990</RefTotal> <RefLink>http:&#47;&#47;dx.doi.org&#47;10.1109&#47;tpc.2009.2017990</RefLink> </Reference> <Reference refNo="42"> <RefAuthor>Jaques PA</RefAuthor> <RefAuthor>de Oliveira FM</RefAuthor> <RefTitle>Software agents for analysis of collaboration in a virtual classroom</RefTitle> <RefYear>1999</RefYear> <RefJournal>Artif Intell Educat</RefJournal> <RefPage>603-5</RefPage> <RefTotal>Jaques PA, de Oliveira FM. Software agents for analysis of collaboration in a virtual classroom. Artif Intell Educat. 1999;50:603-5.</RefTotal> </Reference> <Reference refNo="43"> <RefAuthor>Herczeg M</RefAuthor> <RefTitle></RefTitle> <RefYear>1994</RefYear> <RefBookTitle>Software-Ergonomie &#8211; Grundlagen der Mensch-Computer-Kommunikation</RefBookTitle> <RefPage></RefPage> <RefTotal>Herczeg M. Software-Ergonomie &#8211; Grundlagen der Mensch-Computer-Kommunikation. Bonn: Addison-Wesley; 1994.</RefTotal> </Reference> </References> <Media> <Tables> <Table format="png"> <MediaNo>2</MediaNo> <MediaID>2</MediaID> <Caption> <Pgraph> <Mark1>Table 2: Hits identified in the search of Google Scholar on July 13, 2009. Years were restricted to 2000&#8211;2009.</Mark1> </Pgraph> </Caption> </Table> <Table format="png"> <MediaNo>3</MediaNo> <MediaID>3</MediaID> <Caption> <Pgraph> <Mark1>Table 3: Hits identified in the search of the World Wide Web Virtual Library: Statistics on July 11, 2009</Mark1> </Pgraph> </Caption> </Table> <Table format="png"> <MediaNo>4</MediaNo> <MediaID>4</MediaID> <Caption> <Pgraph> <Mark1>Table 4: Courses identified from &#91;23&#93; and their current web addresses (accessed on July 11, 2009)</Mark1> </Pgraph> </Caption> </Table> <Table format="png"> <MediaNo>1</MediaNo> <MediaID>1</MediaID> <Caption> <Pgraph> <Mark1>Table 1: Hits identified in the search of the Web of Science on July 8, 2009</Mark1> </Pgraph> </Caption> </Table> <NoOfTables>4</NoOfTables> </Tables> <Figures> <Figure format="png" height="684" width="730"> <MediaNo>1</MediaNo> <MediaID>1</MediaID> <Caption> <Pgraph> <Mark1>Figure 1: Screenshot of the graphical user interface of HyperStat</Mark1> </Pgraph> </Caption> </Figure> <Figure format="png" height="629" width="730"> <MediaNo>2</MediaNo> <MediaID>2</MediaID> <Caption> <Pgraph> <Mark1>Figure 2: Screenshot of welcome page of EMILeA-stat. The page is appealingly designed and well arranged. The user can choose whether he&#47;she wants to rummage in the different learning modules (Fig. 3) or start an available course. The course on descriptive statistics (measures of location and dispersion) is freely accessible.</Mark1> </Pgraph> </Caption> </Figure> <Figure format="png" height="628" width="731"> <MediaNo>3</MediaNo> <MediaID>3</MediaID> <Caption> <Pgraph> <Mark1>Figure 3: Screenshot of the learning environment of EMILeA-stat. The navigation tree is on the left-hand side, and the user can browse through the different modules. In this example, the module association has been started, and the chosen topic is measures of association, odds ratio. The learning content is shown on the right. The content is mostly restricted to pure text, formulae and tables.</Mark1> </Pgraph> </Caption> </Figure> <Figure format="png" height="626" width="852"> <MediaNo>4</MediaNo> <MediaID>4</MediaID> <Caption> <Pgraph> <Mark1>Figure 4: Screenshot of the graphical user interface of JUMBO which has been designed using frames. At the lower bottom of the screen, the glossary is shown permanently. The flashy colors of the navigation bar remind of web pages from the early times of the internet and do not conform with modern ergonomy standards &#91;43&#93;.</Mark1> </Pgraph> </Caption> </Figure> <Figure format="png" height="622" width="848"> <MediaNo>5</MediaNo> <MediaID>5</MediaID> <Caption> <Pgraph> <Mark1>Figure 5: Screenshot of a content page of JUMBO. Flashing buttons and cliparts in gif file format appear distracting for many users and deflect from the content.</Mark1> </Pgraph> </Caption> </Figure> <Figure format="png" height="682" width="730"> <MediaNo>6</MediaNo> <MediaID>6</MediaID> <Caption> <Pgraph> <Mark1>Figure 6: Screenshot of the graphical user interface of LernSTATS</Mark1> </Pgraph> </Caption> </Figure> <Figure format="png" height="662" width="851"> <MediaNo>7</MediaNo> <MediaID>7</MediaID> <Caption> <Pgraph> <Mark1>Figure 7: Screenshot of the graphical user interface of Methodenlehre-Baukasten</Mark1> </Pgraph> </Caption> </Figure> <Figure format="png" height="689" width="731"> <MediaNo>8</MediaNo> <MediaID>8</MediaID> <Caption> <Pgraph> <Mark1>Figure 8: Screenshot of welcome page of MM&#42;STAT. The content is well structured. Chapters are subdivided in sections, and they are shown after a mouse click on the chapter level.</Mark1> </Pgraph> </Caption> </Figure> <Figure format="png" height="607" width="677"> <MediaNo>9</MediaNo> <MediaID>9</MediaID> <Caption> <Pgraph> <Mark1>Figure 9: Screenshot of the graphical user interface of MM&#42;STAT. All sections are opened in a new Tab (in this example, Sections 2.7 and 2.5). Open Tabs can be closed by a double click. The active Tab 2.5 only shows a part of the content of the current page. The remaining content can only be seen in a maximized browser window because horizontal and vertical scroll bars are not shown.</Mark1> </Pgraph> </Caption> </Figure> <Figure format="png" height="470" width="856"> <MediaNo>10</MediaNo> <MediaID>10</MediaID> <Caption> <Pgraph> <Mark1>Figure 10: Screenshot of the graphical user interface of Neue Statistik and Neue Statistik II. The graphical user interface is nicely designed. The navigation is intuitive and consistent. Unfortunately, pages are so long that the user has to scroll down regularly. Umlaute and special characters are incorrectly displayed with both the Firefox Browser and the Internet Explorer.</Mark1> </Pgraph> </Caption> </Figure> <Figure format="png" height="602" width="848"> <MediaNo>11</MediaNo> <MediaID>11</MediaID> <Caption> <Pgraph> <Mark1>Figure 11: Screenshot of the graphical user interface of NUMAS</Mark1> </Pgraph> </Caption> </Figure> <Figure format="png" height="623" width="847"> <MediaNo>12</MediaNo> <MediaID>12</MediaID> <Caption> <Pgraph> <Mark1>Figure 12: Screenshot of the graphical user interface of ROBISYS Biomedos</Mark1> </Pgraph> </Caption> </Figure> <Figure format="png" height="531" width="850"> <MediaNo>13</MediaNo> <MediaID>13</MediaID> <Caption> <Pgraph> <Mark1>Figure 13: Screenshot of the graphical user interface of ROBISYS Random. Only the green colored topics are directly available via mouse click.</Mark1> </Pgraph> </Caption> </Figure> <Figure format="png" height="659" width="852"> <MediaNo>14</MediaNo> <MediaID>14</MediaID> <Caption> <Pgraph> <Mark1>Figure 14: Screenshot of the graphical user interface of &#8220;Statistik: Beschreibende Statistik und explorative Datenanalyse&#8221;. Only a quarter of the user interface is used with the common screen resolution of 1280 &#215; 1024 dpi.</Mark1> </Pgraph> </Caption> </Figure> <Figure format="png" height="664" width="841"> <MediaNo>15</MediaNo> <MediaID>15</MediaID> <Caption> <Pgraph> <Mark1>Figure 15: Screenshot of the graphical user interface of SurfStat</Mark1> </Pgraph> </Caption> </Figure> <Figure format="png" height="549" width="731"> <MediaNo>16</MediaNo> <MediaID>16</MediaID> <Caption> <Pgraph> <Mark1>Figure 16: Screenshot of the graphical user interface of Visual Bayes. The graphical user interface of Visual Bayes has a fixed screen resolution of 640 &#215; 480 dpi, thus uses only a quarter of current common screens. The design appears to be out of date with its historic MS-DOS visual appearance.</Mark1> </Pgraph> </Caption> </Figure> <NoOfPictures>16</NoOfPictures> </Figures> <InlineFigures> <NoOfPictures>0</NoOfPictures> </InlineFigures> <Attachments> <NoOfAttachments>0</NoOfAttachments> </Attachments> </Media> </OrigData> </GmsArticle>