Virtual auscultation course via video chat in times of COVID-19 improves cardiac auscultation skills compared to literature self-study in third-year medical students: a prospective randomized controlled cross-over study

Nils Rüllmann ^1,2
Raphael Hirtz ³
Unaa Lee ²
Kathrin Klein ⁴
Ertan Mayatepek ²
Bastian Malzkorn ¹
 Carsten Döing <sup>1,2

1</sup> Heinrich-Heine-University Düsseldorf, Medical Faculty, Office of the dean of studies, Düsseldorf, Germany
² University Children's Hospital Düsseldorf, Department of General Pediatrics, Neonatology and Pediatric Cardiology, Düsseldorf, Germany
³ University of Duisburg-Essen, Department of Pediatrics II, Division of Pediatric Endocrinology and Diabetology, Essen, Germany
⁴ University Hospital Düsseldorf, Division of Cardiology, Pneumology and Angiology, Düsseldorf, Germany

Abstract

Background: Cardiac auscultation is a core clinical skill taught in medical school. Due to contact restrictions during the SARS-CoV-2 pandemic, interaction with patients was very limited. Therefore, a peer-to-peer virtual case-based auscultation course via video conference was established.

Methods: A randomized controlled cross-over study was conducted to evaluate whether participation in a virtual auscultation course could improve heart auscultation skills in 3^rd-year medical students. A total of sixty medical students were randomly assigned to either the experimental or control group after informed consent was obtained. Due to no-shows, 55 students participated. Depending on allocation, students attended three ninety-minute courses in intervals of one week in a different order: a virtual case-based auscultation course held via video chat, literature self-study, and an on-site course using a high-fidelity auscultation simulator (SAM II). The study's primary endpoint was the performance of the two groups at the simulator after participating in the virtual auscultation course or literature self-study. To evaluate their auscultation skills, students participated in five assessments using the same six pathologies: stenosis and regurgitation of the aortic and mitral valve, ventricular septal defect, and patent ductus arteriosus. Moreover, participants rated their satisfaction with each course and provided a self-assessment of competence.

Results: Compared to literature self-study, participation in the virtual auscultation course led to a significantly improved description of heart murmurs at the auscultation simulator with regard to the presence in systole and diastole, low- and high-pitched sounds, and volume dynamics. There was no significant difference between the groups in diagnostic accuracy and identification of the point of maximal intensity. After the virtual course, students showed higher satisfaction rates and a higher increase in self-assessed competence compared to participants who engaged in literature self-study.

Conclusions: For the first time, this study demonstrates that a case-based virtual auscultation course can improve aspects of cardiac auscultation skills on a simulator. This may facilitate the further acquisition of an essential clinical skill, even when contact restrictions will be lifted.

---

---

1. Background

Cardiac auscultation using a stethoscope allows immediate identification of important cardiac pathologies. It is easily accessible and part of most physical examinations enabling skilled examiners to make an accurate diagnosis [1] or to initiate further diagnostics.

Auscultation is an essential examination technique. However, it requires the development of complex auditory skills. In medical education, these skills are taught through lectures, examination courses, and bedside teaching. Bedside teaching allows medical students to learn in a realistic environment, place heard heart sounds in context with other physical findings and recognize typical patterns of sound radiation across the thorax. However, infrequent exposure to rare findings as well as a high ratio of learners to patients pose challenges [2]. Moreover, the variability of clinical presentations prevents standardized teaching [3], and patients (e.g., young children) may not be amenable to or available for examination, most recently due to contact restrictions during the SARS-CoV-2 pandemic.

In the past, many studies have shown poor auscultation skills of medical students [4], residents, as well as practicing physicians [4], [5], [6], [7], [8], illustrating the need for better training methods. Although a core clinical skill, clinical practice does not necessarily improve cardiac auscultation skills [9], [10], [11].

Addressing a generation of digital natives, the use of simulation technology and e-learning for skills training and assessment in medical education has progressively increased over the last two decades: Multiple simulation methods to train cardiac auscultation, summarized in a review of Ward and Wattier [12] and a meta-analysis by McKinney, Cook [13], allow for improving the transfer of cardiac auscultation skills to clinical settings [14]. Virtual teaching programs range from sound simulation [15], [16], [17] to virtual patient examinations [18] and pediatric e-learning courses on cardiology basics [19]. Auscultation training on on-site simulators (e.g., Student Auscultation Manikin=SAM II) and simulated patients in skills labs provide another opportunity to learn and improve auscultation skills of normal and pathological findings [2], [12], [14], [20], [21], [22], [23], [24], [25], [26].

During the ongoing contact restrictions due to the SARS-CoV-2 pandemic, courses at the on-site skills lab with an auscultation manikin were suspended, and interaction with real patients in the context of bedside teaching was compromised [27]. Similar obstacles were described during the outbreak of SARS-CoV-1 [28]. The urgent need for alternative training methods turned out to be an opportunity to further catalyze the modernization of medical education [29] at our faculty during the summer term of 2020: A virtual auscultation course (VAC) via video conference was designed by a student with extensive experience in peer-teaching and supervised by specialist cardiologists [27].

According to results from previous studies [14], [20], [21], [22], [23], the following hypotheses (H) were derived regarding the effect of a VAC on the auscultation skills of medical students: Participation in the VAC allows for better description (H₁), higher diagnostic accuracy (H₂), and more reliable identification of the point of maximal intensity (H₃) of heart murmurs when compared to literature self-study, immediately after the course (H_1A, H_2A) and at follow-up at the simulator (H_1B, H_2B, H₃). The participant’s performance at the simulator was the study’s primary endpoint (H_1B, H_2B, H₃).

To allow participants to benefit from all teaching methods, a cross-over design was chosen. It was hypothesized, that this approach results in comparable cardiac auscultation skills in participants by the end of the study, irrespective of the randomization order (H₄) [30], [31].

Following previous evaluation results [27], it was expected that attendance of the virtual auscultation course leads to increased satisfaction (H₅) and a higher increase in self-assessed competence (H₆) when compared to literature self-study.

2. Methods

2.1. Study design

A prospective, randomized, controlled cross-over study was carried out at the Medical Faculty of the Heinrich-Heine-University of Duesseldorf, Germany. The study was designed to compare cardiac auscultation skills after participating in a one-time ninety-minute, virtual case-based auscultation course with participation in time-equivalent literature self-study.

As shown in figure 1 [Fig. 1], three course formats were offered during this study in a different order: a virtual auscultation course (VAC), literature self-study (SST) during a video conference, both held via Microsoft Teams (MS Teams; [https://www.microsoft.com/de-de]), and an on-site course using a student auscultation manikin (SAM). Courses took place one week apart in groups of 5 (SAM) to 10 participants (VAC & SST).

Auscultation performance was assessed on five occasions (T1-T5) using the same six pathologies found in adult and pediatric patients: stenosis and regurgitation of the aortic and mitral valve, ventricular septal defect, and patent ductus arteriosus. The primary endpoint of the study was the performance at an auscultation simulator seven days after participating in one of two different interventions. Group A (exposed) participated in a virtual auscultation course (VAC), Group B (Control group) in literature self-study. Assessments T1, T2, T4, T5 were conducted before and after the VAC and SST to monitor any direct effect on the auscultation performance.

Participant's satisfaction and self-rated competence were assessed using evaluation forms completed after every course (EV1-EV3).

Approval for the study was obtained from the Ethics Committee of the Medical Faculty, Heinrich Heine University, Germany, (Nr. 2021-1298). The study was conducted in accordance with the Declaration of Helsinki.

2.2. Randomization

Sixty third-year medical students were recruited on a voluntary basis and provided informed consent to participate. Successful attendance was rewarded with 10€. The randomization process is shown in figure 2 [Fig. 2]. During the first two years of the curriculum, students at the Medical Faculty of the Heinrich Heine University participate in a preparatory course for internships, learning cardiac auscultation of the healthy heart. Pathological findings are covered during cardiology lectures in the fourth year of their studies.

2.3. Interventions

Students participated in three courses (VAC, SST, SAM) of equal length (90 min) in two different orders, depending on randomization. To avoid bias, all courses were held by the same tutor.

2.3.1. Virtual auscultation course (VAC)

The interactive online seminar was designed to improve listening technique, description, and interpretation of auscultation findings in an off-site context [27]. This case-based course was held by an experienced medical student as peer-teaching has proven its benefit for both teachers and learners [30], [32]. Clinical cases with synthesized auscultation sounds were presented adapted to the model of case-based learning [33], [34]. Adult and pediatric cases were discussed.

With kind permission, synthesized heart sounds, provided by the online learning program Clinisurf [https://clinisurf.elearning.aum.iml.unibe.ch/] developed at the University of Bern, Switzerland, were used.

2.3.2. Literature self-study (SST)

The control intervention consisted of studying excerpts from two German textbooks teaching cardiac auscultation: “Füeßl: Anamnesis and Clinical Examination” ([35], p.184, 196, 197-207) as the reference of the medical faculty’s internship preparatory course and “Erdmann: Clinical Cardiology” ([36], p.375-377, 381-383, 397-415) as a reference textbook for cardiology lectures. These excerpts were made available as eBook chapters at the beginning of a supervised, 90 minutes video conference. The description of heart murmurs, including phonocardiograpic visualizations, and the presented clinical knowledge corresponded to that of the VAC.

So far, there is no evidence on the efficacy of literature study on cardiac auscultation. It was chosen as control intervention because it represents a standard method for medical students to prepare for the clinical environment. Self-study is thus a relevant comparator even if teaching auscultation via literature alone is uncommon and the effectiveness of self-study has not been evaluated previously.

2.3.3. Auscultation simulator (SAM)

In the skills lab, participants auscultated the simulator Cardionics Student Auscultation Manikin II (SAM, Cardionics, Webster, Texas, USA) which presented the same six heart murmurs. Auscultation performance was assessed (T3). After the assessment, different heart murmurs were presented, and associated cardiac pathologies and their clinical background were discussed with the tutor.

2.4. Assessment

The order of the cardiac pathologies was randomized using the Research Randomizer [https://www.randomizer.org/]. To avoid confounding, the order of pathologies was identical following the study's cross-over design: Before VAC, SST and SAM and after VAC and SST, the same order was used for both groups.

Directly before and after VAC and SST (T1, T2, T4, T5), students listened to auscultation sounds using their own headphones, lasting 15 minutes. They were asked to describe the sound characteristics (e.g., systolic/diastolic murmur, low-/high-pitched sound, volume dynamics) and make a diagnosis of each auscultation finding. The presented auscultation files were those used in the VAC and were the same for the assessments T1, T2, T4, T5. The participants did not receive feedback.

At the simulator, participants used their own stethoscopes to auscultate the same murmurs studied during the VAC and SST. In addition to a description of sound characteristics and a diagnosis regarding the presented pathologies at T1, T2, T4, T5, participants were also asked to indicate a point of maximal intensity for each heart murmur. The synthesized auscultation sounds were provided by Cardionics, the manufacturer of the auscultation manikin SAM II.

2.5. Data collection & processing

For the performance categories “sound description” (DESC), “diagnosis” (DIAG), and, at the simulator, “point of maximal intensity” (PM), participants provided their answers via questionnaires in an open text format. The assessments were performed with the Medical Faculty's online evaluation form and anonymized by source. For online courses (VAC & SST), the questionnaires (T1, T2, T4, T5) were accessible via internet. Time stamps ensured the participant's compliance with the 90 minutes time frame directly before or after the courses. For the on-site course (SAM, T3), printed questionnaires were completed manually and digitalized later.

Answers on each item were compared to a list of accepted answers and assessed by two raters. In cases of disagreement, the final score was assigned by a third rater, a cardiologist. A correct answer was awarded one point. For the evaluation of results scores were separately summed for each of the assessed performance categories (DIAG, DESC, PM). The maximum score in each category was six points.

Additional evaluation forms (EV1-EV3) using six-point Likert scales (best score=1) were employed after every course to measure satisfaction and self-assessed increase in competence.

2.6. Statistics

Data handling and statistical analyses were performed with SPSS 27 (Armonk, NY: IBM Corp.). H_1-6 were assessed by two-tailed testing and results deemed significant at p<.05. Considering that H₄ coincides with the (statistical) H₀ (i.e., no performance difference at T5 between groups regarding different intervention sequences), H₄ was assessed at an adjusted α-level of p<.20. This approach allows for increasing the chance to reject H₀, as recommended when testing for equivalence [37]. All other analyses were deemed exploratory and therefore, not corrected for multiple comparisons.

Effect size was interpreted according to Cohen [38] (d: small 0.20≤d≤0.49, medium 0.50≤d≤0.79, large≥0.8). Power analyses were performed with GPower 3.1 [39] (assuming: α=.05, two-tailed testing, sufficient power=1-β≥0.8).

Sum scores regarding diagnosis and sound description at T1-T5 as well as identification of the point of maximal intensity at T3 were non-normally distributed and contained outliers as identified by Shapiro-Wilk tests, visual inspection of Q-Q plots, and boxplots. This also applied to the items evaluating course satisfaction and self-assessed competence (H₅, H₆). When also considering the design of the study that did not allow for a repeated measure approach, Mann-Whitney U tests were performed to compare the experimental and control group concerning all outcome measures.

3. Results

3.1. Cardiac auscultation skills

There was a significant difference in description performance (DESC; e.g. systolic/diastolic murmur, low-/high-pitched sound, volume dynamics) between the experimental (N=27) and control group (N=28) immediately after the first course (T2: Median_exp=4, Median_control=1; p<.001, d=2.06), at the simulator (T3: Median_exp=3, Median_control=0; p<.001, d=2.06), and before the third course (T4: Median_exp=4, Median_control=2; p=<.001, d=1.24), which was not present at the first assessment (T1: Median_exp=0, Median_control=0; p=.99; H_1A-B proved), (see figure 3 [Fig. 3] and table 1 [Tab. 1]).

In terms of diagnostic accuracy (DIAG), no significant difference was found between groups at the first assessment (T1: Median_exp=0, Median_control=0.5; p=.93) and at the simulator (T3: Median_exp=1, Median_control=1; p=.60; H_2B disproved). However, immediately after the first course and before the third course, there was a significant difference (T2: Median_exp=4, Median_control=1; p<.001, d=2.05; T4: Median_exp=3, Median_control=1, p=.004, d=0.82; H_2A proved) between interventions.

Participation in the VAC did not allow for better identification of the point of maximal intensity of heart murmurs (PM) at the simulator (T3: Median_exp=3, Median_control=3; p=.54; H₃ disproved).

Note, however, that in all sum score-related analyses, power was only sufficient for detecting a large effect size (power (1-β): d≥0.8=0.81).

3.1.1. Evaluation of the cross-over design (H₄)

At the final assessment (T5), no difference between the experimental (N=26) and control group (N=28) concerning DIAG and DESC was found (DESC: Median_exp=4, Median_control=4; p=.97; DIAG: Median_exp=4, Median_control=3; p=.31; H₄ proved).

3.2. Course satisfaction and self-assessed competence

Participants of the VAC reported a significantly higher satisfaction compared to the literature self-study group (see figure 4 [Fig. 4] and table 2 [Tab. 2]). This was found in group A (EXP) after the first course (EV1: Median_exp=1, Median_control=4; p<.001, d=2.70) and in group B (CTR) after the third course (EV3: Median_exp=4, Median_control=2; p<.001, d=1.92; H₅ proved).

Participation in the VAC resulted in significantly higher increase in self-assessed competence than participation in literature self-study. Group A (EXP) reported a higher increase after the first course (EV1: Median_exp=1, Median_control=4; p<.001, d=2.46), just like group B (CTR) after the third course (EV3: Median_exp=4, Median_control=2; p<.001, d=1.31; H₆ proved).

At the auscultation simulator, both groups showed comparably high levels of satisfaction (EV2: Median_exp=1, Median_control=1) and indicated a high self-assessed increase in competence (EV2: Median_exp=2, Median_control=2).

4. Discussion

The present study demonstrates for the first time that a case-based virtual auscultation course via video conference may significantly improve the description of cardiac auscultation findings on a simulator compared to literature self-study.

4.1. Impact on study participants

Medical students participating in the VAC evidenced a distinct increase in the ability to describe sound characteristics of heart murmurs at the simulator. No significant difference in diagnostic accuracy was found. A similar effect was seen in a study by Giovanni et al. [24] comparing student's auscultation performance on patients six weeks after listening to auscultation files or training at an auscultation simulator. After training with a simulator, students showed better performance in heart sound interpretation without higher diagnostic accuracy.

Establishing an auscultation-based diagnosis is presumably linked to declarative, that is, explicit knowledge (e.g., “Aortic stenosis is a systolic murmur”). In contrast, the description of heart murmurs can be considered an implicit skill depending on procedural knowledge [40]. Unlike declarative knowledge, procedural knowledge is exercised in tasks. The results of the present study suggest that participation in the VAC results in superior retention of procedural than declarative knowledge. Importantly, in many instances, procedural knowledge may constitute the more important type of knowledge. As outlined by Kumar and Thompson [11] physicians do not necessarily require high diagnostic accuracy to identify a variety of different murmurs but should be able to distinguish physiological from pathological findings to initiate further diagnostics and cardiologist referral, if necessary.

In line with these considerations, a reliable acquisition and retention of procedural knowledge over a period of one week, as observed in the present study, has previously been reported by a study by H'Mida, Degrenne [41] comparing video and static images to teach a motor skill.

However, the observation that participation in the VAC resulted in the improved description of heart murmurs but not higher diagnostic accuracy may also be related to effects of guessing. There was a high variability in making the correct diagnosis at the simulator, mainly driven by some participants that made the right diagnosis without a correct description of the causal pathology.

Participation in the VAC did not significantly improve identification of typical patterns of sound radiation across thorax (PM). One possible explanation might be that the VAC did not allow to virtually auscultate all auscultation points on the thorax in each presented case, so participants had no opportunity to elaborate on the patterns of sound radiation individually.

4.2. Implications for cardiac auscultation training

In this study, the VAC and training on a simulator led to high rates of satisfaction and a notable increase in self-assessed competence in third year medical students. This might lead to a greater benefit from further auscultation training (e.g. bedside teaching) during the participant's ongoing medical studies as previously suggested by Bernardi et al. [20], demonstrating the importance of early training of essential examination skills.

Multiple studies have shown positive effects of simulation-based auscultation training, ranging from sound simulation [15], [16], [17] to high-fidelity simulators [20], [21]. Simulators like Harvey or SAM provide standardized training featuring many aspects of real patients, but they come at a high price and rationed practice time [24]. During contact restrictions access is further limited.

Considering these limitations, video conference-based auscultation courses may be a valuable addition to the already existing repertoire of auscultation training methods. Participation in training offered face-to-face or by video conferences can lead to similar levels of knowledge and confidence in healthcare professionals [42]. This is confirmed by the results of the present study regarding cardiac auscultation skills in medical students.

Consequently, further research is needed to examine skill transfer from a virtual auscultation course to patients in a bedside scenario, possibly through the comparison of a virtual course with an auscultation simulator. The integration of bedside recorded heart sounds at multiple positions across the patient's thorax could improve the identification of typical patterns of sound radiation.

Once established, virtual auscultation courses are easily accessible and transferable to other faculties, upscaling the number of courses does not require additional equipment and they are not affected by contact restrictions. The presented course design employed peer teaching and may therefore be more resource-efficient than formats relying on post-graduate teaching staff. Moreover, they allow for training auscultation even in remote areas with limited access to alternative training possibilities.

4.3. Limitations

Due to contact restrictions, the transfer of auscultation skills to patients in clinical practice has not been investigated in this study. However, good performance on an auscultation simulator correlated with good performance in real patients as shown by Fraser et al. [43] with regard to mitral regurgitation. Moreover, after training auscultation with virtual patients, auscultation performance on patients was equal to a control group participating in additional bedside teaching [17].

Long-time retention of auscultation skills was not assessed in this study. However, former studies have shown good long-term retention up to three years after training on an auscultation simulator [20], [21]. The sounds presented during and immediately after the VAC at the assessment T2 were the same. This might explain the superior performance of students participating in the VAC compared to SST simply by recognition of the previously presented heart sounds. In contrast, at T3 even though the same six pathologies were presented, the sound files were not identical with those at T2.

Moreover, even though also the VAC was supervised, the participant’s screens could not be monitored for data protection reasons. Thus, it cannot be ensured that participants worked with the literature provided or followed the virtual course the entire time.

The present study was sufficiently powered for valid conclusions, but more subtle effects of the VAC on auscultation performance with a moderate or small effect size may not have been detected.

5. Conclusion

This study demonstrates for the first time that training medical students with a virtual auscultation course via video conference may significantly improve their heart auscultation skills after one week on a simulator when compared to literature self-study. The digital teaching format was rated as good by the participants and lead to a self-assessed increase in competence and satisfaction. Thus, even after contact restrictions are lifted, an interactive online course may provide additional benefit and support acquiring fundamental skills in heart auscultation.

Note

Bastian Malzkorn and Carsten Döing shared senior authorship.

Competing interests

The authors declare that they have no competing interests.

---

References

[1] Chizner MA. Cardiac auscultation: rediscovering the lost art. Curr Probl Cardiol. 2008;33(7):326-408. DOI: 10.1016/j.cpcardiol.2008.03.003
[2] Ewy GA, Felner JM, Juul D, Mayer JW, Sajid AW, Waugh RA. Test of a cardiology patient simulator with students in fourth-year electives. J Med Educ. 1987;62(9):738-743. DOI: 10.1097/00001888-198709000-00005
[3] Holmboe ES. Faculty and the Observation of Trainees' Clinical Skills: Problems and Opportunities. Acad Med. 2004;79(1):16-22. DOI: 10.1097/00001888-200401000-00006
[4] Vukanovic-Criley JM, Criley S, Warde CM, Boker JR, Guevara-Matheus L, Churchill WH, Nelson WP, Criley JM. Competency in cardiac examination skills in medical students, trainees, physicians, and faculty: a multicenter study. Arch Intern Med. 2006;166(6):610-616. DOI: 10.1001/archinte.166.6.610
[5] Mangione S. Cardiac auscultatory skills of physicians-in-training: a comparison of three English-speaking countries. Am J Med. 2001;110(3):210-216. DOI: 10.1016/S0002-9343(00)00673-2
[6] Mangione S, Nieman LZ. Cardiac auscultatory skills of internal medicine and family practice trainees. A comparison of diagnostic proficiency. JAMA. 1997;278(9):717-722. DOI: 10.1001/jama.1997.03550090041030
[7] Dhuper S, Vashist S, Shah N, Sokal M. Improvement of cardiac auscultation skills in pediatric residents with training. Clin Pediatr (Phila). 2007;46(3):236-240. DOI: 10.1177/0009922806290028
[8] Roy D, Sargeant J, Grey J, Hoyt B, Allen M, Fleming M. Helping family physicians improve their cardiac auscultation skills with an interactive CD-ROM. J Contin Educ Health Prof. 2002;22(3):152-159. DOI: 10.1002/chp.1340220304
[9] Gaskin PR, Owens SE, Talner NS, Sanders SP, Li JS. Clinical auscultation skills in pediatric residents. Pediatrics. 2000;105(6):1184-1187. DOI: 10.1542/peds.105.6.1184
[10] Mahnke CB, Nowalk A, Hofkosh D, Zuberbuhler JR, Law YM. Comparison of two educational interventions on pediatric resident auscultation skills. Pediatrics. 2004;113(5):1331-1335. DOI: 10.1542/peds.113.5.1331
[11] Kumar K, Thompson WR. Evaluation of cardiac auscultation skills in pediatric residents. Clin Pediatr (Phila). 2013;52(1):66-73. DOI: 10.1177/0009922812466584
[12] Ward JJ, Wattier BA. Technology for Enhancing Chest Auscultation in Clinical Simulation. Respiratory Care. 2011;56(6):834-845. DOI: 10.4187/respcare.01072
[13] McKinney J, Cook DA, Wood D, Hatala R. Simulation-based training for cardiac auscultation skills: systematic review and meta-analysis. J Gen Intern Med. 2013;28(2):283-291. DOI: 10.1007/s11606-012-2198-y
[14] Butter J, Cook DA, Wood D, Hatala R. Simulation-based Mastery Learning Improves Cardiac Auscultation Skills in Medical Students. J Gen Intern Med. 2010;25(8):780-785. DOI: 10.1007/s11606-010-1309-x
[15] Tokuda Y, Matayoshi T, Nakama Y, Kurihara M, Suzuki T, Kitahara Y, Kitai Y, Nakamura T, Itokazu D, Miyazato T. Cardiac auscultation skills among junior doctors: effects of sound simulation lesson. Int J Med Educ. 2020;11:107-110. DOI: 10.5116/ijme.5eb6.70c6
[16] Barrett MJ, Kuzma MA, Seto TC, Richards P, Mason D, Barrett DM, Gracely EJ. The power of repetition in mastering cardiac auscultation. Am J Med. 2006;119(1):73-75. DOI: 10.1016/j.amjmed.2004.12.036
[17] Sverdrup Ø, Jensen T, Solheim S, Gjesdal K. Training auscultatory skills: computer simulated heart sounds or additional bedside training? A randomized trial on third-year medical students. BMC Med Educ. 2010;10:3. DOI: 10.1186/1472-6920-10-3
[18] Vukanovic-Criley JM, Boker JR, Creley SR, Rajagopalan S, Criley JM. Using virtual patients to improve cardiac examination competency in medical students. Clin Cardiol. 2008;31(7):334-339. DOI: 10.1002/clc.20213
[19] Oliveira AC, Mattos S, Coimbra M. Development and Assessment of an E-learning Course on Pediatric Cardiology Basics. JMIR Med Educ. 2017;3(1):e10. DOI: 10.2196/mededu.5434
[20] Bernardi S, Giudici F, Leone MF, Zuolo G, Furlotti S, Carretta R, Fabris B. A prospective study on the efficacy of patient simulation in heart and lung auscultation. BMC Med Educ. 2019;19(1):275. DOI: 10.1186/s12909-019-1708-6
[21] Perlini S, Salinaro F, Santalucia P, Musca F. Simulation-guided cardiac auscultation improves medical students' clinical skills: the Pavia pilot experience. Intern Emerg Med. 2014;9(2):165-172. DOI: 10.1007/s11739-012-0811-z
[22] Pereira D, Gomes P, Faria S, Cruz-Correia R, Coimbra M. Teaching cardiopulmonary auscultation in workshops using a virtual patient simulation technology - A pilot study. Annu Int Conf IEEE Eng Med Biol Soc. 2016;2016:3019-3022. DOI: 10.1109/EMBC.2016.7591365
[23] Pereira D, Amelia-Ferreira M, Croz-Correia R, Coimbra M. Teaching Cardiopulmonary Auscultation to Medical Students using a Virtual Patient Simulation Technology. Annu Int Conf IEEE Eng Med Biol Soc. 2020;2020:6032-6035. DOI: 10.1109/EMBC44109.2020.9175920
[24] de Giovanni D, Roberts T, Norman G. Relative effectiveness of high- versus low-fidelity simulation in learning heart sounds. Med Educ. 2009;43(7):661-668. DOI: 10.1111/j.1365-2923.2009.03398.x
[25] Quinn A, Kaminsky J, Adler A, Eisner S, Ovitsh R. Cardiac Auscultation Lab Using a Heart Sounds Auscultation Simulation Manikin. MedEdPORTAL. 2019;15:10839. DOI: 10.15766/mep_2374-8265.10839
[26] Friederichs H, Weissenstein A, Ligges S, Möller D, Becker JC, Marschall B. Combining simulated patients and simulators: pilot study of hybrid simulation in teaching cardiac auscultation. Adv Physiol Educ. 2014;38(4):343-347. DOI: 10.1152/advan.00039.2013
[27] Rüllmann N, Lee U, Klein K, Malzkorn B, Mayatepek E, Schneider M, Döing C. Virtual auscultation course for medical students via video chat in times of COVID-19. GMS J Med Educ. 2020;37(7):Doc102. DOI: 10.3205/zma001395
[28] Lam CS, Cheong PY, Ong BK, Ho KY. Teaching cardiac auscultation without patient contact. Med Educ. 2004;38(11):1184-1185. DOI: 10.1111/j.1365-2929.2004.01989.x
[29] Chen CH, Mullen AJ. COVID-19 Can Catalyze the Modernization of Medical Education. JMIR Med Educ. 2020;6(1):e19725. DOI: 10.2196/19725
[30] Widyahening IS, Findyartini A, Ranakusuma RW, Dewiasty E, Harimurti K. Evaluation of the role of near-peer teaching in critical appraisal skills learning: a randomized crossover trial. Int J Med Educ. 2019;10:9-15. DOI: 10.5116/ijme.5c39.b55b
[31] Kam J, Khadra S, Tran QH, Ainsworth H, Louie-Johnsun M, Winter M. Portable Video Media Versus Standard Verbal Communication in Surgical Teaching: A Prospective, Multicenter, and Randomized Controlled Crossover Trial. J Surg Educ. 2019;76(2):440-445. DOI: 10.1016/j.jsurg.2018.08.013
[32] Benè KL, Bergus G. When learners become teachers: a review of peer teaching in medical student education. Fam Med. 2014;46(10):783-787.
[33] Williams B. Case based learning--a review of the literature: is there scope for this educational paradigm in prehospital education? Emerg Med J. 2005;22(8):577-581. DOI: 10.1136/emj.2004.022707
[34] Turk B, Ertl S, Wong G, Wadowski PP, Löffler-Stastka H. Does case-based blended-learning expedite the transfer of declarative knowledge to procedural knowledge in practice? BMC Med Educ. 2019;19(1):447. DOI: 10.1186/s12909-019-1884-4
[35] Füeßl HS, Middeke M. Duale Reihe Anamnese und Klinische Untersuchung. 4th ed. Stuttgart: Georg Thieme Verlag KG; 2014. DOI: 10.1055/b-0034-100129
[36] Erdmann E. Klinische Kardiologie. 7th ed. Heidelberg: Springer Medizin Verlag; 2009. DOI: 10.1007/978-3-540-79011-2
[37] Bortz J, Christof S. Statistics: For Human and Social Scientists. Berlin, Heidelberg: Springer-Verlag; 2010.
[38] Cohen J. Statistical power analysis. London: Taylor & Francis Ltd; 1988.
[39] Faul F, Erdfelder E, Buchner A, Lang AG. Statistical power analyses using G*Power 3.1: tests for correlation and regression analyses. Behav Res Methods. 2009;41(4):1149-1160. DOI: 10.3758/BRM.41.4.1149
[40] Barrett MJ, Lacey CS, Sekara AE, Linden EA, Gracely EJ. Mastering cardiac murmurs: the power of repetition. Chest. 2004;126(2):470-475. DOI: 10.1378/chest.126.2.470
[41] H'Mida C, Degrenne O, Souissi N, Rekik G, Trabelsi K, Jarraya M, Bragazzi NL, Khacharem A. Learning a Motor Skill from Video and Static Pictures in Physical Education Students-Effects on Technical Performances, Motivation and Cognitive Load. Int J Environ Res Public Health. 2020;17(23):9067. DOI: 10.3390/ijerph17239067
[42] Martin P, Kumar S, Abernathy L, Browne M. Good, bad or indifferent: a longitudinal multi-methods study comparing four modes of training for healthcare professionals in one Australian state. BMJ Open. 2018;8(8):e021264. DOI: 10.1136/bmjopen-2017-021264
[43] Fraser K, Wright B, Girarrd L, Tworek J, Paget M, Welikovich L, McLaughlin K. Simulation training improves diagnostic performance on a real patient with similar clinical findings. Chest. 2011;139(2):376-381. DOI: 10.1378/chest.10-1107