From: 26/04/2017 to: 30/04/2017 3rd ESO-ESMO Latin-American Masterclass in Clinical Oncology, San Jose, Costa Rica                                        From: 7/05/2017 to: 7/05/2017 4th ESO Lung Cancer Observatory, Geneva, Switzerland                                        From: 18/05/2017 to: 19/05/2017 Eurasia Course on Gastrointestinal Malignancies, Moscow, Russian Federation                                        From: 22/05/2017 to: 26/05/2017 3rd ESOP-ESO Advanced Masterclass in Oncology Pharmacy, Lisbon, Portugal                                        From: 26/05/2017 to: 27/05/2017 ESMO Preceptorship on Immuno-Oncology 2017, Amsterdam, The Netherlands                                        From: 10/06/2017 to: 13/06/2017 Leukaemia and Lymphoma, Ascona, Switzerland                                        From: 21/06/2017 to: 23/06/2017 Masterclass in Oncology Basics for Beginners, Cambridge, United Kingdom                                        From: 30/06/2017 to: 05/07/2017 4th ESO-ESMO Eastern Europe and Balkan Region Masterclass in Medical Oncology, Belgrade, Serbia                                        From: 13/07/2017 to: 18/07/2017 ESMO-ESO Course on Medical Oncology for Medical Students, Valencia, Spain                                        From: 15/07/2017 to: 15/07/2017 Breast Cancer in Young Women: Joint DFCI-ESO Symposium, Boston, US                                        From: 28/08/2017 to: 08/09/2017 ESO-ESSO-ESTRO Multidisciplinary Course in Oncology for Medical Students, Antwerp, Belgium                                        From: 06/10/2017 to: 07/10/2017 Eastern Europe and Balkan Region Refresher Course on Breast Cancer, Krakow, Poland                                        From: 18/10/2017 to: 20/10/2017 4th Masterclass in Clinical Oncology, Tbilisi, Georgia                                        From: 18/10/2017 to: 18/10/2017 ESO Breast Cancer Observatory, Tehran, Iran                                        From: 27/10/2017 to: 28/10/2017 9th Clinical Oncology Update - Onkologia 2017, Krakow, Poland                                        From: 02/11/2017 to: 04/11/2017 ESO-ESMO Advanced Breast Cancer Fourth International Consensus Conference (ABC4), Lisbon, Portugal                                        From: 02/12/2017 to: 04/12/2017 ESO-ESMO-RCE Clinical Update on Rare Adult Solid Cancers, Milan, Italy                                        From: 15/12/2017 to: 18/12/2017 1st Mediterranean Masterclass in Clinical Oncology, Limassol, Cyprus

Quality assurance


Programme - requirements and guidelines

The concept and curriculum adhere to the following formal requirements and guidelines:

   
1.  European Credit Transfer and Accumulation System ECTS of the European Commission- User´s Guide 2009
 2. Formal Requirements and Regulations of Ulm University
 3. The Mission of the European School of Oncology, Bellinzona/Milano
 4. European Society for Medical Oncology ESMO Clinical Practice Guidelines
 5. Accreditation Council of Oncology in Europe ACOE, Belgium: Guidelines for CME providers (e-learning materials and live events) on 04/22/2010
 6. Swissuni: Recommendations for quality development in university continuing education programmes, approved by the General Assembly on 10/02/2009
 7. Qualifikationsrahmen für den schweizerischen Hochschulbereich nqf.ch-HS vom gemeinsamen Leitungsausschuss der drei Rektorenkonferenzen vom 23.11.2009
   


Quality of Learning Outcomes

The formative and summative programme evaluation considers different aspects to define if the programme achieved the learning outcomes (Kirkpatrick 1993, 2011):

   
1.  Reaction and satisfaction: to what degree participants react favourably to the Programme
 2. Learning: to what degree participants acquire the intended knowledge, skills, attitudes, confidence and commitment based on their participation
 3. Behaviour: to what degree participants apply what they learned during the Programme in their own professional field
 4. Result: to what degree targeted outcomes occur as a result of the Programme and subsequent reinforcement


The achievement of the different levels includes a comprehensive analysis of the following aspects:

Level 1 and 2:

1. Self-evaluation by the participants (existing and acquired knowledge, skills, competences)
 2. Structured evaluation of the modules and courses (content, lectures, presentation, structure, usability)
 3. Online tests at the end of each e-learning module and a certificate exam at the seminar concluding the Programme


Level 3 and 4:

4.  Online presentation (e.g. case-presentations, videoconferences)
 5. Workshops in the seminars
 6. The Programme Chairmen will regularly review the structure and the programme and continue to develop the curriculum
   


Quality of the Content

To ensure a formative and summative review process of the content quality, a scientific board was established. The board is composed of renowned, internationally recognised oncologists and scientists, approved by the chairmen of the programme. The positions of the chairmen, scientific directors and lecturers are characterised by different duties.

Lecturers will be asked to:

   
-
 Define the goals and learning objectives of their materials, which will be reviewed and approved by the scientific director. 
-
 Refer to evidence-based medicine and the corresponding state-of-the-art guidelines, such as the Clinical Practice Guidelines from the European Society of Medical Oncology ESMO.
-
 Provide evidence-based contents, with notes on the level of evidence (where applicable) and suitable references, to the standard required for a publication in a scientific journal.
-
 Provide contents that are suitable for an international audience. Reference is made to the use of international terminology for procedures and therapeutic agents.
-
 Provide reading materials. Ulm University will assure that the publications are available at the University e-library.
-
 Adhere to ethical, medico-legal and legal requirements.
   


Regular annual reviews

The processes and activities in the Programme will be reviewed by the scientific directors and the chairmen once a year. This includes the timeliness and validity of the lectures and accompanying material.


Quality of Transfer

Upon completion of all Modules and Units, participants will have to complete an online evaluation by answering a structured questionnaire. The results of the questionnaire will be reviewed by the Chairmen.

The following criteria will be reviewed:

•  Course topics (quality, preparation, timeliness, relevance for practical work)
•  Theory-practice transfer
•  Course documentation
•  References
•  Lecturers’ competence
•  Individual needs


Quality of Mentoring

Participants will be supported by a two-level tutoring support:

   
1.
 Scientific-related support will be provided by the lecturer within a discussion forum. On the demand of the participants, lecturers will be asked to participate in a live webcast “meet-the-expert” session.
 2. Technical-related support will be provided by e-mail by the IT-provider Soon-Systems GmbH
   


Quality of Media

Media quality will be assured by an e-Learning Style Guide, providing the standards to be followed when developing computer-based learning contents for the Programme. The guide focuses on the following areas:

   
1.  Global Module Architecture
 2. Instructional Design Standards
 3. Graphical User Interface – Menu and Navigation
 4. Media Standards
 5. Writing Standards
 6. Evaluation Standards
 7. Quality Assurance
   


Learning Platform and SCORM Considerations (Shareable Content Object Reference Model)

The learning system launches learning content, keeps track of the learner’s progress, figures out in what order learning objects are to be delivered, and reports participants mastery through the e-learning units and modules. To standardise the learning contents and the tracking of the progress, the SCORM-standard is used by all methods within the Programme platform. The SCORM-standard consists of three parts: Overview, content aggregation model and run time environment.

Upon completion of each Unit and Module, learners will have to complete an online evaluation according to the learning system by answering a structured questionnaire.

The following criteria will be reviewed:

•  Tutoring and support
•  Interactivity
•  Attractiveness
•  Navigation


Quality of Lecturers

The lecturers are selected by the scientific directors under the supervision of the chairmen. To teach as lecturer in the Programme, oncologists and scientists have to fulfil the criteria of Ulm University, representing the academic demand. According to the demand of Ulm University, the Programme chairmen ascertain the accreditation, authorisation, professorship, scientific and research activities, publications and/or the venia legendi of each lecturer.


Conflict of Interests

All faculty members will be required to disclose financial interests that might influence their presentation or participation.
The list of disclosed conflict of interests, or their absence, will be published in the learning platform.