Back to the future 2: An online OSCE Management Information System for nursing OSCEs

A few words about this paper…

It was not long after we implemented our OSCE Management Information System within the School of Medicine in the National University of Ireland, Galway, that our colleagues from the School of Nursing started to use the system. Moreover, as nurses embed solid practice in their research, the purpose of this practice-based investigation was to initiate a first user acceptance test. We were very pleased with their initiative as all (n=18) nurse examiners appeared to very satisfied with the electronic system and its embedded functionalities. With a University/National cut-score in nursing of (only) 40%, it was surprising to see when the difficulty of the stations using Borderline Regression Analysis was incorporated, the cutscore rose towards 60%. Nurses are very well trained in their skill sets. Although not further researched to date, approximately thirty hours of administration time was saved. In contrast to previous paper-based approaches prior to 2014, results and feedback could be released immediately after the exam was finished, according to Pauline, Eimear and Evelyn. read more

Back to the Future 1: Electronic Marking of Objective Structured Clinical Examinations and Admission Interviews Using an Online Management Information System in Schools of Health Sciences

A few words on this paper…

‘Back to the Future’ refers to the 1985 American science fiction film directed by Robert Zemeckis, featuring Micheal J. Fox as teenager Marty McFly. Marty, a 17-year-old high school student, is accidentally sent thirty years into the past in a time-traveling DeLorean invented by his close friend, the maverick scientist, Doc Brown.

We looked back 44 years, to when Professor R.M. Harden invented the paper-based OSCE in 1974. The future would have to be about the actual results. Facing 30% errors in our paper assessment results, we had a problem to solve. With incomplete forms and failures in adding up the results, we decided to automate the OSCE procedure. Planning, form submission and data analysis is all done electronically and this paper provides insights in the automated features. read more

The fairness, predictive validity and acceptability of multiple mini interview in an internationally diverse student population- a mixed methods study

A few words about this paper…

For the Irish and moreover in an international context, an important paper written by my colleague in the School of Medicine/National University of Ireland, Galway, Dr Maureen Kelly. Once multiple-mini-interviews were made available in an electronic fashion, data retrieval, storage and analysis appeared more accessible than collecting all data from paper score-sheets. International medical students, those attending medical school outside of their country of citizenship, account for a growing proportion of medical undergraduates worldwide. This study aimed to establish the fairness, predictive validity and acceptability of Multiple Mini Interview (MMI) in an internationally diverse student population. MMI appears to be a welcome addition to assessment armamentarium for selection, particularly with regard to stakeholder acceptability. Understanding the mediating and moderating influences for differences in performance of international candidates is essential to ensure that MMI complies with the metrics of good assessment practice, and principles of both distributive and procedural justice for all applicants, irrespective of nationality and cultural background.  read more