A review does not ask whether your OSCE is good. It asks what evidence you hold that it is, and whether you produce that evidence routinely. Almost every document it wants already exists somewhere in the exam cycle. The work is keeping them in a single file in a format someone outside the school can read. This page maps the questions to the documents.
What a reviewer is checking
Assessment sits under Standard 3 of the World Federation's standards for basic medical education. That is the frame the Georgian quality agency used in its own review of medical schools. No standard prescribes the OSCE or any particular format. What they ask is narrower and harder. That the method suits what is being certified. That the school knows how well it worked. And that the decisions it produced can be traced.
Three questions sit behind nearly every request.
Does the exam test what the program claims to certify? That is the blueprint and the station set. Do the scores support the decision taken on them? That is reliability, the station metrics and the standard-setting record. And does the school act on what it finds? That is the review cycle, and it is the one most often missing.
The mapping
What the reviewer asks | The document | Where it comes from |
|---|---|---|
What does a pass certify? | The validity argument, one page | |
Does the exam cover the curriculum? | The blueprint with station mapping | The design section |
How were stations written and checked? | Station files, review notes, pilot records | |
Who examined, and were they trained? | The examiner register with training dates | |
How was the pass mark set? | The standard-setting decision record and minute | |
How well did the exam work? | The quality report for each sitting | |
Who ratified the results? | The board minute and the pass list | |
What happened on the day? | The incident log, signed | The delivery section |
What did candidates get back? | Feedback records and the results letter template | The candidates section |
What changed as a result? | The annual review and its actions | |
How are appeals handled? | The regulations and any appeal outcomes |
A reviewer reads the last row of that table more closely than the first. Anyone can write a blueprint. Only a school that runs the cycle can show three years of reports with actions attached.
What one national review actually found
The Georgian agency's analysis of medical education is unusually blunt. It is worth reading, because the gaps it names are the ordinary ones.
The evidence behind the methods is direct. The experts could not find evidence related to the reliability and validity of the methodology used. Only one institution applies the psychometric approach. One institution explained the reason plainly. The work requires a lot of time if done manually, so it was looking to buy an application.
Its recommendations name specific documents. Developing patient consent forms for OSCE use, including for international students. Retraining relevant examiners. Reviewing the number of OSCE stations and testing hours to ensure that competence assessment is thorough and reliable. It found that timely feedback after assessment is achieved only to a limited extent when the process is carried out manually. And it asked for the rules on retakes to be brought in line with the law.
Read as a checklist: five documents: a consent form, an examiner training record, a station and timing justification, a feedback record, and a retake regulation. A school that holds those five answers most of what that review asked.
The Georgian context
Two facts frame the conversation for schools here. The national health strategy for 2022 to 2030 prioritizes the wider use of the OSCE in undergraduate medical education as a gold standard. And the national quality agency has been recognized by the World Federation since 2018, with that recognition valid to 2028.
So the OSCE is being encouraged here, and reviews are run against standards recognized worldwide. A school adopting the format now should build the file from its first sitting. Assembling it the month before a visit is much harder.
Keeping the file
Four habits make the difference, and none of them costs much.
Keep one folder per sitting, with the same subfolders every time. Name the documents by what they are, not by who made them. Put the date of the sitting in every filename. And write a one-page cover sheet per academic year listing what ran, what the reports found, and what changed.
The cover sheet is the part schools skip, and reviewers value most. It turns a pile of evidence into an argument.
Limits
A complete file is not a good exam. It is a claim that can be checked, which is all any review can ask for. A school can hold every document on this page and still run eight stations with untrained examiners. The file will show exactly that.
Requirements also differ by country and by regulator. Some publish detailed expectations that this page does not reproduce. Read your own regulator's current documents and map them onto this table rather than the other way around.
Frequently asked questions
What evidence does an accreditation review want about an OSCE?
The blueprint, the station files and their review notes, the examiner training register, the standard-setting record, a quality report for each sitting, the board minute and pass list, the incident log, candidate feedback records, and the annual review that shows what changed.
Does any standard require an OSCE?
No. Assessment standards ask that methods suit what is being certified, that their reliability and validity are known, and that decisions can be traced. The OSCE is one way to meet that for clinical skills, and the review asks for your evidence, not for a particular format.
What do reviewers most often find missing?
Evidence about the methods themselves. One national review reported that experts could not find evidence on the reliability and validity of the methods used, and that only one institution applied a psychometric approach. The review cycle, showing what changed after each exam, is the other common gap.
How long should OSCE records be kept?
As long as the school's retention policy and the appeal window require, which usually means several years. Keep one folder per sitting with the same structure each time, and a one-page yearly cover sheet naming what ran, what the reports found, and what changed.
What is the single most useful document to add?
The annual cover sheet. Most schools already hold the underlying records but present them as a pile. One page per year, listing the sittings, the findings, and the actions taken, turns that pile into an argument a reviewer can follow.