Preparing for success in final summative medical specialist … – BMC Medical Education

Twenty-nine ophthalmologists (12 women and 17 men) who had sat RACE recently (n = 19) or were supervisors of trainees preparing to sit RACE (n = 10) were interviewed. Participants were representative of all seven RANZCO training networks across Australia and New Zealand. Eight trainees shared experiences of failure on one or more sittings of RACE, and all supervisors had supervised trainees who failed RACE.

Analysis of the interview data identified six key themes regarding trainee preparation that promoted examination success (Table 1).

‘Those who fail to plan, plan to fail’

Interviewees reported that they started to prepare for RACE years in advance. Most interviewees commented that a study plan or timeline (developed individually or within study groups) was the essential first element in their preparation. Study plans provided the structure, discipline and accountability that kept them focussed and motivated over the long study period up to the examination. Most trainees suggested that structuring the timetable around the curriculum standards proved useful to ensure the comprehensiveness of study.

We had a conference and we sat down and said, ‘look, this will be the biggest examination we’re going to sit in our lives, we want to get through the first time so let’s come up with a strict study schedule and let’s not waste time anymore’. (Trainee 8)

In terms of preparing for the examination, I set a timetable very, very early on in the piece and that basically involved me starting 11 months prior to sitting the written examination… I think organization, planning, writing it all down at the very beginning, going through the curriculum, it helped us immensely, and we spent like six hours doing that … and then we just sort of stuck to the plan. (Trainee 3)

Trainees who were in locations with heavy workloads/on-call demands when trying to prepare reflected on their frustrations in attempting to secure study time. Some trainees were wise to this issue, and as part of their planning requested training rotations in locations which would support their preparations through minimal on-call, a flexible roster that facilitated attendance at tutorials and teaching sessions, access to Fellows with examination committee experience, and approval of study leave to attend residential examination preparation courses.

The only thing I found really tricky [when preparing for RACE as a trainee] was I was on-call for six months straight up, on-call 24/7. Like there was no weekend off. No nothing. Because some of the rotations, you alternate week on week off, but the ones I was on there was only one registrar there and so you’re on-call the whole time. So I found that really difficult. There wasn’t a point where I could just plan, ‘okay, Sunday I’ll do all day’, because you’d end up being called in and then frustrated with yourself because you like only had two hours today. (Supervisor 1)

I had a rotation at the sort of main tertiary hospital at a time when the juniors were pretty good and it was very well staffed and so I’d just finish my clinic and go study straightaway and come in a bit late in the morning and study in the morning. I had plenty of extra time to study. (Trainee 17)

It takes a village

The experiences shared by interviewees demonstrated that preparation for RACE was underpinned by collective efforts and support from the trainees’ entire training network, the College and their family and friends. First, trainees in their basic years of training were seen as important in supporting sitting candidates by taking up extra duties in clinics which increased study opportunities for trainees preparing for RACE. Interviewees acknowledged the importance of reciprocity of collegiality in the network.

There’s a good culture in [network] amongst the registrars themselves, that like you scratch my back, I scratch yours. So I’m a junior registrar, I know you’re sitting your exams in a couple of months, so I’ll step up and do a lot more of the clinic and give you time to sort of go off to this tutorial, or go off to this teaching session, or take some time off from the clinic so you can prepare a bit more. And then when it’s my go, I know you’ll be through and you’ll hand me your notes or give me some time so you cover me when I need to do my examination. (Supervisor 9)

Second, final year trainees who had already passed RACE contributed to trainee preparation by providing important advice for RACE preparation through their lived-experience of either examination success or failure. Trainees in their final year of training were also seen as a vehicle for study notes; although not all were willing to share their resources with sitting candidates. Trainees emphasised that the study plans used by previous cohorts of successful RACE candidates provided a starting point which current candidates could adapt to suit their own plans.

We just asked the people in the year above, ‘How did you do it?’ And then we took their plans and went, well that doesn’t quite work for us, because we’re all away in different places, we’re going to do it this way instead. So we just changed it to suit our lifestyles, our personal situations, and of course, our work locations and situations a bit more. And that really helped. (Trainee 3)

I got resources from a number of people, probably had too many, more than what I needed. But then a number of other trainees have asked me for what I’ve had, so I’ve downloaded what I have in a big folder and given it to them to work their way through. Because it took me a long time to acquire it. And look, some of the registrars don’t really want to share their stuff with anyone else and other people will. (Trainee 14)

Third, interviewees described that trainees needed to surround themselves with others preparing to sit the examination to build an emotional support network. This was often achieved through the formation of study groups which provided camaraderie, emotional and moral support and the opportunity for peer encouragement. Of note, smaller training networks meant some trainees were left isolated as there were no other trainees preparing to sit. A few of these trainees described overcoming this challenge by connecting virtually with other trainees in an online study group.

I think having that peer support and the combined learning experience with colleagues going through exactly the same thing as you are at exactly the same time, that’s the single biggest thing that I think we need to make sure they all have. Because without that, I honestly don’t think you can pass. I really don’t. (Supervisor 5)

There’s so much importance in having a group of people who not only help you study and study together and share knowledge, but it’s just camaraderie, team building, personal support. (Trainee 6)

The trouble with being in [location] is that we are all scattered all over …so it’s difficult … now since the pandemic, a blessing in disguise, we’ve had Zoom. So we’re meeting up every week on Zoom. (Trainee 5)

Fourth, Fellows and supervisors were pivotal given they helped trainees prepare by quizzing them on their knowledge during clinics and surgeries. Supervisors and Fellows also provided much needed feedback regarding the adequacy and accuracy of trainee answers when using previous exams for practise.

When I was at [hospital] just before the OSCE, and quite a lot of the consultants working there were good, take you out of their way to have a look at this patient, now examine them, tell me what’s going on, that kind of thing. So quizzing you … Some of the consultants at [hospital] actually had a previous kind of RACE OSCE questions like on version PowerPoints. So call me in and like quiz me. So that was really going out of their way. (Trainee 14)

Fifth, Directors of Training provided support in the form of information sessions for trainees on how to prepare for the examination, and monitored their progress throughout the preparation period. However, some trainees did not find the generic information helpful and would have preferred individually tailored advice delivered on a one-to-one basis with their Director of Training.

I actually spent a lot of time with the final year registrars helping them prepare with their exams … lots of RACE tutorial trainings, so I’ve been involved in a lot of the teaching with the registrars, so setting up OSCEs, their conferences, their tutorials, and their sort of final exam preparation. (Supervisor/Director of Training 9)

The College (RANZCO) was a sixth source of support, providing educational resources, curriculum standards, assigning mentors and facilitating access to psychological support. However, some trainees and supervisors commented that the College could provide more detailed guidance on how to prepare effectively for RACE.

I do think that the College has great resources and has done a lot of supporting things for people and everyone has a mentor and things like that, so I do think that the College has done a lot for people. And also, I mean, from the sort of mental health point of view, there also is a lot of support. (Supervisor 3)

Maybe they need to do something about learning the exam technique, how do you answer this question safely and what are the red flags? And it doesn’t just have to be for those who fail, it could be something that everyone could learn before sitting. They don’t give lectures. They don’t give content. I find that a bit unusual. They just keep the curricular standards. (Supervisor 1)

Lastly, and perhaps most importantly for trainees’ emotional and physical wellbeing, was the support provided by friends and family, and domestic service providers such as nannies and cleaners. Trainees reported that the support from friends and family was essential to maintain emotional wellbeing and study motivation. Trainees stated that they outsourced help when needed (e.g. home delivered meals, cleaning, childcare) to take the pressure off their home environment and maximise study time.

I think first of all, I had incredible support. I think without [my partner’s] support, I would have really floundered. It was incredibly taxing to have the [children] around me wanting to be with me and for me not being able to be there. (Trainee 6)

My [partner] took on a lot, my mother took on a lot, everyone around me, we had a nanny, we had all hands onboard. We threw a lot of money at it. It was really hard but equally I think if I hadn’t put 100% in, I might not have got through and then I’d be dragging it out for another six months and then maybe even longer, so that was kind of my approach. (Trainee 18)

Get to know your opponent

Trainees largely described their familiarity with the format of the clinical component of RACE as they had the opportunity to attend mock clinical examinations prior to sitting. Given these are essentially simulated examinations, trainees felt well prepared to sit the clinical component of RACE.

The clinical, I actually found it quite easy. In [network] we did a lot of OSCE kind of training all the time and really challenging cases as well and on the day, pretty much almost all the cases we had for the real exam were ones that we’ve already faced in a practice OSCE or in a teaching session. So we all found it pretty easy to be honest. (Trainee 14)

However, the written component of RACE was described by interviewees as being unlike any university assessment they had previously encountered. Supervisors emphasised that the written component was not an examination of knowledge, but rather an assessment of how knowledge is applied. Some trainees only recognised this with hindsight, having failed RACE initially after expecting a traditional examination and hence preparing by focusing on reading textbooks to become saturated with knowledge. After reflecting on their failure, they described that they had not recognised the need to become familiar with the examination construct, and to develop and practise a specific examination technique to achieve success.

I think one of the key things about the written paper is it’s an opportunity for the candidate to be able to write down their clinical approach and their clinical thinking and clinical reasoning, and that’s quite a complex thing for trainees to do because it’s really trying to put down what is going through their head when they’re seeing patients. (Supervisor 6)

I think just the big thing for me was doing lots and lots of old exam questions, going through them and then asking colleagues to look through them, or Fellows that had sat previously. I think that that was a big part of my preparation. (Trainee 9)

All interviewees acknowledged the important role of using past examination papers as a study resource to prepare and develop examination specific technique. Practising past examinations allows trainees to become familiar with the examination format and understand the requirements to pass. In fact, some trainees specifically indicated that this was the sole mechanism used to prepare for the examination.

What I did was I printed out every single old exam and the examiners’ feedback, and then I sat down and said, ‘what do the examiners want for each type of question?’ And then all I did was past exams for that entire period and if I didn’t know any information, I’d go and look it up. But I sat for every day and I did five written questions, 12 min each, that made 60 min and that was my 60 min of study per day. (Trainee 4)

Written examination technique was reportedly best developed by using past examination papers to study, supported by robust discussion in study groups and obtaining feedback from Fellows, supervisors and examiners on written answer attempts. This helped trainees hone their technique by allowing them to identify patterns and templates for how to answer questions.

I think just the big thing for me was doing lots and lots of old exam questions, going through them and then asking colleagues to look through them, either consultants or Fellows that had sat previously. I think that that was a big part of my preparation. (Trainee 9)

I worked out that the people passing quite efficiently were the people who just studied the exams … they structured their answers based on what the examiners wanted. (Trainee 11)

Finally, trainees unanimously described the written component as being immensely time pressured. Therefore, they emphasised the importance of simulating the time constraints of examination conditions using past papers to develop efficiency in answering questions. Given the online nature of the written examinations, proficient touch typing was seen as essential.

The first thing I did was actually a typing course … I spent a few months learning how to touch type in the evenings, just like 15 min … and I think that made a big difference, because there’s a huge time pressure and if you’re not a touch typist, I don’t know how you would do it. (Trainee 2)

There is no substitute for hard work

Trainees described that on average, RACE required at least twelve months of study to effectively prepare. Those trainees with young children reported that studying for longer periods was beneficial to counter the impact of family responsibilities on study time. Amongst those who sat RACE during the past five years, the shortest duration of study was eight months and the lengthiest was two years.

About two years before [started studying for RACE], but not as intense for the first year. I was just taking my time going through things slowly and then more intense in the last 12 months. The main reason I did that is because I have children … I knew that I needed to get studying earlier as I’m not going to have as much time as a lot of my other colleagues. (Trainee 14)

In terms of study intensity, trainees described dedicating at least one to three hours per day to RACE study individually, with additional group study sessions, tutorials and courses scheduled during the week. Trainees unanimously reported an increasing frequency and intensity of study leading up to the examination. Given the challenge of securing study time against work demands, some trainees reported being opportunistic in clinics, studying between patients and asking trainees in their basic years of training to shoulder more of the load to allow them opportunities to focus on studying.

It’s pretty hardcore, to be honest, but like in terms of quantification, I would say it was basically in the lead up to the first one, it was three hours a day for a year. And that meant I used to get up at quarter past five and just be studying before work, trying to get in an hour or so before work, and then doing an hour or so or two after work. It’s just fairly constant. (Trainee 1)

Most trainees described the need for a period of focused examination preparation in the immediate weeks before sitting, which was facilitated by either study or recreational leave. Some trainees consequently outlined their concerns that some training networks denied access to study leave immediately prior to the examination.

I think it would be nice for all the sitting candidates to have that little bit of time off before, like two weeks or something where it’s just protected time off for those people sitting. Because it’s really stressful to think that you have to go into work the day before such a big [examination]. To allow the candidates to really focus on that, I think it would be nice to have leave before the exam. (Trainee 18)

Noting the duration and intensity of preparation, interviewees almost universally described the RACE preparation period as being the single most physically, mentally and emotionally challenging time of their educational journey. Trainees therefore almost unanimously reflected on their ‘one and done’ attitude, whereby they wanted to give themselves the best chance of passing first sit by throwing everything they had at the initial preparation process.

It was quite stressful and quite intense, but I managed to get through and my experience, I guess I had a lot to lose, so I threw everything at it. I just didn’t want to have to do it again. (Trainee 18)

Interviewees emphasised that self-determination underpinned preparation efforts that were necessary for success in RACE. Supervisors described some situations where they felt trainees were not as dedicated as they needed to be during the preparation period, and that more efforts were needed to educate trainees on the importance of being proactive and self-directed in their preparation.

You really have to drive it yourself I think is the thing. You have to not expect anybody’s going to give you anything … I think if you go in with the attitude that I’ve got to really do all this myself, then I think that gives you the best chance of passing. (Trainee 16)

You’ve got to do everything you can. You’ve got to ask everyone you come across, for a tutorial, for some help, for some exam question marking, or just talking through scenarios. You’ve got to be proactive and maybe the trainees don’t hear that from enough people? (Supervisor 8)

Mechanisms that trainees reported as helpful for managing the ongoing stress and pressure included daily exercise where possible, eating well, outsourcing help when needed, and using mindfulness techniques. Recognising the need to take a break from study to support mental and physical health was also emphasised during the preparation period, but often this proved counterproductive.

You take a bit of a break because you know you need a break, but every time while you’re taking that break, you’re always feeling guilty thinking ‘I should be studying’. (Trainee 19)

Keep pace with the herd

Benchmarking efforts against other trainees preparing to sit was important in the preparation process, which related to trainees reflecting on both the amount of time spent studying, and their knowledge base and understanding of examination technique relative to their peers. Group study was an important conduit for benchmarking, as it highlighted expectations for study effort and also offered the opportunity to share knowledge, study timetables and materials. Trainees described the inherent downplaying of time spent studying by their peers, which meant that some sitting candidates genuinely didn’t appreciate how much effort people were putting into preparation.

I have a friend who’s failed a few times and I think one of the things, especially the first time they sat it, they just had no idea how much people studied for it, or like how long they studied for it and things like that. Like I said, everybody plays down how much they study. (Trainee 2)

Benchmarking was also achieved through trainees attending specific ophthalmology training courses and conferences during RACE preparation. The Dunedin Ophthalmology Clinical Course in particular was almost unanimously viewed as critical for RACE preparation. However, it is important to note that not all interviewees attended Dunedin, with one describing the belief that attendance was not necessary for success. Trainees who attended the course described the opportunity to develop and refine their examination technique, identify gaps in their learning and benchmark their level of knowledge against others preparing to sit RACE.

I think Dunedin [course] is invaluable. I mean, you’re living, breathing, eating, sleeping ophthalmology and when you finish, you just leave thinking, ‘what did I even know before? … It’s just great to consolidate all of that knowledge and information, and have like-minded people pushing you to your limits. (Trainee 3)

Don’t jump the gun

Finally, interviewees highlighted the importance of being adequately prepared to meet examination standards, rather than attempting RACE as soon as eligible. The temptation to sit at the first available opportunity often reflected the immense pressure and intensity that accompanied the preparation period, and the desire of trainees to reclaim their personal life. Trainees described becoming eligible typically at the end of their third year of training. However, interruptions to training due to health or family reasons, as well as the timing of opportunities to access certain training rotations, meant that some trainees had not had sufficient clinical experience or time to prepare. One trainee recognised their hesitation at sitting so close to their initial eligibility, but described being encouraged by others given the notion that there were multiple opportunities to pass.

I was a few weeks shy of the three-year mark when I sat, but I felt ready enough … I had plenty of time to study and I guess people said to me ‘look, two schools of thought – you sit early and often, or you sit once and done’. I was quite nervous about it, but then so many people encouraged me just to get on and give it a go that I was like, ‘okay, if you all think it’s a good idea, I’ll give it a go.’ And so I was able to pass the clinical at that point, but I didn’t pass the written … It was quite demoralising, obviously, failing the first round. (Trainee 13)

Supervisors shared that they could often predict which trainees were not ready based on clinical performance and preparation, and consequently encouraged these trainees to consider delaying their RACE attempt. Interviewees conceded that a face-to-face meeting prior to the intention to initially sit RACE was therefore a critical step in promoting success as it allowed the opportunity to assess the trainee’s preparation progress and readiness to sit. However, supervisors described that advice given to delay sitting due to concerns about preparation was largely ignored, which in some cases resulted in examination failure. Supervisors emphasised the importance of trainees heeding their advice and waiting until they were properly prepared to maximise chances of success.

The Director of Training said up front, ‘don’t do the exam in the next sitting, you’re not ready for it, you are going to fail it.’ And so [they] deferred [the] exam and passed both exams first go … Incidentally, one other person in [training network] that year also got told ‘you’re not ready to sit the exam.’ But that person sat anyway and failed … I think it’s worthwhile if RANZCO suggests to all Directors of Training that every time you have trainees approaching you saying, ‘I want to sit RACE’, you sit down with them for about 10 min and actually make sure they’re ready. (Trainee 3)