Evidence of learning in workplace-based assessments in a Family Medicine Training Programme

Background Learning portfolios (LPs) provide evidence of workplace-based assessments (WPBAs) in clinical settings. The educational impact of LPs has been explored in high-income countries, but the use of portfolios and the types of assessments used for and of learning have not been adequately researched in sub-Saharan Africa. This study investigated the evidence of learning in registrars’ LPs and the influence of the training district and year of training on assessments. Methods A cross-sectional study evaluated 18 Family Medicine registrars’ portfolios from study years 1–3 across five decentralised training sites affiliated with the University of the Witwatersrand. Descriptive statistics were calculated for the portfolio and quarterly assessment (QA) scores and self-reported clinical skills competence levels. The competence levels obtained from the portfolios and university records served as proxy measures for registrars’ knowledge and skills. Results The total LP median scores ranged from 59.9 to 81.0, and QAs median scores from 61.4 to 67.3 across training years. The total LP median scores ranged from 62.1 to 83.5 and 62.0 to 67.5, respectively in QAs across training districts. Registrars’ competence levels across skill sets did not meet the required standards. Higher skills competence levels were reported in the women’s health, child health, emergency care, clinical administration and teaching and learning domains. Conclusion The training district and training year influence workplace-based assessment (WPBA) effectiveness. Ongoing faculty development and registrar support are essential for WPBA. Contribution This study contributes to the ongoing discussion of how to utilise WPBA in resource-constrained sub-Saharan settings.

https://www.safpj.co.zaOpen Access describes the evidence of learning in WPBAs in a Family Medicine training programme in South Africa (SA).
Work-based learning shifts the focus from theoretical learning to learning in and from practice. 6Work-based learning also broadens the scope of educational assessment from assessment of learning (AoL), summative components with pass/fail decisions, 5 to assessment for learning (AfL). 7ssessments for learning form part of day-to-day clinical practice: seeking, reflecting and responding to information from observation and dialogue to promote learning. 8ssessment for learning provides meaningful narrative feedback to enhance the learning experience. 7,9Assessments of learning are high-stake assessments focusing on achieving learning outcomes at the end of a programme 7,10 for accountability, ranking and certification of trainee's achievement of competence. 11e distinction between AfL and AoL is complex, making it difficult for trainers to discern how to use the different assessment types effectively. 11Workplace-based assessments captured in learning portfolios (LPs) provide adequate evidence of trainees' competence and are collectively used for the summative AoL. 7Given that WBL and WPBA are recent developments, it may be more difficult for trainers to use AfL and AoL to the trainees' best benefit.

Learning portfolios for workplacebased assessment
In programmatic assessment, defined as 'a consciously designed assessment system in which the longitudinal development is visible to the learner as usable feedback which provides rich data for informed, holistic decision on making learner progression', individual data points from low-stake AfL accumulate into multiple data points for highstake AoL. 4 Learning portfolios, introduced in the United Kingdom in 1996 for postgraduate general practice vocational training, 12,13 are now widely used as a longitudinal tool in programmatic assessments.
Learning portfolios offer several benefits for trainees' longitudinal development.Portfolios may include evidence of personal and professional WBL, 14 assessments of soft skills, like professionalism, communication, teamwork and 'hard' clinical procedural skills. 4,15Soft skills are better learned and assessed when opportunities are provided to address the complexities of clinical practice in the workplace. 4,14,15Learning portfolios provide a systematic overview of the tasks, expected levels of competency for the required tasks, perceived levels of competence (ability to perform the tasks) and areas needing improvement. 15ompetency cannot be measured, but competence, an attribute of the person performing the task, can be measured. 16earning plans, an essential component of LPs, encourage trainees to track their educational progress and stimulate reflection and feedback as critical skills in self-directed learning. 13,17Supervisors are expected to assist trainees in developing learning goals and support them in achieving their learning plans. 18,19The most critical factor influencing LP use in high-income countries was supervision that stimulates trainees' reflection and promotes deep learning. 20,21he organisation of portfolios also affects their efficacy. 21rainees require clear guidelines on the portfolio structure, format and content and how to avoid excessive paperwork. 21rkplace-based assessments are best used as part of a programmatic assessment approach; no single assessment method embodies all the required educational characteristics, such as reliability and validity, educational impact and acceptability. 22However, different WPBA tools have varying educational impacts across clinical contexts. 23,24,25In highincome countries, the effectiveness of WPBA tools relied on prior training on using the tools and the contexts where assessments were conducted. 22,24One factor affecting WPBA is the lack of consensus on the number of assessments used as AfL. 24Other factors arise from the trainee-tool interactions.For example, trainee-assessor relationships could promote lenient marking. 24Despite the challenges associated with WPBAs, the trainees and trainers agree that WPBAs provide valuable narrative feedback and augment trainee selfreflective skills, thus improving learning opportunities. 26tential barriers to effective LP use include the paperwork required, finding senior staff to supervise procedures, ineffective supervision, the lack of faculty engagement 21 and ticking boxes to indicate whether skills were performed. 17,27,28icking boxes does not provide feedback on the quality of performance. 20Other barriers that have been identified were the need for multiple assessors, inadequate supervisor and trainee training on WPBA tools, low trainee confidence and whether WPBAs are conducted for learning or of learning. 13,21,24n one study, trainees were concerned that delayed feedback after WPBAs would impact their results -supervisors could not always remember individual trainees. 28ile WBL theories and models have been developed, variations in how trainees and supervisors utilise WPBA tools across settings need further research. 13Workplacebased assessment tools have been extensively investigated in high-income settings like the Netherlands and the United Kingdom, but there is a paucity of studies exploring their effect on trainee performance in low-middle-income contexts. 29There is a need for further characterisation of LP use, purpose, structure, evidence for mentoring and assessments across different contexts. 21Some authors have suggested a need to explore the influence of context on LP use to understand why implementation failed in some contexts and to identify and interrogate improvements. 21e SA learning portfolio requirements Learning portfolios were introduced SA as a WPBA tool in postgraduate family medicine (FM) training in 2012. 30The Colleges of Medicine of South Africa (CMSA), the examining board for the national exit examinations for registrars (SA postgraduate medical trainees), specifies five-unit standards and 83 programmatic learning outcomes to be achieved at the end of a 4-year specialist training programme. 30,31,32The national LP was designed to capture the evidence for 50 of the 83 learning outcomes. 31,33The LP records evidence of registrars' personal and professional development through reflection and from WPBA tools. 30etailed learning plans should specify registrars' learning needs, plans to address their needs and the goals they have achieved. 34Registrars have to obtain a subminimum of 60% in the LP for each of 3 years to progress to the following year and qualify for the national exit examinations. 30e guidelines for the national LP recommend establishing effective supervisor-registrar relationships with regular engagements, including monthly meetings, at least 6 h of dedicated weekly training and supervision and adequate mentoring. 30Learning portfolios can be handwritten or electronic, depending on university requirements, but electronic portfolios are associated with better completion rates, improved quality of scoring entries, increased frequency of use and sustained supervisor-registrar engagement. 35Previous SA studies found that registrars' reflective skills, knowledge of the requirements, good supervisor feedback and regular engagement with supervisors positively influenced LP use. 34e skills list for registrars was revised and validated in a 2018 national Delphi study. 36This list of 205 core and 39 elective skills is part of the national LP requirements. 30ere are four self-reported competence levels for skills: • A -Only possesses theoretical knowledge about the skill.
• B -Possesses theoretical knowledge and observed that skill performed.• C -Performed the skill under supervision.
• D -Can be fully entrusted to perform that specific skill independently.
There are few studies on WPBA and using LPs in postgraduate medical training in low-middle countries, especially in public district health systems where WBL occurs across various primary health care (PHC) facilities and hospitals.Assessment for learning is used to decide annual registrar progression: the quarterly assessments (QA) and the LP overall score are considered.The QA are observed consultations or procedures evaluated using WPBA tools by a supervisor from another district.The QA scores were taken as AfL separately from the overall LP scores contributing to the year mark.The involvement of multiple supervisors improves the validity of WPBA. 24Assessment of learning includes university examinations conducted 18 months into the training programme and the national exit examination after at least three training years as the final high-stake assessment towards specialist qualification.

Postgraduate family medicine programme at the University of the Witwatersrand
In the logbook section of the Wits University FM LP, registrars must achieve competencies clustered into core and elective skills within 14 clinical domains aligned to CMSA requirements.These clinical domains are adult health, ear, nose and throat (ENT), eyes and skin, women's health, emergency care, child health, consultation skills, clinical governance, orthopaedics, anaesthetics, forensics, community-oriented primary care (COPC), clinical administration, teaching and learning and palliative care.Registrars must achieve competence at level D for all core skills and level C or D for elective skills.Their immediate supervisors evaluate registrars' bi-annual selfassessments of skills in their logbooks before submitting the LPs to the university for final evaluation by the portfolio committee.

Study design
This study forms part of a broader, mixed-methods case study evaluating the postgraduate FM training programme at University of the Witwatersrand using a logic model.The quantitative component of the broader study reported in this article evaluated evidence of learning in WPBAs as shortterm outcomes of the logic model -the short-term outcomes were proxy measures of registrars' knowledge and skills.

Study setting
The study was conducted across the five training districts affiliated with University of the Witwatersrand: Ekurhuleni, Johannesburg Metro, Sedibeng and West Rand in the Gauteng province and Dr Kenneth Kaunda in the North West province of South Africa.Gauteng province is more densely populated (total population above 15 million) than the North West province (just over 4 million). 39However, more than 75% of the population in both provinces is uninsured and utilises government health services at PHC clinics, CHCs and district hospitals. 39There is a gross disparity in the distribution of doctors across the provinces.While Gauteng province has over 4000 medical practitioners and 1500 specialists, North West has an acute doctor shortage with just above 1000 medical practitioners and 100 specialists covering the province. 39he less-populated Dr Kenneth Kaunda district in the North West province has only 30 PHC clinics and 10 CHCs, spread over 14 671 km. 41The number of regional and tertiary hospitals ranges from five hospitals in the Johannesburg Metro district to no tertiary facility in the Sedibeng, West Rand and Dr Kenneth Kaunda districts. 41Most of the uninsured population in these communities relies solely on health services provided by PHC and CHC facilities as the first point of health care, emphasising the need for highquality patient care to be provided at these facilities.

Study population and sampling
The study population included all 18 registrars' LPs across 3 years of the 2020 training programme.All 18 registrars who submitted LPs at the end of the training year 2020 (N = 18) consented to their LPs being evaluated.The registrars' total QA and LP sectional scores, including their skills competence levels and final LP scores, were collected as the AfL.The AoL component for the first-and second-year registrars was the outcome of the 18-month university examinations and the national exit college examination results for third-year registrars.

Data collection
The 'evidence for learning tool' was developed to record registrars' scores and skills competence levels.Quarterly assessment scores and university or CMSA examinations' pass or fail outcomes (in the same or the following year) were extracted from university records.Registrars in the second year wrote the University of the Witwatersrand exams in 2020; the first years wrote in 2021 after completing their 18 months of training.The third-year registrars, who had submitted their LPs in 2020, sat the CMSA exams in 2021, in their fourth year of study.This study used supervisors' total scores allocated for QA, LP and various LP sections and the final pass/fail in the university or CMSA examinations as proxy measures of registrars' knowledge.
The nationally validated skills set 36 was used to develop the skills section of the data collection tool.Registrars' selfassessment scores for each skill in the LP logbook were taken as proxy measures for skill competencies.After the final submission, the registrar's immediate supervisor and the university's portfolio committee verified all the LP scores.

Data analysis
The

Results
Six LPs from each year of registrar training were assessed (N = 18).The total LP median scores and interquartile ranges were 76.3 (62.1-81.2),and the median and interquartile ranges for the QA scores were 64.9 (60.7-69.5).
The median and interquartile ranges calculated for the total LP scores and various LP sectional and QA scores across the training years (Y1-Y3) are shown in Table 1.The total LP median scores were higher in Year 3 compared to Year one (Y1) and Year two (Y2) (Table 1).The Year two registrar's QA median scores were higher than Years one (Y1) and three (Y3) (Table 1).Supervisors awarded full marks (10/10) in some LP sections in Y1 and Y2 but not in Y3 (Table 1).
Table 2 shows the median and interquartile ranges calculated for the total LP scores and various LP sectional and QA scores across the five districts (D1-D5).The total LP median scores varied considerably across D1-D5 (Table 2), but not the QA median scores.Again, some LP sections (learning plans, educational meetings and observations) had median scores of 10/10 in some districts (Table 2).
In the first-and second-year summative assessments (AoL), 6 out of 12 registrars passed the 18-month university examinations on the first attempt; five of the 12 failed them, and one registrar did not take the mid-point examinations.Of the six registrars who completed the 3 years of training, four who sat the national exit examination passed on their first attempt, and two did not take the examination.

Clinical skills competence levels
The logbook skills section was incomplete across all training years, but primarily in the first year: four first-year registrars did not complete the section.The self-assessed competence levels of 18 registrars for 205 core clinical skills and 39 elective skills varied considerably (Appendix 1).Depending on the registrars' self-assessment and the type of skill, competence levels of skills varied and scored from A to D (Appendix 1).Third-year registrars self-assessed their competence as higher (D scores) in most skills than in the other 2 years.The registrars reported higher competence levels in clinical  Although the self-reported level of competence in performing clinical skills was relatively better among third-year registrars compared to Years one and two, some core skills still included levels A, B and C. Examples included a laparotomy for ectopic pregnancy, cricothyroidotomy, assisted vaginal delivery, proctoscopy, vasectomy and reduction of elbow dislocation (Table 3).The total number of registrars in each year was six but varied as registrars did not report on many core skills and left them incomplete (Table 3).
Table 4 shows the total skills set score medians and interquartile ranges for all 14 clinical domains in the LP across the 3 years of training.These medians were higher in adult health, women's health, emergency care and child health for second-and thirdyear registrars than ENT, eyes and skin, orthopaedics and anaesthetics domains (Table 4).The Year two median was higher than Year three for the COPC and teaching and learning domains.When total core skills median scores progressed across the training years, elective skills median scores remained low across all three training years (Table 4).

Discussion
This study examined the evidence of registrar learning from scores and self-reported clinical-skills competence levels recorded in LPs and QAs.The major finding was that LPs are not being used optimally as self-directed learning tools in decentralised training contexts, as has been found previously. 13,17,42The scores in various LP sections and skills level scores (for each skill and skill set) were variable in different clinical domains across training years and lacked adequate evidence of registrar progression in knowledge and skills.Although the LPs showed evidence of registrar learning, they can be used more effectively in WPBA.ENT, ear, nose and throat; COPC, community-oriented primary care; IQR, interquartile range.†, 4/6 Year 1 registrars did not complete the logbook, scoring zero as lower quartile in all total skills set score medians.The total skills set score is the number of self-assessed D-scores in each domain.

TABLE 3:
Self-reported competence levels on selected core clinical skills among third-year registrars (n = 6).Apply club foot cast 0 2 1 1 2 Multiple assessments from various sources in authentic contexts improve assessment validity and reliability. 22lthough there was evidence that the programme included multiple WPBAs, there was also evidence of lenient scoring in LP sections like the learning plans and skills competence levels.The negative impact of lenient scoring may be exacerbated by inadequate narrative feedback, as previously reported for this training programme. 35These combined problems raise concerns about whether LPs are being used effectively to support self-directed learning and suggest that supervisors need more clarity on using LPs in postgraduate training. 13,17e total LP scores improved across training years, but in QA scores across 3 years, second-year registrars had a higher score average than third-year registrars, similar to previous studies that detailed the inadequacies and leniency of supervisors while scoring WPBAs. 43Other LP sections, such as educational meetings and direct observations, showed the required number of educational meetings and WPBAs between supervisors and registrars.As stated in previous studies, 28,34,42 registrars and supervisors in this study focused on completing LP sections rather than effectively utilising them as a learning tool.Whether supervisor-registrar engagement was quantified or engagement took place according to the expected standards with quality feedback to the registrars needs further exploration.In our WBL context, all LP scores were allocated by immediate FP supervisors and later verified by the university's portfolio committee.The LP introduction in the first year, with adequate registrar training on its use and ongoing mentoring by supervisors, could have enhanced LP utilisation during self-directed learning. 21,44arterly assessment scores, part of the AfL component, contributed separately from LP scores to decide yearly registrar progression.In authentic clinical settings, supervisors and registrars struggle to use WPBA tools such as mini-CEX strictly as a summative tool during QA, always adding a formative component to those assessments.Similar challenges were identified related to mini-CEX use in highincome countries. 24,43e self-assessed competence in this study ranged across all four levels.Self-assessment is a feasible method for registrars to report their perceived competence, but it is susceptible to over-or under-reporting. 45,46Although the logbooks ensure that trainees perform the maximum number of skills required for competence, 23 incomplete entries across all three training years undermine that intention.Registrars may have been reluctant to complete the logbook skills section because they perceived their skills competence as inadequate.Alternatively, they may not have felt confident about reporting their competence levels because of inadequate exposure to these skills in their context.Despite the increasing emphasis on selfassessment and critical analysis of trainees' performance in competency-based medical education, 47 the registrars appeared to lack the skills to self-assess their performance.The reported competence levels improved in higher training years, suggesting continuous skills learning at their workplaces.Registrars perform skill rotations in major disciplines during their first and second years of training, allowing them to acquire all needed skills.It was encouraging to find that registrars reported adequate competence levels in domainspecific skills learnt earlier in their training, such as consultation, clinical governance and administration, community-oriented primary care and teaching and learning.
A concerning finding was that specific skills such as cricothyroidotomy, assisted vaginal delivery, laparotomy for ruptured ectopic pregnancy and reducing an elbow dislocation were some examples of skills in which third-year registrars reported lower skills competence levels.Thirdyear registrars should be fully entrusted to perform these essential skills and be able to train junior registrars or students.Registrars' skills deficiencies should be included in learning plans as learning needs, discussed with supervisors and planned on how to acquire them.Achieving adequate procedural skill competence levels by registrars is a priority in full-time postgraduate FM training programmes compared to older part-time programmes. 44The medical officers working in district hospitals in similar contexts reported adequate competence in performing these procedures. 45nce qualified as an FP, the registrar will need to function as a consultant and capacitator for medical practitioners and other health workers by performing various surgical and obstetric skills to strengthen district hospital services. 48This study reiterated that registrars require adequate exposure to learning opportunities to achieve mastery in performing core procedures encountered commonly in primary-care settings.
Third-year registrars reported lower competence levels on core clinical skills such as proctoscopy, applying clubfoot cast, vasectomy, culdocentesis and performing a brachial block.Questions that need to be answered include whether registrars had sufficient opportunities or allocated time to practise these skills during clinical rotations and whether these procedures were performed in sufficient numbers in various disciplines of the regional and district hospitals where registrars rotated.Current trends in medical education emphasise contextualising the curriculum and learning opportunities to acquire knowledge and skills needed in the health care system where trainees practice. 49hile the FM skills list was revised in 2017, 36 some core skills are still not performed sufficiently at peri-urban district hospitals. 45,50Perhaps it is time to revise the FM registrar training skills list to include more relevant contextspecific procedural skills.
The impact of the training context on achieving the required levels of core skills competence may not be sufficiently considered.Family physicians in SA work in various healthsystem contexts like district, regional and tertiary hospitals, private general practice or rural and urban clinics, where they require most of these skills. 51Mastering all core skills could be more relevant for an FP practising in a rural district hospital where acute health worker shortages and referral challenges are experienced than in urban settings.It may be time to consider separating skill sets for FPs practising in rural and urban contexts. 45,52Even in high-income countries, doctors working in rural areas reported higher skill levels than their urban counterparts. 46,53A compulsory rural block for registrars working in peri-urban district hospitals to achieve specific skills, for example, a 2 to 3-month rotation or even a year of longitudinal clinical work from a periurban district hospital to a rural district hospital, could potentially mitigate the skills gaps identified among registrars.
Although studies were conducted when the LP was introduced into postgraduate FM training in SA about 10 years ago, 42 there has not been further research to measure its longitudinal impact.This study initially sought evidence for WBL in the short term, but comparing the findings to studies from a decade ago highlights the long-term impact after LPs were introduced whether they were effectively utilised in WBL.Despite the positive impact of LPs on WBL, this study highlighted several issues that adversely affected how effectively registrars used the LPs, including incomplete logbook sections and a lack of clarity about the roles of FPs.
Workplace-based assessments captured in the LP provide trainees with more opportunities to reflect on their practice in authentic settings, positively influencing learning behaviour. 43eamwork, professionalism and self-appraisal are all assessed when a mini-CEX tool is used in WPBAs. 22The assessment of complex tasks relied on the trainee's ability to integrate cognitive, psychomotor and affective components, best evaluated in authentic clinical settings. 22Currently, the LP primarily focuses on scoring systems to determine whether the numbers needed are met or whether registrars achieved adequate skill competence levels.Providing more qualitative feedback on registrar performance will enhance the comprehensiveness of WPBAs.Most importantly, creating a learning environment that encourages a reflective dialogue between trainees and their supervisors is vital for effective LP utilisation. 20

Limitations
The number of LPs assessed was low, despite including all those available.However, the results contributed to a better understanding of the 'phenomenon of interest' for the broader mixed-methods case study, namely the postgraduate FM registrar decentralised training at the University of the Witwatersrand.
The data extracted depended on the legibility and completeness of various LP sections.Many skill competencies were incomplete, especially in the first-year registrar portfolios, with data collection likely impacted by the coronavirus disease 2019 (COVID-19) lockdown.
During the lockdown, registrars struggled to complete LPs in some clinical skills rotations, which affected our results.
Self-assessment may have resulted in the over-or underreporting of skills competency levels.However, this effect may have been mitigated by supervisors' evaluating competency levels by directly observing procedures.Additional mitigation likely arose during the University's portfolio committee's final evaluation.All districts are represented on this internal committee, which interrogates the LPs and discusses inconsistencies, thereby improving the validity of the results.The initial intention was to determine the association of the scores and skills with the training districts and training years, but this was not feasible given the small number of LPs.Future research on entrusted decisions by supervisors on observed skills may corroborate registrars' self-reported competency levels.

Recommendations
The study highlighted the need for faculty development and registrar training to improve FPs' and registrars' literacy in WPBAs.Training will capacitate supervisors to mentor registrars effectively and enhance registrars' self-directed learning.The LPs should include multiple assessments of various competencies, with both hard and soft skills, from various assessors in different contexts.Adequate formative feedback needs to be provided to augment registrar learning opportunities.Regular formative assessment visits by faculty programme managers will improve and maintain WPBA standards, which could translate to better registrar learning at their workplaces.

Conclusion
This

Teaching and training
Plan and implement a teaching or continuing professional development activity Use a portfolio of learning 0 0 1 8 9 Mentor a colleague 0 0 2 7 9 Facilitate small group learning 0 0 1 10 7 Prepare and give a presentation 0 0 1 11 6 Note: Number of registrars that achieved maximum in each category (A-D), Incomplete = no answer recorded or left blank.

TABLE 4 :
Total skills set score median and interquartile ranges for Years 1-3 (N = 18) in 14 family medicine domains.
39,40While the Johannesburg Metro district has 108 PHC clinics, 11 CHCs and two district hospitals, Ekurhuleni has 84 PHC clinics, nine CHCs and one district hospital.Sedibeng has 8 CHCs and 30 PHC clinics, while West Rand district has 45 PHC clinics and 3 CHCs.
Department of Family Medicine to conduct the research and access the university records and LPs.Informed consent was obtained from registrars to access the LPs.The research was carried out following the Helsinki Declaration.
data were entered into an Microsoft Excel spreadsheet and imported into Stata 14.2 software.Median and interquartile ranges were calculated for the total LP, LP sectional and QA scores for each training district and year.Frequencies of self-reported competence levels for each skill (category scores A-D) were determined.Ethical considerationsEthical approval was obtained from the Human Research Ethics Committee (HREC Medical) of the University of the Witwatersrand (Certificate number M191140).Permission was obtained from the University Registrar and the Head https://www.safpj.co.zaOpen Access of the

TABLE 2 :
Assessment for learning scores in learning portfolios and quarterly assessments across training districts (N = 18).

TABLE 1 :
Assessment for learning scores in learning portfolios and quarterly assessments across training years.as adult health, women's health, child health and emergency care than ENT, eyes and skin, orthopaedics and anaesthetics.First-and second-year registrars scored low in domains like orthopaedics, anaesthetics, ENT, eyes and skin because these clinical rotations occur during their third year of training.Most registrars, even first-year registrars, reported higher competence levels in consultation, clinical administration, clinical governance, COPC and teaching and learning domains (Appendix 1).
https://www.safpj.co.zaOpenAccess domains such study aimed to evaluate evidence of learning in LPs, formative and summative WPBAs and the influence of the training district and the year of training on assessments.While the findings provided a holistic view of WPBA in FM training in one setting, they could apply to similar contexts at South African universities.Future research on WPBA across multiple training programmes will give a complete picture of postgraduate FM training in SA, which may also benefit other sub-Saharan African countries. https://www.safpj.co.zaOpenAccess