Occupational Medicine Advance Access originally published online on June 7, 2007
Occupational Medicine 2007 57(5):342-348; doi:10.1093/occmed/kqm023
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Specialist competencies in occupational medicine: appraisal of the peer-reviewed literature
1 Centre for Occupational and Environmental Health, Faculty of Medical and Human Sciences, University of Manchester, 4th Floor, Block C, Humanities Building (Devas Street), Oxford Road, Manchester M13 9PL, UK
2 Centre for Occupational and Environmental Health, University of Manchester, Manchester M13 9PL, UK
3 Occupational Health Department, Durham County Council, Durham, UK
4 Medical Division, Civil Aviation Authority, Gatwick, RH6 0YR, UK
Correspondence to: F. Gallagher, Centre for Occupational and Environmental Health, Faculty of Medical and Human Sciences, University of Manchester, 4th Floor, Block C, Humanities Building (Devas Street), Oxford Road, Manchester M13 9PL, UK; e-mail: frankgallagher3{at}btinternet.com
| Abstract |
|---|
|
|
|---|
Background A re-assessment of competencies and therefore learning outcomes for higher specialist training in occupational medicine (OM) is being undertaken. Although peer-reviewed literature on the subject exists, it is limited and needs appraisal.
Aims To search, and critically appraise the peer-reviewed literature on specialist competencies in OM.
Methods Systematic search of a range of databases of peer-reviewed literature, followed by criterion based appraisal and categorization of the findings.
Results Two hundred and thirty five papers were found of which only 20 were left after application of the grading and exclusion criteria. These addressed competencies from four perspectives: peer consensus, client, educational and legal.
Conclusions Limited evidence can be obtained from the peer-reviewed literature on specialist competencies in OM. However, it suggests the main paradigms for deriving these competencies as well as indicating gaps and the manner in which these might be filled.
Keywords Competencies; occupational medicine; review; specialist
| Introduction |
|---|
|
|
|---|
The need to determine and re-evaluate competencies and therefore learning outcomes for higher specialist training in occupational medicine (OM) is widely acknowledged. In keeping with this, the Faculty of Occupational Medicine (FOM) of the Royal College of Physicians of London is developing an educational strategy to determine how postgraduate training in the specialty will be developed and assessed over the next 10 years. Therefore, it was considered essential to conduct an appraisal of the peer-reviewed evidence base regarding the competencies and learning outcomes which higher specialist training in OM should accomplish.
This paper presents the results of this exercise, discusses the methodological issues involved and makes recommendations on how further progress may be made.
| Methods |
|---|
|
|
|---|
For the purposes of this study, a valid evidence base in the context of setting competencies and learning outcomes for trainee occupational physicians was principally defined as those peer referenced papers adopting a recognized research design. Other peer referenced papers identified which were based on other factors such as legal, ethical or educational approaches were included if judged particularly relevant to considerations of competencies or outcomes.
It was appreciated that formally searching the scientific literature might not identify all the published work, since it has to be acknowledged that the grey literature also contributes to this subject. Nevertheless, since the peer-reviewed literature is clearly defined with bibliographic criteria, this exercise was limited to these sources only (however, some consideration of grey literature is included in the Discussion section).
A search of Medline (as Pubmed) was undertaken using the terms occupational and (education or specialist or accreditation or postgraduate) industrial (education or specialist or accreditation or postgraduate). Those not in English, obviously not relevant (e.g. relating to occupational therapy, undergraduate education, nursing education, individual opinion), or published before 1980 (judged to be a reasonable cut-off) were automatically excluded. A repeat search was undertaken using the same terms for the NIOSHTIC and HSEline databases (accessed via OSHROM) to identify any additional papers not identified by the Medline search.
Each reference was given a score, using a five-point scale (1 = no value, 5 = very valuable), based on the following criteria:
- (i) Recognized study design (none = 1, low strength = 2, valid method = 3).
- (ii) Contains identifiable competence implications (=1, if not = 0).
- (iii) Contains identifiable learning outcomes associated with competence implications found in (ii) (=1, if not = 0).
- (ii) Contains identifiable competence implications (=1, if not = 0).
References scoring 2, or less, were discarded unless reviewers considered them to have a specific value outwith the above criteria.
| Results |
|---|
|
|
|---|
The initial Medline search identified 235 papers. Combination with the NIOSHTIC and HSEline searches and application of the exclusion and grading criteria reduced the relevant papers to 20 [1–20]. Due to the relatively small number of identified papers, a review of their reference lists was undertaken to identify other relevant documents [21–29].
Interpretation of these papers suggested that several main drivers underpinning the views expressed on required competencies were identifiable. These were given the titles educational (reflecting educational and management theory), legal (based on national professional and legislative practice), client (based on needs and opinion of stakeholders in occupational health other than doctors) and peer (based on peer professional opinion) driven.
The main drivers for each paper scoring 2 or more were considered in full, being 13 peer-based [6,11,15–19, 21–23,25–28], 9 legal [2,5,7,9,10,13,14,17,27], 10 educational [1,3,4,8,11,12,14,19,20,24] and 1 client-driven [29]. This imbalance is of concern, when research suggests a disparity between peer and client perspectives of key competencies for occupational health physicians (OHPs). This is an empirical classification with obvious weaknesses (e.g. the drivers are not in some cases mutually exclusive, so double counting may be possible) but identifies the principal aspects of the papers.
A summary of the key findings for the 29 key references identified is provided in Table 1. (A fuller version of this table is available as Supplementary data at Occupational Medicine Online).
|
| Discussion |
|---|
|
|
|---|
The process of identifying a scientifically valid evidence base infers that the definition of what an OHP is and does is commonly accepted, and that by defining the tasks to be accomplished, specialist-level standards of competence and therefore corresponding learning outcomes for trainee specialists may be identified. Many of the reviewed papers were descriptions of practice in different countries [5,6,7,9,10,18] which served to highlight that no such consensus currently exists internationally, by virtue of tradition or legal imperative. This study showed substantial variation in what an occupational physician is regarded as being, and therefore as needing to learn. Dinman [24] offers a useful definition of competence and perhaps consensus needs first to be sought at this level before further progress can be made in identifying specific competencies.
We found that for all areas of occupational health practice, those standards of competence which have been published at best derive from structured peer review (Delphic) methods rather than a more robust scientific evidence base. Those papers addressing issues of competence and outcomes instead represent a variety of dominant influences which we refer to as key drivers and which are discussed further below. The lack of an objective validity for the lists of competencies which currently exist confirms the views of previous authors [25].
A valid research-derived evidence base to support the setting of standards of competence required for accreditation as a specialist in OM could not be identified. Neither did any one paper discuss how an evidence-based approach could be developed. Additionally, most papers fell short as regards specifying the required outcomes and competencies for specialist training. For those that did only a minority provided any prioritization of their suggested subjects. Therefore a less scientific, more pragmatic, approach was required.
The circular, reiterative, quality improvement process proposed by Franco and Bisio [4] for the basis of curriculum development lends itself to audit and continuous improvement in the face of changing social priorities. However, Franco's client-driven approach is not necessarily the only or best means of progress, as discussed below. Such a cycle may be deemed to commence from standard setting. In turn, this determines competencies and therefore, for educational purposes, learning outcomes. These are determined by delivery followed by assessment (such as examination or other means).
Quality improvement cycles may be entered at any point. However, because learning outcomes may be extrapolated from desired clinical outcomes, the latter may prove the logical point of entry. OM suffers as a specialty since its required practical outcomes are less readily apparent, and arguably more numerous, than for other specialties. Acute surgical and medical specialties have tangible endpoints, cure and/or control. Although these are also desirables for OM, they are not the only required outcomes. In particular, OM is primarily a preventive specialty with negative outcome of disease avoidance a required outcome. OM involves numerous relationships: doctor–patient, doctor–employer, doctor–enforcer and so on, each of which entails its own separate defined objectives. This perspective acknowledges that OM is not an invariably scientific discipline but is in large part driven by non-scientific considerations such as legal or managerial. Thus, a scientifically evidence-based approach, although desirable, may for large elements of practice prove unrealistic.
An uncritical attempt to list the competencies on the basis of merging the various views which have been expressed in the literature is not to be recommended. Such an effort would represent no more than an amalgamation of peer-consensus-driven opinions from the various countries which have published such views. It is known, though not necessarily documented in the peer-reviewed literature, that many grey reports draw on each other's content, and therefore automatically appear to corroborate or reinforce each other—but in an artefactual and potentially biased manner. Thus, it is essential to have an ongoing process for maintaining competencies, learning outcomes and hence a syllabus which adequately reflects occupational health practice and maintains its validity. This approach is similar to that proposed by Macdonald et al. [23]. The key drivers identified in our study—peer-based, legal, client and educational drivers—could be used as a basis for analysing the transactions conducted by specialist OHPs in the UK, from which learning outcomes and competencies may be derived. In keeping with the multi-faceted nature of OM's transactions, the client-driven category for those activities performed at the request of the various clients served, e.g. employers, is important, but of itself can be limited and narrow in perspective. This category has recently been recognized by the Health and Safety Executive, as is discussed below [30]. None of the papers identified addressed competency or learning outcomes related to sickness absence advice from OHPs. This function represents a considerable element of UK OHP professional activity [17] and is of considerable interest to organizations funding occupational health services. The absence of a literature base on this subject in relation to OHP training may in itself be symptomatic of a failure by the profession to analyse and evaluate this area of practice.
These four categories (which should not be regarded as mutually exclusive) are to be recommended as a basis from which competencies, learning outcomes and hence a suitable syllabus for postgraduate training could be derived.
A suitable baseline review of the syllabus would consist of the following.
Peer review perspective
The professional behaviours set out in Good Medical Practice for Occupational Physicians should be included in the revised syllabus. This document also underpins the core curriculum for Foundation training [31]. This would integrate specialist training with the behaviours and activities involved in revalidation under the new General Medical Council requirements, thus equipping emerging specialists with revalidation skills and habits. Account of developments in postgraduate OM training within other European Union (EU) countries will also help achieve consistency of practice on the basis of an increasingly common occupational health and safety legislative base. A further workshop to consider the European dimension of training: the implications of European equivalence of specialist qualification identified that a common approach, i.e. a common syllabus within Europe is highly desirable (provided it can address the difficulty of OHPs having different roles in each EU country). In reviewing grey literature from Europe and beyond, it is clear that a number of key competencies are replicated across training strategies, and agreement on these core competencies would provide a useful platform on which to build. As Dinman [24] highlights, there will continue to be varying needs at the level of specialist or augmentative knowledge; however, consensus on core knowledge and therefore core competencies should be achievable. A paper collating the views of EU OHPs on core training requirements has recently been published [32].
Client perspective
This could be progressed in line with the recommendations from Harrington and Ewan McDonald [29]. There is a growing acknowledgement of the value of consultation across stakeholder groups, and this is particularly relevant in the multidisciplinary field of occupational health and safety. Educational bodies need to join government and regulatory bodies in ensuring competencies take account of client views and changing needs, and that all groups work towards developing innovative ways of delivering cost-effectives occupational health services relevant to sector specific size and needs.
Educational perspective
Suitable academic medical educational input should assist the development of syllabus content, competencies and learning outcomes. Published literature highlights a number of educational strategies as being of benefit, these include problem-based learning [1], defining appropriate performance indicators and learning outcomes [3], a total quality approach encompassing self-learning and continuous improvement and development [4,5,16,22], an assessment process which provides both formative and summative components [4] and which acknowledges changing societal needs [4,17]. Clearly much work has been done by the working group on Modernising Medical Careers [30] and the Academy of Medical Royal Colleges [31] in devising training strategies which meet the future needs of medical practitioners and it is essential that OM as a speciality both reflects best practice and has a central role within the ongoing evolution of medical training.
Legal perspective
While the difference in legislative practice across the EU is acknowledged, EU Framework directives do require a certain consistency of approach and this may provide a useful basis on which to develop a consensus for core competencies across member states. However, this implies the necessity of legal representation on the relevant syllabus committees and effective dialogue between these groups.
Though comparison with other specialties has not been made in this review, our specialty is unlikely to be alone in the challenges it faces in this area. During our work, we have become aware of a number of gaps in the evidence base. The peer drivers are often directed by senior members of the profession (the good and the great). To an extent, this may also be true of educational and legal drivers. Only two papers [1,3] explicitly sought to investigate means of ensuring understanding of, and compliance with, evidence-based guidelines relating to work-related health conditions. While this may reflect limitations in the search terms adopted in this study, it is of concern that the use of evidence-based data in both the education and revalidation of OHPs has not been investigated to a greater extent. On issues of ethics, there was no unanimity of opinion, even between OHPs from the same country, further complicating the identification of measurable learning outcomes [26]. However, core competencies do exist, as reflected in current training curricula, and further dialogue should be encouraged between relevant groups to achieve consensus.
Several authors emphasize the need to ensure an open and enquiring mind as a competency of OHPs. While not explicitly stated, the method of establishing this competency in a number of EU countries appears to be the submission of a research project [8,9,17,21]. No alternative methods of assessment were noted from the literature related to the assessment of attainment of this training aim.
The experience of specialists who have recently completed their training is an important one. Such a study has been undertaken (J. Moore, R. Agius, F. Gallagher and A. Pilkington, in preparation) and will be reported upon shortly.
The current review of postgraduate training requirements across medical specialities and the proposals which have developed from Modernising Medical Careers [30] provide a timely opportunity for OM to review its training competencies. OM is unique in providing the clinical experience in both the National Health Service and industry. It is important that these differences are understood by those tasked with developing and implementing Foundation training programmes [31]. It is important that potential gaps in the clinical experience of those intending to pursue postgraduate training in OM are identified and addressed at an early stage of training to ensure a smooth transition between the foundation and specialist programmes.
This paper addresses by definition those competencies to be achieved at or by the end of higher specialist training. However, Modernising Medical Careers [30] additionally envisages intermediate criteria required to progress to further higher training in the specialty. The literature review has not provided enough information to characterize these intermediate competencies. Nevertheless, it appears intuitive and efficient to aim for a congruency between these intermediate specialist training competencies and those intended for generalists with a special interest notably the Diploma of the FOM [33]. This may also facilitate the admission of non-specialists with such a qualification to a higher specialist training programme in OM.
All medical practitioners are faced with constant changes in clinical practice. This is particularly true in OM which has seen a significant decline in classical industrial diseases in recent decades and the emergence of a spectrum of health conditions which reflect both changes in technology and a greater awareness of the role of psychosocial factors. The practice of OM is also influenced by changing societal concerns and legislative practice. There is a need for the profession to keep pace and to be seen to address societal concerns such as environmental and sustainability issues. The changing face of the EU will continue to have a significant impact on the practice of OM within the UK. This all implies a knowledge base for specialist training which is proactive in addressing these needs.
It is acknowledged that there is currently a limited evidence base on which to develop competencies for the future training needs of OM. The establishment of such an evidence base is therefore essential to the success of future training initiatives and the credibility which OM has within both its peer group and wider society. The growth and accessibility of IT provide an opportunity to gather relevant data, disseminate good practice and ensure consistency of practice. Those who fund academic research have a responsibility to encourage the growth of evidence-based medicine, and those who publish peer-review journals should establish regular series which stimulate authors to submit relevant findings.
However, much of this discussion and the main drivers highlighted above suggest the need for a broader multidisciplinary approach than currently exists across medical disciplines. Within OM, there is a need for all relevant stakeholders to be actively involved in shaping future training strategy. Given the variation in practice across the EU, there is also a need to identify individuals from each area of the EU to form a joint working group specifically charged with the task of agreeing competencies. If successful, this should have sufficient credibility to influence training needs across the wider global marketplace.
| Conflicts of interest |
|---|
|
|
|---|
None declared.
| References |
|---|
|
|
|---|
- Smits PB, de Buisonje CD, Verbeek JH, van Dijk FJ, Metz JC, ten Cate OJ. Problem-based learning versus lecture-based learning in postgraduate medical education. Scand J Work Environ Health (2003) 29:280–287.[Web of Science][Medline]
- Boczkowski A. Self-assessment of the competencies in occupational medicine as an instrument for improving postgraduate training. Int J Occup Med Environ Health (2000) 13:91–101.[Medline]
- Smits PB, Verbeek H, van Dijk FJ, Metz JC, ten Cate TJ. Evaluation of a postgraduate educational programme for occupational physicians on work rehabilitation guidelines for patients with low back pain. Occup Environ Med (2000) 57:645–646.
[Abstract/Free Full Text] - Franco G, Bisio S. Total quality strategy in the formative process of the occupational physician. Scand J Work Environ Health (1999) 25:153–156.[Web of Science][Medline]
- Indulski JA, Boczkowski A. Occupational health education in Poland: new needs, new requirements, new programmes. Int J Occup Med Environ Health (1999) 12:3–13.[Medline]
- Koh D, Jeyaratnam J. Occupational health in Singapore. Int Arch Occup Environ Health (1998) 71:295–301.[CrossRef][Web of Science][Medline]
- Lehnert G, Wrbitzky R. Occupational health in Germany and other countries of the European Union. Int J Occup Med Environ Health (1998) 11:9–18.[Medline]
- Jedrychowski W, Maugeri U. Needs and requirements for undergraduate and graduate training in environmental and occupational epidemiology. G Ital Med Lav (1993) 15:7–11.[Medline]
- He FS, Lu JY. Training and education in occupational health in China. Asia Pac J Public Health (1989) 3:160–164.[Medline]
- Lee WR. Development in education in occupational medicine in the United Kingdom. Am J Ind Med (1981) 2:203–208.[CrossRef][Medline]
- Boczkowski A. The competencies postulated for occupational medicine training in Europe as viewed by Polish specialists. Int J Occup Med Environ Health (2001) 14:63–69.[Medline]
- Agius RM, Bagnall G. Development and evaluation of the use of the Internet as an educational in occupational and environmental health and medicine. Occup Med (Lond) (1998) 48:337–343.[CrossRef][Medline]
- Saric M. A review on occupational health in Yugoslavia. J UOEH (1987) 9:119–126.[Medline]
- Indulski JA, Dawydzik LT, Michalak J. Polish approach to the quality assurance system in occupational health services. Int J Occup Med Environ Health (1998) 11:209–215.[Medline]
- Philipp R, Goodman G, Harling K, Beattie B. Study of business ethics in occupational medicine. Occup Environ Med (1997) 54:351–356.
[Abstract/Free Full Text] - Turner S, Hobson J, D'Auria D, Beach J. Continuing professional development of occupational medicine practitioners: a need for assessment. Occup Med (Lond) (2004) 54:14–20.[CrossRef][Medline]
- Netterstrom B, Grandjean P. Occupational and environmental medicine in Denmark. Int Arch Occup Environ Health (1998) 71:3–6.[CrossRef][Web of Science][Medline]
- Guidotti TL. Preventive medicine: notes toward an agenda for change. Am J Prev Med (1996) 12:165–171.[Web of Science][Medline]
- Lucey CT. What role dues occupational and environmental health law have in grad and continuing medical education? J Occup Environ Med (1996) 38:169–177.[CrossRef][Web of Science][Medline]
- Lee WR. Training in occupational medicine. Am J Ind Med (1986) 9:499–501.[CrossRef][Web of Science][Medline]
- Richter ED, Berman T. Environmental and occupational medicine and injury prevention: education and impact, classroom and community. Public Health Rev (2002) 30:277–292.[Medline]
- Palmer KT, Harling CC, Harrison J, Macdonald EB, Snashall DC. Good medical practice: guidance for occupational physicians. Occup Med (Lond) (2002) 52:341–352.[CrossRef][Medline]
- Macdonald EB, Ritchie KA, Murray KJ, Gilmour WH. Requirements for occupational medicine training in Europe: a Delphi study. Occup Environ Med (2000) 57:98–105.
[Abstract/Free Full Text] - Dinman BD. Education for the practice of occupational medicine: knowledge, competence, and professionalism. J Occup Environ Med (2000) 42:115–120.[CrossRef][Web of Science][Medline]
- D'Auria D. The core of competence. Occup Med (Lond). (1999) 49:209.[CrossRef][Medline]
- Aw TC. Ethical issues in occupational medicine practice: knowledge and attitudes of occupational physicians. Occup Med (Lond) (1997) 47:371–376.[CrossRef][Medline]
- Lane DS, Ross V, Parkinson MD, Chen DW. Performance indicators for assessing competencies of preventive medicine residents. Am J Prev Med (1995) 11:1–8.[Web of Science][Medline]
- Wegman DH, Peters JM, Fine LJ, Boden LI, Burgess WA. Teaching occupational health to physicians. J Med Educ (1978) 53:746–751.[Web of Science][Medline]
- Competencies of Occupational Physicians: the Customer's Perspective. Research Report 247. Health and Safety Executive. HSE Books, 2004.
- Modernising Medical Careers—the Next Steps (2004) Department of Health.
- Curriculum for the Foundation Years in Postgraduate Education and Training. The Foundation Programme Committee of the Academy of Medical Royal Colleges, in co-operation with Modernising Medical Careers in the Departments of Health, 2005.
- Cashman C, Slovak S. The occupational medicine agenda: routes and standards of specialization in occupational medicine in Europe. Occup Med (Lond) (2005) 55:308–311.[CrossRef][Medline]
- Faculty of Occupational Medicine. In: Diploma in Occupational Medicine (DOccMed). London: Royal College of Physicians. http://www.facoccmed.ac.uk/edtrain/diplomas/doccmed.jsp (date last accessed 23 May 2007).
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||