INTRODUCTION
To improve patient care, health systems worldwide have had an ongoing concern with health care professionals’ competencies, functions, and job performance, and have called for medical schools to educate professionals to adequate levels of ability and performance.[1]
Professional competencies have been defined as the set of knowledge, procedures, attitudes and values that have concrete job results in a specific work environment. These competencies involve socioaffective, cognitive, psychological, sensory and motor abilities, expressed as knowing, knowing how to do, and knowing how to be, so that the professional knows how to act to solve problems and complete tasks, functions and responsibilities in professional practice.[2−7]
There have been many projects, meetings, events and statements on this topic, and various models have been proposed to address the development of competencies in medical education and how they relate to patient care and the workplace. Several countries have adopted competency-based training in their universities, and organizations and centers have been created for its study.[8−13] In the intensive care specialty, several studies have identified competencies. Some of the most important are Roca’s study,[4] the CoBaTrICE project and the Multisociety Task Force Recommendations.[14,15]
In Cuba, regulations have been approved to identify job competencies,[16−18] and several studies have been conducted by the National School of Public Health and the Medical University of Havana (UCMH).[2,3,19,20] The Ministry of Public Health (MINSAP) created a national competency and performance commission, which began the process of defining competencies in seven specialties.[21] The intensive care and emergency medicine (IEM) specialty was not among the first seven selected for competency definition in this process, but two national workshops were held to develop the IEM specialty, in which 60 eminent professionals agreed on the need to define IEM competencies and to modernize Cuba’s IEM residency program with a competency-based curriculum.[1,22,23]
The purpose of this study was to identify specific professional competencies of IEM specialists, thus helping to improve professional profile and job performance.
METHODS
Study type and participants A developmental study was conducted from January 2014 through December 2015, using qualitative techniques. Empirical methods used were surveys and expert consultations. The research builds on previous work by Véliz that defined specific functions and procedural skills required of IEM specialists.[23]
A purposive maximum-variation sampling strategy was used to select 48 professionals for different stages of the study, taking into account their experience and ability to provide authoritative and competent judgments.[24,25] Participants included members of the National IEM Expert Group; members of the national governing board of the Cuban Society of Intensive Care and Emergency Medicine; and members of the IEM residency and specialty advisory committee. It also included heads of ICUs; IEM professors; officials of MINSAP’s Division of Urgent Care, Emergency Medicine and Transplantation; academic deans and vice deans of faculties offering IEM training; directors and assistant directors of hospitals with intensive care units, critical care departments and emergency rooms; and managers of mobile medical emergency units.
Data sources and collection Information collection instruments were developed for both the surveys and expert consultations, and databases were created for statistical processing.
Definitions
IEM specialist Physician who has successfully completed the IEM medical residency or who has met the requirements for the title of second-degree specialist (a Cuban higher-level specialty credential) in IEM after being accredited in another medical specialty.[26]
Professional competencies Set of know-ledge, skills, attitudes and values used in a specific work environment to solve a concrete problem in the practice of a profession.[7]
Specific professional competencies Those that all professionals require to practice their profession, depending on the area, service or specialty. As these are gradually acquired, specialists increase their expertise.[19]
IEM specialists’ professional competencies Set of knowledge, skills, attitudes and values that determine IEM specialists’ practice and are used in their work environment, with concrete job results.[7]
Key purpose Definition of what the occupation purports to achieve.[27] In the health care professions, this is care in the health–disease process.[28]
Functions or competencies Definitions based on the key purpose, and related to the basic and most general functions of the specialty, stated in its graduate profile.[22] In IEM, four functions have been defined: patient care, management, teaching and research.[23]
Competency unit (CU) A set of productive functions that can be performed by a person in a particular job. CUs are made up of various achievements that must be attained for the specific function to be considered fulfilled.[28]
Competency element (CE) An action, behavior, or result that professionals must demonstrate.[27]
Functional competency map A table showing the process for successively categorizing competencies. It begins by formulating the key purpose of an area for analysis, continues by identifying competency units, and is completed by specifying the competency elements a specialist should be able to perform.[28]
Study design Three groups of experts were consulted to define IEM specialists’ competency areas, competency units and specific competency elements, following steps described in detail by Véliz,[1,23] with some modifications.
The algorithm used was developed in the three stages (Figure 1).
Stage 1. Identification of IEM specialists’ professional competencies
- document analysis and systematization of definitions, focuses and trends in professional competencies and work performance
- state of the art of IEM competencies worldwide
Figure 1: Methodology for defining professional competencies of specialists in intensive care and emergency medicine
SNS: National Health System UCMH: Medical University of Havana
Stage 2. Competency definition
-
- Information collection: This was done with a first group of five IEM experts who had participated in the previous study[1,2,3] and met the criteria: ≥10 years of IEM practice, involved in direct care during the study, teaching appointment of at least assistant professor level or higher with satisfactory evaluations, master’s degree or doctorate, second-degree specialization in IEM and experience in research.
This group performed its work in several face-to-face sessions, alternated with other techniques, such as oral and written brainstorming[25] on a discussion list called Competenciasmie, created on Infomed (Cuba’s digital health information network) for working via email. In the end, a list of CEs was obtained, the CEs were grouped into CUs, and a map of specific IEM competencies was created.
- Information validation: This was conducted with a second expert group of 25 professionals from across Cuba, of whom 16 had participated in the previous study. Nine specialists left the group for various reasons, and were replaced by professionals who had qualified for the previous study, but had not participated in it.[23] The nine specialists who joined the group received individual orientation on professional competencies. All participants met study requirements:
- ≥15 years practicing medicine
- ≥10 years practicing IEM at different care levels, and currently providing direct specialty care
- Second-degree specialization in IEM
- Teaching appointment at assistant professor level or higher, with satisfactory evaluations
- MS in urgent care or other IEM-related degree, and/or PhD
- History of performing patient care, teaching and research duties, with satisfactory evaluations
- Participation on year-end exam juries and state specialty exam boards
All these professionals had an average competence coefficient[1,20] of 0.94, higher than in the previous study.[23]
The Delphi method was applied in three rounds:
- Round 1: Via email, participants were sent the list of specific competencies determined by the first group, and were offered a chance to give a dichotomous answer (agree/disagree) for each proposed CU and CE, and add other competencies or propose any modifications they considered necessary. This design allowed calculation of the percentage of accepted or unaccepted competencies, and addition of others that had thus far not been identified. The cutoff for determining consensus was 80%, adopted as the standard of approval for each proposed CU and CE.[24,29] Experts were contacted by email, telephone or in person to discuss their responses and ensure they had been clearly and accurately understood. Questionnaire responses were then reviewed by the author group and a second questionnaire incorporating all contributions was prepared.
- Round 2: The group received the resulting list of specific competencies, showing group response percentages, comments, and new proposals and modifications (repetitions deleted, as were details that could be included in competency standards in later studies). This allowed experts to reassess their opinions after reading other group members’ views. To complete this round, the authors performed a logical and grammatical analysis of responses that met the 80% threshold, deleting those that failed to meet it and eliminating repetitive or redundant proposals.
- Round 3: This round allowed increased consensus among the experts (by identifying indicators with 85% or higher agreement). A final report was prepared, which was sent to each expert along with a letter of thanks.
Stage 3. NHS managers and UCMH academics
As in the previous study,[23] a third group of 20 professionals was convened, consisting of policy, management, academic and methodological decisionmakers in the SNS and UCMH. This group included directors and deputy directors of hospitals with intensive care units, critical care departments and emergency rooms, as well as managers of mobile medical emergency units. In addition to their position or job responsibility, all met study requirements: ≥20 years in medical practice, first- or second-degree specialization, university teaching appointment, a master’s degree or doctorate, and a competence coefficient >0.8. All had a competence coefficient of 0.9 or greater. Only three had participated in the previous study. Two members did not complete the Delphi process and were excluded from the study.
The purposes of the study were explained to all, as were participants’ contributions and roles within it. They were asked to join a group using the Delphi method. To initiate the process, the CUs and CEs defined by the previous groups were listed in a document (questionnaire), and a Likert-type rating scale was applied, using five columns ordered by degree of importance or priority.[23] Two rounds of consultation were held.
Data analysis and management Results were collected in Excel and SPSS 21 for Windows databases. Results were displayed as absolute and relative frequencies in contingency tables, with competencies as rows and ratings as columns (accepted/not accepted in the first two Delphi rounds). Ratings from the final Delphi round were on an ordinal scale of: unimportant, somewhat important, important, very important and essential, numbered from one to five in the same order.
Ethics Participants’ anonymity, confidentiality and written informed consent were ensured. The study was approved by the Ethics Committee of UCMH’s Comandante Manuel Fajardo Medical Sciences Faculty.
RESULTS
The first expert group performed a functional occupational analysis of the specific IEM specialist functions described by Véliz[24] with the following results by function:
- patient care, 48 CEs grouped in 7 CUs
- management, 17 CEs in 3 CUs
- teaching, 6 CEs in 1 CU
- research, 6 CEs in 1 CU
The second expert group used the Delphi process to assess the specific competencies and competency map determined by the first group. In the first round, it confirmed that all CUs and CEs had obtained >92% approval (above the 80% minimum standard). No new CUs were proposed to add to the seven in the patient care function, although it was suggested that two CUs be merged, which lowered the number to six. There were 83 proposed changes to the CEs, consisting of 66 wording changes, 11 new CE proposals, 3 mergers, 2 deletions and 1 division into several CEs.
After Round 2, there were 35 proposed changes: 21 CE wording changes, 8 new CE proposals, 3 mergers and 1 separation. The final list at the end of Round 3 contained 73 CEs in 11 CUs: 44 CEs in patient care, grouped in 6 CUs; 16 CEs in management, in 3 CUs; 7 in teaching, in 1 CU; and 6 in research, in 1 CU.
Table 1 displays the responses of the third expert group concerning the CUs’ importance to IEM as a specialty. The 18 professionals ranked the 11 CUs and 73 CEs defined by the previous groups as essential 896 times (59.3% of 1512 possible answers), very important 514 times (34%), and important 102 times (6.7%). None of the CUs or CEs were rated not very important or unimportant, with ratings basically divided between the very important and essential categories.
Table 2 displays the map of CUs and CEs defined by the study.
Table 1: Expert ratings of importance of specific IEM competencies1
1Both competency units and competency elements
2Number of times competency received this rating (maximum possible 1512)
IEM: intensive care and emergency medicine
Table 2: Functional competency map for intensive care and emergency medicine
SNS: National Health System UCMH: Medical University of Havana
Table 2: Functional competency map for intensive care and emergency medicine (cont’d)
DISCUSSION
Defining professional competencies for IEM was an important challenge because of the study’s potential impact on the specialty’s present and future practice, and because of the need to clearly define what constitutes an intensive care specialist in Cuba, as well as to set targets for levels of training, competence and performance to improve quality as physicians proceed through specialty training along its path to professionalization.[30,31]
The competencies obtained are tools for human resource development and a basis for training, mentoring and curriculum improvement to enhance quality and safety of patient care. They are the starting point for performance appraisal and a service quality accreditation system. Performance improvement is a deliberate process carried out through specialists’ systematic integration of new knowledge and tools as the specialty evolves.
Competencies have been examined and classified from a number of perspectives; we adopted a classification based on generic and specific competencies.[7] Our focus in this study was on defining specific professional competencies for IEM specialists in Cuba. Our approach to defining specific patient care competencies was tailored to medical care of the seriously ill patient using the clinical–epidemiological method,[32,33] from initial patient care in urgent and emergency situations, to care for patients in critical stages of disease, and over the spectrum of prevention, diagnosis, treatment and rehabilitation.
Patient care competencies include documentation, monitoring, followup, development and interpretation of clinical, laboratory and imaging data, analysis and integration of new situations; carrying out IEM techniques and procedures;[24] diagnosis and therapeutic support of patients with serious or critical illness; disaster transport and care; and maintaining professional relationships with patients, families and the health care team, based on solid ethical foundations.[34,35]
We believe that the patient care competencies identified here are both an expression and a consequence of the Cuban health care model, in which IEM provides continuous, progressive care to patients with clinical or surgical urgent care or emergency needs of any origin. As the patient moves through different scenarios in the care network, intensivists must be prepared to work in these scenarios and dedicate all their time to highly specialized care and treatment.[22] Since patient care tasks are the core of the specialty, it is only to be expected that the majority of specific competencies identified relate to the patient care function. Other studies in intensive care medicine have had similar results.[4,14,15]
Second in number to patient care competencies are management CUs and CEs which provide organizational, followup, managerial and monitoring support for patient care and academic processes and activities, as well as for management activities themselves in various health service components. These competencies build on the management functions defined in the previous study,[23] which considered administration a social science that uses planning, organizing, managing, coordinating and monitoring of activities to marshal material and human resources to meet organizational objectives.[36] Management competencies also involve analysis of quality indicators and monitoring of human and financial resources, as well as requiring compliance with regulations, protocols and guidelines in medical care through internal audits and rigorous quality control. For health administration, quality health care and patient safety programs are two vital components.
Seven teaching CEs were determined, all under a single CU. These include conducting teaching and training activities for professionals and employees within facilities, through use of teaching skills, active learning methods, evaluations and designing health education programs, all of which contribute to professional development and continuing education.[3] The competency in use of information and communications technologies deserves special attention, as these technologies offer an ideal framework for sharing and disseminating knowledge and supporting training, research and innovation in IEM.[37]
Six research CEs were determined, grouped under a single CU: application of methodological principles of scientific research to conduct clinical research; use of statistical tools, bibliographical references, including foreign-language literature, to develop research, patient care and teaching activities; communicating results in different formats; organizing scientific activities; and participating in clinical trials, all of which IEM specialists should use to build their scientific and research skills and improve patient care, creating added value for both themselves and their work settings. Intellectual capital and human resources now constitute prime competitive advantages for organizations.[38]
Competencies have not been explicitly stated in Cuba’s IEM specialty curriculum,[39] so there is no basis for comparison with the ones developed in this study, and very few studies have fully identified specific professional competencies in other medical specialties in Cuba.[10,40] Nor do we intend to draw comparisons with intensive care competency studies conducted in Europe[4,14] and the United States,[15] since results are influenced by differing contextual factors, such as health care and training scenarios, and economic and technological development.[7] Furthermore, Cuba’s IEM specialty combines intensive care, urgent care and emergency care specialties, which are considered separate specialties in some other countries.[22]
One of the study’s constraints is that the competencies it identified have not yet been broken down into their essential components, including knowledge, skills, procedures and values, a task for further research. Nevertheless, the study is timely, because it corresponds with recently approved guidelines for Cuba’s economic and social policy.[41] It is also innovative because of its comprehensiveness and focus on determining IEM specialist competencies, emphasizing key principles such as in-service education; integration of teaching, patient care and research; and encouragement of a tutorial education process for residents and ongoing postgraduate professional development.
Identifying IEM specialty competencies is crucial to enabling performance assessment and evaluation of job performance and assessment of specialists’ suitability to practice; it also provides a guide for rational distribution of specialists in the various occupational IEM profiles in Cuba and countries where Cuba provides medical collaboration.
From a technical standpoint, the methodology used in the study may be informative for developmental research to determine competencies in other specialties.
CONCLUSIONS
The specific professional competencies of IEM specialists were identified using a scientific method based on consultation with experts. Defining specific competencies in intensive care and emergency medicine is a theoretical, practical, methodological and social contribution that can be used for future curriculum reform and evaluation of specialist performance. It thus constitutes a tool for improving IEM management, training, research, and, ultimately, patient care quality in Cuba.