Advancing a new evidence-based professional in health care: job task analysis for health and wellness coaches

A heterogeneous literature base for health & wellness coaching

While there are over 350 articles in the peer-reviewed literature describing health or wellness coaching interventions, careful scrutiny reveals enormous heterogeneity in use of the terms “health” or “wellness” coach. Job definitions and the interventions under evaluation run the gamut from minimally trained undergraduate students phoning patients to review and problem-solve homework assigned in a structured chronic disease management program [9], to volunteers with 16 h of training who review with patients the importance of managing chronic conditions [10], to highly-trained health professionals with up to 100 h of additional coach-specific training who use specific processes founded on evidence-based behavior change theories [4, 11, 12]. “Health” or “wellness” coaching is also used to refer to technology interventions without interpersonal communication [13], and to individuals providing interventions that completely lack description [14].

The systematic review noted that of the 284 articles reviewed at the time, less than a third described the coaching methods used during the interventions studied, hindering a full evaluation of the effectiveness or contribution of specific methods, and replication in other studies. Hence, to build a robust evidence base on HWC, the tasks conducted by a health and wellness (HW) coach must be well-defined and consistently applied in order to support stringent methodology.

Establishment of emerging professions

An emerging profession starts with pioneers who develop and test a new competency set and establish applications across different contexts. This phase is followed by innovators who refine these competencies and collect evidence over time, before reaching a maturity phase suited to standardization, credentialing, and eventually licensure. Best practices for delineating emerging job roles include the conduct of a practice analysis, or JTA, followed by a validation survey of the JTA completed by individuals practicing that particular profession or role [16, 17]. The JTA clarifies the real-world content of a job, as well as the requirements necessary for those who perform the job. Hence, the JTA is used to create accurate and valid job descriptions, while defining the tasks, knowledge, and skills that an individual must have to conduct that job at a minimally competent level [18, 19].

Once established, necessary training curricula can be articulated, to delineate valid entry-level skills and basic job requirements. The JTA is based on input from selected practicing coaches, who are in the best position to describe the requirements and content of their work, as compared to educators or theorists more removed from the field [16–19]. The JTA process also presumes that use of well-constructed scientific inquiry and appropriate statistical methodology will lead to a reliable and valid description of job requirements. Use of validation survey procedures and appropriate psychometric assessments ensure reliability as well as content validity to the JTA [17]. Ultimately, the validation survey lays the foundation of the blueprint for a certification exam that tests the applied knowledge required to carry out the tasks as specified in the JTA. Professional certification is thus obtained when a person passes an examination that adequately and proportionally covers the job as delineated and validated in the job task analysis [16, 17].

Phase I: building the task list

The JTA implemented by the NCCHWC for HWC was facilitated by Gerald A. Rosen, EdD, a consulting psychometrician with 32 years of experience in the design, administration and analysis of credentialing programs. A first step in the JTA was to assemble a small panel of Subject Matter Experts (SMEs) who formed a representative sample of practicing professional HW coaches. Experienced HW coaches were nominated by NCCHWC Board members and invited leaders in the field to serve on the SME panel. Nominees completed a survey indicating information about their background and current practice. The initial pool of 38 invitees was narrowed to 34 to ensure an “in the trenches” experience level. Participants were required to coach at least 10 h per week on average and have a minimum of 100 h of practice post training; since four of the nominees did not, they were removed from the pool.

The demographics, professional background, coach training, and work characteristics of the 34 potential invitees were then considered to create a diverse group. Prior to panel selection, the Board identified the factors that were most important to consider in a creating a diverse panel, including the following: gender (to ensure male representation), ethnicity, age, professional background, training programs attended, source of nomination, amount of coaching experience, current work setting, and the area of the country in which the coach practiced. Stratification was done manually by evaluating different configurations for the panel considering the above criteria. For example, a panel which had no dietician representation was rejected, and a panel which had no coaches under 35 years of age was rejected. The NCCHWC Board reviewed the possibilities and decided by consensus on the most diverse. Stratification resulted in 15 representatives.

In March of 2014, SMEs gathered in Indianapolis for a 2.5-day meeting, where the consultant facilitated a process to define the specific tasks that they perform in coaching sessions. The consultant led the participants in an initial brainstorm wherein they noted in a linear fashion each thing they do during a coaching session. The consultant then led participants back through the tasks again and again, repeatedly asking clarifying questions such as “What happens next?” or “Is there anything else you do during this task?” or “Are there times when you don’t do this?” The process was repeated many times to guarantee completeness of the task list, with the consultant pushing the group to think clearly and concretely until the group met consensus on each included task. Consensus was required that the task is essential to perform HWC, independent of how frequently the task is conducted. The process was collaborative; rather than simply listing and voting on task inclusion, tasks were included in the final list only after consensus was achieved. Panel members emphasized that the sequence of coaching tasks is emergent rather than linear; for most of the process, the needs of the patient dictate the sequence of tasks more than an order that is defined a priori.

After panel members felt confident that all tasks were listed, they discussed the relative frequency and importance of each task. While some specific tasks may be performed only rarely, they are essential to the process of HWC. Other tasks may be done frequently, but are less critical [17]. Panel members then came to consensus on the grouping of tasks into domains. Considering both the frequency and importance of each domain, the SME panel then assigned a domain weight to each task grouping to indicate the domain’s relative contribution to the process. The SME-assigned domain weight served as a comparison point for the domain weights that were later derived from the validation study conducted in Phase II.

The JTA SME panel briefly discussed a list of knowledge and skills necessary to support the tasks. Since time limitations precluded thorough analysis of these, the Board convened a second SME group composed of HWC educators with representatives from 20 different programs in academia, government, associations and the private sector. That SME group was professionally facilitated by a specialist in curriculum development and the process used to clarify and refine the knowledge and skills lists is described elsewhere [20]. Those findings will form the basis for national standards for training and education as well as practical assessment for HW coaches.

The NCCHWC board of directors had the responsibility to review the JTA and approve, raise concerns or request amendments. The board approval process to request amendments required consensus of the board, and full approval by the SME panel. Individual SMEs were sent a copy of the JTA through email by the JTA coordinator, with requested edits in tracked changes. Each SME was asked to provide feedback and approve or reject the edits. Panel members responded to the JTA coordinator, who passed the information on to the board. In the case of rejection by any SME, amendments would be denied or reworked until consensus was reached.

Phase II: validating the task list

Data analysis

Responses to the survey were compiled through Survey Monkey and exported to EXCEL. Descriptive statistics, frequency counts, task weights and domain weights were calculated using EXCEL. Tasks weights and domain weight were based on the importance and frequency ratings, per the formulas presented in Fig. 1 [21].

The JTA panel

Ten of the 15 SMEs regularly had direct communication with patients’ other care team members. Nine shared their records with other providers. Six used a web coaching platform; eight used an electronic medical record (EMR); and eight were actively involved in coaching with measured outcomes for research purposes.

Task list

The validation sample

The mean Importance and Frequency ratings for each job task can be found in Table 2, with the listing of the tasks. Table 2 also contains the task weights and domain weights based on the survey responses. For the first three domains, the domain weights originally proposed by the JTA panel were remarkably similar to those of the validation survey. Comparatively, the domain weights for the JTA panel versus the validation survey participants, respectively, were 25.0 % versus 25.6 % for Domain I, 40.0 % versus 40.7 % for Domain II, and 30.0 % versus 28.7 % for Domain III. The JTA panel proposed a weight of 5 % for Domain IV. In the validation survey, the single question relevant to Domain IV (Legal and Professional Considerations) was answered in the affirmative by 95 % of the sample.

Interpretation of the JTA

The JTA enables the NCCHWC to build an accurate, valid and legally defensible certification examination [17, 18]. The domain and task weights generated through the JTA process set the foundation for the specifications for the first national certification exam for HW coaches. The typical criteria for the acceptance of Tasks range from a mean Importance rating of 2.0 (lenient) to 3.0 (stringent) [23]. As seen in Table 2, all mean Importance ratings exceeded 3.0 and, therefore, all of the tasks merit inclusion in the final certification examination specifications.

The decision to retain or reject tasks in Domain IV, which address legal, ethical, and professional considerations, was made in a different manner. Survey respondents were asked if they thought it important for the certification examination to include questions pertaining to such matters. Since approximately 95 % answered in the affirmative, Domain IV tasks also merit inclusion in a knowledge certification examination. Five percent was retained as the domain weight in the test specifications based on the overwhelming survey respondent support for the retention of Domain IV.

Tasks of a health and wellness coach

With the newly validated JTA, there is now a clear role delineation to be followed by those practicing as HW coaches. The tasks in the JTA make it clear that HW coaches do not diagnose, interpret behavior or beliefs, or clinically advise patients on what to do. Instead, HW coaches follow specific procedures that elicit personally meaningful HW goals from the patient, and use a number of communication and experiential learning techniques to aid the patient in self-discovery and generation of solutions. Importantly, HW coaches help the patient strengthen motivation, establish systems of accountability and integrate their own learning in how to best shift their behavior in the context of their own life circumstances.

While there certainly are many gaps in the medical system that need to be addressed through new roles, use of the term “coach” for other roles is confusing to patients and providers. According to this validated JTA, coaches are not “navigators” who tell a patient how to work through the complexities of the health care system. They are not a type of physician extender who calls patients to remind them to take their medications or come to appointments. Nor are they administrative personnel who also have good interpersonal skills. All of these roles may be exceptionally important, but a different term is needed to avoid confusion in the literature, and indeed among the public.

Developing a certification examination

NCCHWC used best-practice processes to delineate the role of HW coaches. The professionally-led JTA produced 21 tasks that were validated by a national survey of 1031 respondents, of whom 885 were actively practicing HW coaches whose task ratings were included in the task and domain weights. Survey results revealed a high degree of support for all tasks, and thus all merit inclusion in the test specifications for the NCCHWC certification exam. The fact that the validation sample in itself represented such diversity in terms of educational background and coaching training underscores the need to set at least a minimal bar for background education and for professional competencies specific to HW coaching.

Consistent with the majority of health professional organizations, the NCCHWC will administer only a written exam since the delivery of practical and oral skills examinations has been criticized for low reliability and validity while simultaneously incurring high administration costs [24]. In order to be eligible for the NCCHWC professional certification exam, a minimal skill set must be obtained and documented. Exam applicants must first complete pre-requisites that demonstrate competency in the minimal knowledge and skills necessary to conduct the role of HW coach as defined by the JTA. These pre-requisites include satisfactory completion of healthy lifestyle education, training from an NCCHWC-accredited HW coach training program, practical skills assessment, and documentation of practical experience [20]. As pre-requisites are updated, they will be listed on NCCHWC.org.

Using the tasks identified and validated in the JTA, the preparation of a certification examination has begun, with the content covered according to the relative weights obtained in the validation survey. The written examination will include approximately 150 multiple-choice questions using the blueprint foundation established in the JTA. To begin preparing items for the exam, 19 item writers who are also actively practicing coaches were recruited and underwent a 90 min training by the JTA consultant. The training emphasized that examination test questions which follow best practices must include the right proportion of question types (i.e. assessment of knowledge and recall, application and interpretation, as well as problem solving and evaluation skills).

Following training, item writers were assigned JTA domains in which to write questions or items. Potential questions were created and submitted to the JTA consultant for review. If appropriately structured, the questions were then submitted to a pool of questions to be reviewed by a smaller Item Review Panel comprised of members with no vested interest in any particular coach training program. The Item Review Panel will convene to make a final determination once an exam administration partner has been chosen. The certification examination will require ongoing assessment to ensure content validity and be certain that it remains relevant to HWC practices.

Limitations

Despite building collaborative relationships over a 6 year period and using best-practice processes to delineate the specific tasks of a HW coach, there are at least four significant limitations to the process. First, the rapidly growing field of HWC has myriad players, some of whom have vested interests in maintaining their own definition rather than contributing to a consensus approach. While the NCCHWC welcomes participation of new and existing groups, and indeed continues to grow, it will never be possible to have all parties in complete agreement. Second, the SME panel that formed the JTA was diverse in terms of myriad coaching-related variables and background characteristics, but quite limited in terms of racial and ethnic diversity. In addition, the validation survey did not ask participants their race or ethnicity. While this is common practice for role delineation studies [25–27], there is no published sociodemographic data on practicing HW coaches. Hence, we have no way to evaluate how representative our sample is of the field itself. Third, non-probability sampling for surveys can result in a number of biases [28]. First, the sampling was limited to those with online access who had completed specific training programs that sent the survey invitations to their graduates. Although we reached out to many programs, there was self-selection in whether or not programs responded. There was also self-selection in which individuals responded. Since 78 % of the respondents had received a reminder email, those that did not respond may have been less interested in a national certification or simply forgot about the original email. In addition, the numbers reported regarding the validation sampling process may not accurately reflect those who received the invitation. We did not ask the training programs to collect data on how many invitations had incorrect emails and were returned. Moreover, it is likely that some invitees received more than one invitation since some invitees had completed more than one training program. Fourth and finally, the field is not yet mature enough for licensure. While certification and licensure both require individuals to demonstrate a certain level of knowledge and ideally ability, only licensure refers to the legal rights of being able to practice a profession in a given locale. However, licensure is practically driven by economic and systemic priorities in any given state; until there is a reasonable volume of consistently credentialed practitioners in the field, licensure is unlikely to be financially viable or practical. Although a national certification will begin to create uniformity that allows for better research and accumulation of evidence to move toward best practices, regulation of use of the term HW coach and enforcement of the scope of practice are left to the field at large to self-police.