Computational protocol: The development of an online decision support tool for organizational readiness for change

Similar protocols

Protocol publication

[…] Using measures that meet the inclusion criteria described above, we will conduct a mapping exercise to categorize what underlying factors/dimensions of organizational readiness each item included in each measure is intended to assess. The following information will be extracted independently from each measure by two investigators: setting of validation, innovation-specific focus (if applicable), and the inclusion of items assessing specific aspects of implementation beyond organizational readiness as defined by Holt et al.[] (e.g., developing an implementation plan). Inter-rater reliability between the two investigators will be computed using the kappa statistic; a score greater than 0.6 will be considered sufficient to proceed.We will map each item of each of the included readiness assessment measures to one of the four readiness for change constructs as identified by Holt et al.[], i.e., individual psychological (IP), individual structural (IS), organizational psychological (OP), and organizational structural (OS), to determine which construct the item is most closely measuring, similar to mapping exercises conducted by Cane et al.[] and Dixon et al.[]. This conceptual framework was selected because it provides a multi-level depiction of organizational readiness that has informed definitions of readiness in the field [,]. Items that are inconsistent with any of the four constructs of organizational readiness will be categorized as ‘other.’ Before proceeding, the study investigators will reach consensus on the specific definitions of each of these constructs following from the work by Holt et al.[] and Weiner et al.[]. To facilitate the mapping exercise, we will create an electronic mapping worksheet (Figure ). The worksheet will consist of the individual items abstracted from each of the selected measures; these items will be presented in random order, and reviewers will be blinded to the measure from which the items were derived.A simple coding system will be developed for each of the four constructs of the organizational readiness for change framework (1 = IP; 2 = IS; 3 = OP; and 4 = OS). We will include an additional code for constructs lying outside of these definitions (5 = other), given that many measures contain items that do not assess readiness [].Four to six reviewers will independently review and code each item from each measure; as this methodology is similar to closed-sorting content validation tasks, two to 24 reviewers are sufficient for this exercise [,,]. Reviewers to participate in the mapping exercise will be selected from among the study investigators as well as from external experts in the field. We will use the results of Attieh et al.’s systematic review [] to purposively identify individuals who have published at least two articles on the topic of organizational readiness in healthcare (i.e., ‘field experts’). Potentially eligible reviewers will be invited by e-mail to participate in the mapping exercise as an external reviewer, and will be given a brief overview of the study. Individuals who agree to participate will be sent an information package, instructions for completion, and a copy of the electronic mapping worksheet. Each reviewer (both internal and external) will conduct mapping independently over a two-week time period, and will send their completed worksheets by e-mail to a designated study investigator to collate the results.To determine the level of agreement among the reviewers, data will be entered into SPSS 22.0 and an interclass coefficient (ICC) and 95% confidence interval (CI) will be computed. An overall ICC >0.70 will be considered satisfactory to move forward. Any discrepancies will be resolved through deliberation with the reviewers in consultation with all study investigators until final consensus is reached. Following deliberations, the proportion of items measuring each of the four constructs of organizational change readiness (i.e., IP, IS, OP, or OS) and the ‘other’ category will be calculated per readiness for change assessment measure. […]

Pipeline specifications

Software tools SAMtools, SPSS
Application Miscellaneous