Development and testing of study tools and methods to examine ethnic bias and clinical decision-making among medical students in New Zealand: The Bias and Decision-Making in Medicine (BDMM) study
Health provider racial/ethnic bias and its relationship to clinical decision-making is an emerging area of research focus in understanding and addressing ethnic health inequities. Examining potential racial/ethnic bias among medical students may provide important information to inform medical education and training. This paper describes the development, pretesting and piloting of study content, tools and processes for an online study of racial/ethnic bias (comparing Māori and New Zealand European) and clinical decision-making among final year medical students in New Zealand (NZ).
The study was developed, pretested and piloted using a staged process (eight stages within five phases). Phase 1 included three stages: 1) scoping and conceptual framework development; 2) literature review and identification of potential measures and items; and, 3) development and adaptation of study content. Three main components were identified to assess different aspects of racial/ethnic bias: (1) implicit racial/ethnic bias using NZ-specific Implicit Association Tests (IATs); (2) explicit racial/ethnic bias using direct questions; and, (3) clinical decision-making, using chronic disease vignettes. Phase 2 (stage 4) comprised expert review and refinement. Formal pretesting (Phase 3) included construct testing using sorting and rating tasks (stage 5) and cognitive interviewing (stage 6). Phase 4 (stage 7) involved content revision and building of the web-based study, followed by pilot testing in Phase 5 (stage 8).
Materials identified for potential inclusion performed well in construct testing among six participants. This assisted in the prioritisation and selection of measures that worked best in the New Zealand context and aligned with constructs of interest. Findings from the cognitive interviewing (nine participants) on the clarity, meaning, and acceptability of measures led to changes in the final wording of items and ordering of questions. Piloting (18 participants) confirmed the overall functionality of the web-based questionnaire, with a few minor revisions made to the final study.
Robust processes are required in the development of study content to assess racial/ethnic bias in order to optimise the validity of specific measures, ensure acceptability and minimise potential problems. This paper has utility for other researchers in this area by informing potential development approaches and identifying possible measurement tools.
This research output has an Altmetric Attention Score of 1. This is our high-level measure of the quality and quantity of online attention that it has received. This Attention Score, as well as the ranking and number of research outputs shown below, was calculated when the research output was last mentioned on 15 June 2020.
All research outputs
#26,938,113
of 32,611,522 outputs
Outputs from BMC Medical Education
#3,958
of 4,842 outputs
Outputs of similar age
#253,191
of 327,819 outputs
Outputs of similar age from BMC Medical Education
#54
of 65 outputs
Altmetric has tracked 32,611,522 research outputs across all sources so far. This one is in the 9th percentile – i.e., 9% of other outputs scored the same or lower than it.
So far Altmetric has tracked 4,842 research outputs from this source. They typically receive a little more attention than average, with a mean Attention Score of 6.4. This one is in the 5th percentile – i.e., 5% of its peers scored the same or lower than it.
Older research outputs will score higher simply because they've had more time to accumulate mentions. To account for age we can compare this Altmetric Attention Score to the 327,819 tracked outputs that were published within six weeks on either side of this one in any source. This one is in the 12th percentile – i.e., 12% of its contemporaries scored the same or lower than it.
We're also able to compare this research output to 65 others from the same source and published within six weeks on either side of this one. This one is in the 9th percentile – i.e., 9% of its contemporaries scored the same or lower than it.
