| Title |
Assessing the equivalence of Web-based and paper-and-pencil questionnaires using differential item and test functioning (DIF and DTF) analysis: a case of the Four-Dimensional Symptom Questionnaire (4DSQ)
|
|---|---|
| Published in |
Quality of Life Research, February 2018
|
| DOI | 10.1007/s11136-018-1816-5 |
| Pubmed ID | |
| Authors |
Berend Terluin, Evelien P. M. Brouwers, Miquelle A. G. Marchand, Henrica C. W. de Vet |
| Abstract |
Many paper-and-pencil (P&P) questionnaires have been migrated to electronic platforms. Differential item and test functioning (DIF and DTF) analysis constitutes a superior research design to assess measurement equivalence across modes of administration. The purpose of this study was to demonstrate an item response theory (IRT)-based DIF and DTF analysis to assess the measurement equivalence of a Web-based version and the original P&P format of the Four-Dimensional Symptom Questionnaire (4DSQ), measuring distress, depression, anxiety, and somatization. The P&P group (n = 2031) and the Web group (n = 958) consisted of primary care psychology clients. Unidimensionality and local independence of the 4DSQ scales were examined using IRT and Yen's Q3. Bifactor modeling was used to assess the scales' essential unidimensionality. Measurement equivalence was assessed using IRT-based DIF analysis using a 3-stage approach: linking on the latent mean and variance, selection of anchor items, and DIF testing using the Wald test. DTF was evaluated by comparing expected scale scores as a function of the latent trait. The 4DSQ scales proved to be essentially unidimensional in both modalities. Five items, belonging to the distress and somatization scales, displayed small amounts of DIF. DTF analysis revealed that the impact of DIF on the scale level was negligible. IRT-based DIF and DTF analysis is demonstrated as a way to assess the equivalence of Web-based and P&P questionnaire modalities. Data obtained with the Web-based 4DSQ are equivalent to data obtained with the P&P version. |
X Demographics
The data shown below were collected from the profiles of 4 X users who shared this research output. Click here to find out more about how the information was compiled.
Geographical breakdown
| Country | Count | As % |
|---|---|---|
| United States | 1 | 25% |
| Unknown | 3 | 75% |
Demographic breakdown
| Type | Count | As % |
|---|---|---|
| Members of the public | 4 | 100% |
Mendeley readers
The data shown below were compiled from readership statistics for 63 Mendeley readers of this research output. Click here to see the associated Mendeley record.
Geographical breakdown
| Country | Count | As % |
|---|---|---|
| Unknown | 63 | 100% |
Demographic breakdown
| Readers by professional status | Count | As % |
|---|---|---|
| Student > Master | 9 | 14% |
| Student > Ph. D. Student | 8 | 13% |
| Researcher | 7 | 11% |
| Student > Doctoral Student | 6 | 10% |
| Lecturer | 3 | 5% |
| Other | 11 | 17% |
| Unknown | 19 | 30% |
| Readers by discipline | Count | As % |
|---|---|---|
| Medicine and Dentistry | 9 | 14% |
| Psychology | 8 | 13% |
| Nursing and Health Professions | 7 | 11% |
| Social Sciences | 6 | 10% |
| Agricultural and Biological Sciences | 2 | 3% |
| Other | 10 | 16% |
| Unknown | 21 | 33% |
Attention Score in Context
This research output has an Altmetric Attention Score of 2. This is our high-level measure of the quality and quantity of online attention that it has received. This Attention Score, as well as the ranking and number of research outputs shown below, was calculated when the research output was last mentioned on 26 April 2018.
All research outputs
#13,580,944
of 23,023,224 outputs
Outputs from Quality of Life Research
#1,389
of 2,916 outputs
Outputs of similar age
#171,779
of 331,231 outputs
Outputs of similar age from Quality of Life Research
#38
of 70 outputs
Altmetric has tracked 23,023,224 research outputs across all sources so far. This one is in the 39th percentile – i.e., 39% of other outputs scored the same or lower than it.
So far Altmetric has tracked 2,916 research outputs from this source. They receive a mean Attention Score of 4.6. This one has gotten more attention than average, scoring higher than 50% of its peers.
Older research outputs will score higher simply because they've had more time to accumulate mentions. To account for age we can compare this Altmetric Attention Score to the 331,231 tracked outputs that were published within six weeks on either side of this one in any source. This one is in the 46th percentile – i.e., 46% of its contemporaries scored the same or lower than it.
We're also able to compare this research output to 70 others from the same source and published within six weeks on either side of this one. This one is in the 42nd percentile – i.e., 42% of its contemporaries scored the same or lower than it.