You are seeing a free-to-access but limited selection of the activity Altmetric has collected about this research output.
Click here to find out more.
X Demographics
Mendeley readers
Attention Score in Context
| Title |
Sequential Effects in Essay Ratings: Evidence of Assimilation Effects Using Cross-Classified Models
|
|---|---|
| Published in |
Frontiers in Psychology, June 2017
|
| DOI | 10.3389/fpsyg.2017.00933 |
| Pubmed ID | |
| Authors |
Haiyan Zhao, Björn Andersson, Boliang Guo, Tao Xin |
| Abstract |
Writing assessments are an indispensable part of most language competency tests. In our research, we used cross-classified models to study rater effects in the real essay rating process of a large-scale, high-stakes educational examination administered in China in 2011. Generally, four cross-classified models are suggested for investigation of rater effects: (1) the existence of sequential effects, (2) the direction of the sequential effects, and (3) differences in raters by their individual characteristics. We applied these models to the data to account for possible cluster effects caused by the application of multiple rating strategies. The results of our research showed that raters demonstrated sequential effects during the rating process. In contrast to many other studies on rater effects, our study found that raters exhibited assimilation effects. The more experienced, lenient, and qualified raters were less susceptible to assimilation effects. In addition, our research demonstrated the feasibility and appropriateness of using cross-classified models in assessing rater effects for such data structures. This paper also discusses the implications for educators and practitioners who are interested in reducing sequential effects in the rating process, and suggests directions for future research. |
X Demographics
The data shown below were collected from the profiles of 2 X users who shared this research output. Click here to find out more about how the information was compiled.
Geographical breakdown
| Country | Count | As % |
|---|---|---|
| Switzerland | 1 | 50% |
| Unknown | 1 | 50% |
Demographic breakdown
| Type | Count | As % |
|---|---|---|
| Members of the public | 2 | 100% |
Mendeley readers
The data shown below were compiled from readership statistics for 19 Mendeley readers of this research output. Click here to see the associated Mendeley record.
Geographical breakdown
| Country | Count | As % |
|---|---|---|
| Unknown | 19 | 100% |
Demographic breakdown
| Readers by professional status | Count | As % |
|---|---|---|
| Student > Master | 5 | 26% |
| Researcher | 3 | 16% |
| Student > Doctoral Student | 2 | 11% |
| Student > Ph. D. Student | 1 | 5% |
| Lecturer > Senior Lecturer | 1 | 5% |
| Other | 1 | 5% |
| Unknown | 6 | 32% |
| Readers by discipline | Count | As % |
|---|---|---|
| Psychology | 3 | 16% |
| Nursing and Health Professions | 2 | 11% |
| Social Sciences | 2 | 11% |
| Computer Science | 2 | 11% |
| Economics, Econometrics and Finance | 2 | 11% |
| Other | 2 | 11% |
| Unknown | 6 | 32% |
Attention Score in Context
This research output has an Altmetric Attention Score of 1. This is our high-level measure of the quality and quantity of online attention that it has received. This Attention Score, as well as the ranking and number of research outputs shown below, was calculated when the research output was last mentioned on 07 June 2017.
All research outputs
#18,548,834
of 22,973,051 outputs
Outputs from Frontiers in Psychology
#22,402
of 30,131 outputs
Outputs of similar age
#241,982
of 317,326 outputs
Outputs of similar age from Frontiers in Psychology
#497
of 599 outputs
Altmetric has tracked 22,973,051 research outputs across all sources so far. This one is in the 11th percentile – i.e., 11% of other outputs scored the same or lower than it.
So far Altmetric has tracked 30,131 research outputs from this source. They typically receive a lot more attention than average, with a mean Attention Score of 12.5. This one is in the 19th percentile – i.e., 19% of its peers scored the same or lower than it.
Older research outputs will score higher simply because they've had more time to accumulate mentions. To account for age we can compare this Altmetric Attention Score to the 317,326 tracked outputs that were published within six weeks on either side of this one in any source. This one is in the 13th percentile – i.e., 13% of its contemporaries scored the same or lower than it.
We're also able to compare this research output to 599 others from the same source and published within six weeks on either side of this one. This one is in the 10th percentile – i.e., 10% of its contemporaries scored the same or lower than it.