You are seeing a free-to-access but limited selection of the activity Altmetric has collected about this research output.
Click here to find out more.
X Demographics
Mendeley readers
Attention Score in Context
| Title |
Chat Generative Pretrained Transformer Fails the Multiple-Choice American College of Gastroenterology Self-Assessment Test
|
|---|---|
| Published in |
American Journal of Gastroenterology, May 2023
|
| DOI | 10.14309/ajg.0000000000002320 |
| Pubmed ID | |
| Authors |
Kelly Suchman, Shashank Garg, Arvind J. Trindade |
| Abstract |
Chat Generative Pre-trained Transformer (ChatGPT) is a natural language processing model that generates human-like text. ChatGPT-3 and ChatGPT-4 were used to answer the 2022 and 2021 American College of Gastroenterology (ACG) Self-Assessment Tests. The exact questions were inputted in both versions of ChatGPT. A 70% or higher was required to pass the assessment. Overall ChatGPT-3 scored a 65.1% on 455 included questions, and GPT-4 scored 62.4%. ChatGPT did not pass the ACG self-assessment test. We don't recommend its use for medical education in gastroenterology in its current form. |
X Demographics
The data shown below were collected from the profiles of 38 X users who shared this research output. Click here to find out more about how the information was compiled.
Geographical breakdown
| Country | Count | As % |
|---|---|---|
| United States | 11 | 29% |
| Tanzania, United Republic of | 1 | 3% |
| Thailand | 1 | 3% |
| Singapore | 1 | 3% |
| South Africa | 1 | 3% |
| Italy | 1 | 3% |
| Mexico | 1 | 3% |
| Unknown | 21 | 55% |
Demographic breakdown
| Type | Count | As % |
|---|---|---|
| Members of the public | 18 | 47% |
| Scientists | 10 | 26% |
| Practitioners (doctors, other healthcare professionals) | 8 | 21% |
| Science communicators (journalists, bloggers, editors) | 2 | 5% |
Mendeley readers
The data shown below were compiled from readership statistics for 46 Mendeley readers of this research output. Click here to see the associated Mendeley record.
Geographical breakdown
| Country | Count | As % |
|---|---|---|
| Unknown | 46 | 100% |
Demographic breakdown
| Readers by professional status | Count | As % |
|---|---|---|
| Researcher | 7 | 15% |
| Other | 4 | 9% |
| Student > Master | 4 | 9% |
| Student > Bachelor | 4 | 9% |
| Student > Doctoral Student | 3 | 7% |
| Other | 9 | 20% |
| Unknown | 15 | 33% |
| Readers by discipline | Count | As % |
|---|---|---|
| Medicine and Dentistry | 12 | 26% |
| Business, Management and Accounting | 3 | 7% |
| Social Sciences | 3 | 7% |
| Agricultural and Biological Sciences | 2 | 4% |
| Computer Science | 2 | 4% |
| Other | 6 | 13% |
| Unknown | 18 | 39% |
Attention Score in Context
This research output has an Altmetric Attention Score of 374. This is our high-level measure of the quality and quantity of online attention that it has received. This Attention Score, as well as the ranking and number of research outputs shown below, was calculated when the research output was last mentioned on 01 September 2023.
All research outputs
#83,935
of 25,394,764 outputs
Outputs from American Journal of Gastroenterology
#51
of 5,783 outputs
Outputs of similar age
#2,058
of 388,206 outputs
Outputs of similar age from American Journal of Gastroenterology
#2
of 54 outputs
Altmetric has tracked 25,394,764 research outputs across all sources so far. Compared to these this one has done particularly well and is in the 99th percentile: it's in the top 5% of all research outputs ever tracked by Altmetric.
So far Altmetric has tracked 5,783 research outputs from this source. They typically receive a lot more attention than average, with a mean Attention Score of 17.7. This one has done particularly well, scoring higher than 99% of its peers.
Older research outputs will score higher simply because they've had more time to accumulate mentions. To account for age we can compare this Altmetric Attention Score to the 388,206 tracked outputs that were published within six weeks on either side of this one in any source. This one has done particularly well, scoring higher than 99% of its contemporaries.
We're also able to compare this research output to 54 others from the same source and published within six weeks on either side of this one. This one has done particularly well, scoring higher than 96% of its contemporaries.