↓ Skip to main content

OC-2-KB: integrating crowdsourcing into an obesity and cancer knowledge base curation system

Overview of attention for article published in BMC Medical Informatics and Decision Making, July 2018
Altmetric Badge

Mentioned by

twitter
1 X user

Citations

dimensions_citation
15 Dimensions

Readers on

mendeley
59 Mendeley
You are seeing a free-to-access but limited selection of the activity Altmetric has collected about this research output. Click here to find out more.
Title
OC-2-KB: integrating crowdsourcing into an obesity and cancer knowledge base curation system
Published in
BMC Medical Informatics and Decision Making, July 2018
DOI 10.1186/s12911-018-0635-5
Pubmed ID
Authors

Juan Antonio Lossio-Ventura, William Hogan, François Modave, Yi Guo, Zhe He, Xi Yang, Hansi Zhang, Jiang Bian

Abstract

There is strong scientific evidence linking obesity and overweight to the risk of various cancers and to cancer survivorship. Nevertheless, the existing online information about the relationship between obesity and cancer is poorly organized, not evidenced-based, of poor quality, and confusing to health information consumers. A formal knowledge representation such as a Semantic Web knowledge base (KB) can help better organize and deliver quality health information. We previously presented the OC-2-KB (Obesity and Cancer to Knowledge Base), a software pipeline that can automatically build an obesity and cancer KB from scientific literature. In this work, we investigated crowdsourcing strategies to increase the number of ground truth annotations and improve the quality of the KB. We developed a new release of the OC-2-KB system addressing key challenges in automatic KB construction. OC-2-KB automatically extracts semantic triples in the form of subject-predicate-object expressions from PubMed abstracts related to the obesity and cancer literature. The accuracy of the facts extracted from scientific literature heavily relies on both the quantity and quality of the available ground truth triples. Thus, we incorporated a crowdsourcing process to improve the quality of the KB. We conducted two rounds of crowdsourcing experiments using a new corpus with 82 obesity and cancer-related PubMed abstracts. We demonstrated that crowdsourcing is indeed a low-cost mechanism to collect labeled data from non-expert laypeople. Even though individual layperson might not offer reliable answers, the collective wisdom of the crowd is comparable to expert opinions. We also retrained the relation detection machine learning models in OC-2-KB using the crowd annotated data and evaluated the content of the curated KB with a set of competency questions. Our evaluation showed improved performance of the underlying relation detection model in comparison to the baseline OC-2-KB. We presented a new version of OC-2-KB, a system that automatically builds an evidence-based obesity and cancer KB from scientific literature. Our KB construction framework integrated automatic information extraction with crowdsourcing techniques to verify the extracted knowledge. Our ultimate goal is a paradigm shift in how the general public access, read, digest, and use online health information.

X Demographics

X Demographics

The data shown below were collected from the profile of 1 X user who shared this research output. Click here to find out more about how the information was compiled.
Mendeley readers

Mendeley readers

The data shown below were compiled from readership statistics for 59 Mendeley readers of this research output. Click here to see the associated Mendeley record.

Geographical breakdown

Country Count As %
Unknown 59 100%

Demographic breakdown

Readers by professional status Count As %
Student > Ph. D. Student 10 17%
Researcher 7 12%
Student > Master 5 8%
Student > Bachelor 5 8%
Other 3 5%
Other 14 24%
Unknown 15 25%
Readers by discipline Count As %
Computer Science 12 20%
Medicine and Dentistry 10 17%
Business, Management and Accounting 4 7%
Unspecified 2 3%
Nursing and Health Professions 2 3%
Other 8 14%
Unknown 21 36%
Attention Score in Context

Attention Score in Context

This research output has an Altmetric Attention Score of 1. This is our high-level measure of the quality and quantity of online attention that it has received. This Attention Score, as well as the ranking and number of research outputs shown below, was calculated when the research output was last mentioned on 03 August 2018.
All research outputs
#17,962,854
of 23,098,660 outputs
Outputs from BMC Medical Informatics and Decision Making
#1,519
of 2,013 outputs
Outputs of similar age
#236,985
of 329,730 outputs
Outputs of similar age from BMC Medical Informatics and Decision Making
#19
of 27 outputs
Altmetric has tracked 23,098,660 research outputs across all sources so far. This one is in the 22nd percentile – i.e., 22% of other outputs scored the same or lower than it.
So far Altmetric has tracked 2,013 research outputs from this source. They receive a mean Attention Score of 4.9. This one is in the 24th percentile – i.e., 24% of its peers scored the same or lower than it.
Older research outputs will score higher simply because they've had more time to accumulate mentions. To account for age we can compare this Altmetric Attention Score to the 329,730 tracked outputs that were published within six weeks on either side of this one in any source. This one is in the 28th percentile – i.e., 28% of its contemporaries scored the same or lower than it.
We're also able to compare this research output to 27 others from the same source and published within six weeks on either side of this one. This one is in the 29th percentile – i.e., 29% of its contemporaries scored the same or lower than it.