In this post, Mike Taylor, Head of Metrics Development at Altmetric and Dimensions, and Stacy Konkiel, Director of Research Relations at Altmetric, share amazing data insights that have been tracked for books, scholarly monographs, and chapters since we started tracking their online attention in 2016.
Altmetric launched Altmetric for Books in 2016, and since then we’ve tracked over 4.6 million online mentions of more than 1.1 million books and book chapters.
In this post, I’ll share the most interesting tidbits about how researchers and the public engage with both trade books and scholarly monographs and their chapters.
Altmetrics for books: what the literature tells us
Scientometricians — academics who use a data-driven approach to study “the science of research” — have long been aware that journal-centric metrics like citation counts are often inadequate for understanding the impact of books. Instead, they’ve suggested a number of altmetrics that can show books’ cultural influence, as well as non-traditional scholarly impacts:
- A number of studies have found that book reviews can be a useful indicator of scholarly impact for monograph-heavy disciplines.
- Wikipedia citations may be useful indicators of the non-scholarly impact of books, with a third of all monographs having received at least one link from the online encyclopedia.
- Inclusion of books in university syllabi “gives a new way to estimate the educational utility of books in a way that sales data and citation counts cannot”.
- “Libcitations” (a count of how many libraries include a title in their holdings) can illustrate books’ cultural impact for researchers of all career levels and disciplines (a challenge that humanities researchers often face).
- Goodreads reader ratings have been suggested as a useful way “to identify the impact of books beyond academia”.
The research makes clear that anyone who wants to understand “big picture” impact for a book or monograph should use a variety of data, rather than citation counts and sales figures alone. Altmetrics make the perfect complement to these kinds of traditional data.
Altmetrics for books: what the data tells us
We love exploring the rich data we’ve captured in the Altmetric database, and have learned some really interesting things so far.
In terms of overall coverage, we’ve noticed that books receive roughly the same amount of attention as journal articles: 68% of books and 67% of journal articles that Altmetric tracks have been discussed in an online source tracked by Altmetric. Interestingly, only 1.8% of book chapters receive attention online, suggesting that perhaps people are more likely to reference a chapter in a book by sharing a link to the entire book, rather than a direct link to the chapter.
We’ve also noticed specific trends when it comes to how long it takes for books to achieve broader impacts, the differences between OA and non-OA monographs in terms of the attention they receive, and disciplinary differences in attention for books.
A “discussion lag” exists for monographs
A long-standing argument in favor of altmetrics is that they are quicker to accumulate than citations. The conventional wisdom tells us that people can start talking about a book days after it has been published, but that it takes years to be cited (after all, this is true for journal articles). However, the research surprisingly does not bear this assumption out.
Digital Science’s “The State of Open Monographs” white paper recently explored this and other trends found in Altmetric book data. The evidence suggests that books’ “citation lag” may be observed with Altmetric data as well: Books’ broader impact appears to have a different profile to that of research articles.
For example, comparing books and journal articles published in the field of History in 2013, the white paper’s authors found that Wikipedia citations, news and blog mentions start later for books than for articles, and that they persist over a longer period of time, eventually overtaking research articles’ annual online mention counts.
Altmetric disciplinary differences and books
Using the new Fields of Research (FOR) subject categories available in Altmetric (via data supplied by Dimensions), and CWTS’ VOSviewer, it’s possible to visualize disciplinary differences as a network, which can help communicate how the broader impact that books have varies for discipline, and potentially support comparative understanding of a collection of books.
In this diagram, we show how clusters of books form around different sources of broader impact. Blog and news mentions are closely related, and form an important central point in the graph. Policy mentions are most associated with Education, Economics, Environmental Sciences and other Humanities. Wikipedia is well-balanced across the disciplines, while patents are particularly important in Biological Science, Chemical Sciences, Engineering, Computing and Technology.
Network visualizations and analyses can produce compelling evidence of publishing catalogs and provides benchmarks against which a list’s potential for broader impact can be evaluated. For example, a publisher of Arts and Humanities monographs might reasonably expect to see Wikipedia attention, and rather less patent citations.
Monographs from different subject areas attract attention from different sources. VOSviewer creates clusters of similar data, identified by colour and position. Strength of relationship is shown by thickness of line. Relative strength of activity is shown by the size of the type and circle. For example, we see that Chemical Sciences, Information and Computing Science, Technology and Engineering cluster around Patents. VOSviewer suggests that news and blogs (the red circle, slightly overlapping with the News circle) are tightly related for books. Policy documents are represented by the red circle between Environmental Sciences, Economics and Medical and Health Sciences.
Open Access monographs may have an altmetrics edge
Digital Science’s Head of Metrics Development, Mike Taylor, reports that evidence also suggests that there is a marked advantage for open access (OA) monographs over traditional, toll access books, with Altmetric coverage being significantly higher for OA monographs in some disciplines.
It’s important to note that this observation is across a relatively small set of books, and further research is needed. Mike is going to be undertaking further analysis and will present findings at the forthcoming LATmetrics event in Peru in early November, with a paper soon to follow.
(If you’re interested in studying this topic or other themes related to altmetrics for monographs, check out our free data access options for researchers.)
To ensure the future success of books within the scholarly environment, it’s necessary to understand their unique contribution to scholarship, as well as the distinctive ways in which they achieve impact.
It has been long established that books are generally slow to accrue citations – with the implication that short periods of evaluation are inappropriate for books (and monographs in particular). Similarly, Altmetric data has been shown to accrue more slowly for books than research articles, however that impact – when it does accrue – appears to be at a higher rate than articles, and possibly over a long period of time. Institutions, funders and evaluation professionals should be mindful of the value of books, when it comes supporting their future funding, development and assessment.
We are at the beginning of understanding the data that allows this deeper understanding of book impact and look forward to supporting book publishers and academics for home books are their key output, especially those in the humanities, social sciences and arts.
Please get in touch with us if you would like to receive a consultation about the altmetrics data we’ve tracked for your book portfolio. You can also join us on November 14th for the first in our series of expert-led Altmetric book club online workshops to learn more about the insights Altmetric data can provide for book editors.
- “Web indicators for research evaluation. Part 3: books and non standard outputs”, Kayvan Kousha & Mike Thelwall, El Profesional de la Información, 2015.
- “Altmetrics for books: a guide for editors”
- “The Story Behind Altmetric for Books”