Have you ever wondered how to use altmetrics to enhance a CV, grant application, presentation, or report? This blog post will give you some ideas and examples of how you can communicate the attention your work is receiving online, including:
- How to write about your research impact in a narrative format
- How to summarize attention using bullet points
- How to use altmetrics in reference lists
What is impact?
First, it is important to consider how you define impact. Impact is a word that gets thrown around a lot, but what does it actually mean? What does it mean to you? What does it mean to your boss? What does it mean to the organization funding your research? Unfortunately, a lot of people and organizations don’t have a set definition, but it’s good to think about, especially as more and more people are asked to create dissemination plans and plans to evaluate the impact of their work.
Here are some different ways of categorizing impact and how Altmetric can help:
- Academic impact: many people use citations and citation-based metrics as proxies for academic impact. At Altmetric, we track Faculty Opinions and Publons. These online communities participate in post-publication peer review, which you can use to see how other experts in your field respond to your work.
- Global impact: In Altmetric Explorer, you’ll see heatmaps of global attention for news, Twitter, Facebook, and policy sources. This can help you identify where in the world people are discussing your research.
- Impact on innovation: Altmetric tracks mentions in patent applications. This can be really useful to see how your research is leading to new innovations!
- Impact on policy: You can also see where your work is being cited in policy documents and guidelines, which can help you make the case that your research is influencing real-world changes.
- Impact on public discourse: At Altmetric, we also track social media sources Twitter, Facebook, and Reddit. It can be very interesting to see these diverse and far-reaching conversations about your work!
One final, very important note about impact before jumping into some examples: Altmetric attention does not equal impact in and of itself. Rather, altmetrics can help you discover pathways to impact. Altmetric data comes in handy in space between the outputs and impact, and you can use Altmetric Explorer to help you gather evidence to underpin the impact and add to your narrative. Let’s take a closer look…
How to write about your impact in a narrative format
Here are some tips to keep in mind when writing your narrative:
- Use plain language; avoid jargon
- Add context when you can, e.g. in addition to listing the number of news outlets, give a bit more detail like which news outlets are sharing your work or what the headlines are
- Don’t use the Altmetric Attention Score unless you provide more context
- What kind of impact are you trying to describe?
- Global impact – consider highlighting the number of countries your work has been shared in
- Academic impact – consider highlighting post publication peer reviews
- Public impact – look to news, social media, wikipedia, etc.
If you click the link above, you’ll be taken to the Altmetric Details Page for this output where you’ll see all of the mentions this output has received online, including:
- 16 news mentions
- 2 policy mentions
- 125 twitter mentions
If I follow the links in the Details Page, I learn that this output has been mentioned in a guideline from the National Institute for Health and Care Excellence, as well as news stories by NPR and Reuters. How do I create a story about this attention? Here is one example:
“This work informed non-complex fracture guidelines from the National Institute of Health and Care Excellence recommending that pediatric patients receive ibuprofen to manage mild to moderate pain. More broadly, this research has influenced conversations in mass media surrounding opioid addiction; it has also been described on social media as ‘practice changing’ research by clinicians and government officials, evidencing the dissemination of this work to audiences beyond academia.”
Or here is a shorter version:
In addition to being cited 71 times, this paper has been mentioned in 16 news outlets including NPR and Reuters. It was also cited in the non-complex fracture guideline from the National Institute of Health and Care Excellence.
Example 2: Randomized Trial of Peanut Consumption in Infants at Risk for Peanut Allergy
Again, if you click the link above you’ll see the Altmetric Details Page where you’ll discover that this output has led to changes in policy, changes in industry, and changes in clinical practice. Here is an example narrative impact statement:
“This work led to sweeping reversals on policy regarding introducing allergens to children. This work has also influenced public discourse on the topic, and the results have been shared widely on Twitter, clinicians’ Facebook pages, and mass media outlets including The New York Times and Washington Post, suggesting public awareness of this topic and translation to practice.”
How to summarize attention using bullet points
Oftentimes, you won’t have the space to write out a nice paragraph summarizing the impact of your work in a narrative format. Here are a variety of ways to incorporate altmetrics into short statements:
- Of my papers published in the last 10 years, 79% have received Altmetric attention.
- My work has been mentioned in 1,781 news stories in 45 countries, including:
- 20 stories in the New York Times
- 18 stories in The Conversation
- 16 stories in BBC News
- My work has influenced 88 policy documents in 8 countries, including government organizations in:
- United Kingdom
- United States
- Netherlands
- Australia
- This paper was tweeted over 100 times in more than 15 countries, including by a women’s health center in South Africa that disseminates information to our target population.
- This paper is in the 95th percentile of all JAMA papers tracked by Altmetric.
- This publication has been tweeted over 3,100 times by over 2,550 users with an upper bound of 19 million followers.
- This publication has been tweeted in 73 countries, most frequently by tweeters in the US, Canada, and Japan.
- The most prominent twitter accounts (by twitter follower count) to share this publication include MSNBC host Chris Hayes, Atul Gawande, White House Chief of Staff Ronald Klain, and scientist Eric Topol.
How to use altmetrics in reference lists
You can also consider adding metrics to the end of your references. This is a space-saving way to sneak in some metrics when space is at a premium. You could do this on your CV or even in the reference list for a grant application. Here is an example (the added metrics are bolded):
Reference List
- Randomized Trial of Peanut Consumption in Infants at Risk for Peanut Allergy, NEJM, Feb 2015. 25705822. Q1 journal; RCR: 47; 377 news stories (WoS; Dimensions; Altmetric)
- Impact of peanut consumption in the LEAP Study: Feasibility, growth, and nutrition, The Journal of Allergy and Clinical Immunology, October 2016. 27297994. Q1 journal; 134 news stories, 7 patent mentions (WoS; Altmetric)
- Association of Staphylococcus aureus colonization with food allergy occurs independently of eczema severity, The Journal of Allergy and Clinical Immunology, August 2019. 31160034. 61 news stories, 133 tweets (Altmetric)
- Effect of Avoidance on Peanut Allergy after Early Peanut Consumption, NEJM, April 2016. 26942922. RCR 14; 7 patent mentions (Dimensions; Altmetric)
The above examples include both citation-based metrics (journal quartiles and the Relative Citation Ratio or RCR) and altmetrics. It is best practice to list where you got the information, e.g. Dimensions, Altmetric, etc. Learn more about different metrics using the Metrics Toolkit.
Finally, you’ll notice that the Altmetric Attention Score is not used in any of these examples! The Altmetric Attention Score is an indicator that helps you pick out where your research is being mentioned online. However, the score alone does not provide additional important context like where these conversations are happening and who is talking about your work. The power of altmetrics lies in the details, so be sure to keep that in mind as you start writing impact statements of your own!
If you would like to learn more about these examples or how to use Altmetric tools and data, please contact [email protected].
Discover key moments from our webinar here, or watch the full version here.
To mark the occasion and to contribute to the discussion we had a look into the publication age of researchers that are publishing in the ‘Climate Action’ space with papers relating to SDG 13.
Publication age refers to the years between an author’s first publication and their most recent publication. For example, if someone published their first paper in 2002, and their most recent one in 2018, their publication age would be 17 years (=2018-2002+1).
Once we had a breakdown of publication age, we split this by gender (based on the author’s first name only), so you can see from the graph below that researchers with a higher publication age are predominantly male, but the data towards the bottom of the graph could show an encouraging trend.
For those researchers with a higher publication age, the trend points in the direction of the demographic being predominantly male, however when we look at researchers with ‘younger’ publication ages, we see the breakdown beginning to balance somewhat – suggesting that female researchers are becoming more prominent in this field and the demographic is starting to become more equal.
We also looked at papers associated with a few more SDGs, to see if there was an overarching trend when looking at publication ages and gender.
SDG 8: Decent Work and Economic Growth
We were pleased to see that the trend for researchers and their publication ages for SDG 8: Decent Work and Economic Growth was also encouraging, showing similarities to the demographic shown for climate action papers.
As the publication ages become ‘younger’, the breakdown between male and female researchers becomes more balanced. Suggesting that as Agenda 2030 becomes the focus for many researchers all over the world, male and female – we could expect to see a more balanced demographic of paper authors in terms of gender.
SDG 5: Gender Equality
As this investigation was primarily to mark International Women’s Day, we also had a look at the papers and authors associated with SDG 5: Gender Equality.
In this field, closely related to Gender Studies, we expect to find more women than men researchers, which is true in most publication ages; the trend is reversed for researchers with 30 years or more of publication history.
This could reflect the fact that 30 years ago, the position of researchers was still predominantly a man’s position. Now that academic research is perhaps more accessible to women, the balance has reversed and more women are doing research on gender equality.
Overall, our small investigation into some of the data associated with SDG related papers highlighted some promising trends.
Across the analysis we did, the demographics were becoming more equal between male and female authorship as we moved to the ‘younger’ publication ages. Interestingly though, the field in which we saw a continued unbalanced demographic was Gender Equality….
As with all data investigation, some nuance is required. It’s important to mention that although when we look at the data above we see the proportion of female researchers growing in the younger publication age fields and this could indicate a positive trend, it could also confirm a well known fact. Statistically speaking, many women leave academia and their research careers earlier due to having children and therefore their publication ages are often significantly ‘younger’, as they don’t publish in their respective fields for the time spans that we regularly see from their male counterparts.
We hope that everyone had a wonderful International Women’s Day and enjoyed participating in all the wonderful discussions that happened across the globe!
This thoughtful analysis was undertaken by Hélène Draux, Data Scientist in the Digital Science Consultancy Team.
Our Head of Data Insights, Mike Taylor, recently sat down with Alexander Schacht for an episode of ‘The Effective Statistician’ podcast. You can listen to the episode here.
During the episode, Mike and Alexander discuss Altmetric and Dimensions and the importance of understanding the reach and influence of clinical and scientific research beyond citations and understanding the full journey, from idea to impact.
Alexander and Mike touch on a number of interesting topics during the interview, including how Altmetric and Dimensions work together in uncovering this journey, but also the insights that can be gleaned from the kind of data the tools provide.
‘I get to sit in the middle of this wonderful web with both Dimensions data and Altmetric and I pull the two things together. And together, I can create these translational maps of where research is going from the laboratory through to the hospital and into the broader population.’ – Mike Taylor
The discussion also touches on Key Opinion Leaders and how using Altmetric and Dimensions data, links can be identified and groups of the influential leaders in different research spheres can be discovered.
When diving into the research landscape of a particular Therapeutic Area or clinical research focus, getting the low down on who is authoring with whom, and who is ‘leading the pack’, is crucial.
Mike and Alexander also discuss how having this kind of insight into the dissemination and ‘journey’ of research provides ‘organizational wisdom’ that can enhance foresight, competitor analysis or benchmarking and importantly, inform outreach and publication strategies.
Don’t miss this exciting discussion all about the actionable insights that Altmetric and Dimensions data can provide…
‘The end of the story is not the publication. The end of the story is how it’s picked up.’ – Alexander Schact
Find out more: