Standards in Altmetrics

Find out more about altmetrics best practice

Why is there a need for standards?

As more and more publishers, funders and institutions start to look to altmetrics to provide additional insights about the reach and influence of their work, it’s important that everyone can understand where these data come from and how they are maintained.

The impetus to be transparent about how the data are collected and presented sits with altmetrics providers, of which Altmetric is one. Beyond supporting best practices (such as those laid out in the Leiden Manifesto) we’re committed to providing the best possible quality data, and to being transparent about how it is collected and displayed.

The development of standards

NISOIn June 2013 the Sloan Foundation awarded NISO (the National Information Standards Organisation) a grant to undertake a two-phase initiative to explore, identify, and advance standards and/or best practices related to a new suite of potential metrics in the community.

Altmetric’s Founder Euan Adie and Product Development Manager Jean Liu were part of the working groups convened by NISO to formulate proposed codes of conduct for altmetrics data and providers.

The NISO website states:

“This project is an important step in the development and adoption of new assessment metrics, which include usage-based metrics, social media references, and network behavioral analysis.”

The groups met virtually over a period of months to determine and agree the scope of what they would recommend, and the draft guidelines and codes of conduct.

In September 2016 NISO released the final outputs from the initiative.

What do the standards cover?

NISO convened 3 working groups to discuss and tackle to challenge of setting standards for altmetrics:

Working Group A: Definitions & Use Cases

This working group extensively studied the altmetrics literature and other communications and discussed in depth various stakeholders’ perspectives and requirements for these new evaluation measures. Altmetric Product Development Manager Jean Liu was part of this group.

Working Group B: Output Types and Identifiers

This working group investigated alternative research outputs and application of persistent identifiers in the scholarly environment in order to clearly identify and track research outputs and their relationships.

Working Group C: Data Quality

This working group studied and discussed issues of data quality in the altmetrics realm, an essential aspect of evaluation before metrics can be used for research and practical purposes. Altmetric’s Founder Euan Adie was part of this group.

 

The final version of recommended practice from the NISO Alternative Assessment Metrics Project is now available to download here.

Our Compliance

Screen Shot 2016-06-02 at 16.37.39Altmetric data meets all guidelines laid out in the NISO Data Quality Code of Conduct (in fact we were the guinea pig for its development!)

You can view and download our report here.

Engaging with the community

Beyond the work we’ve been involved in as part of the NISO Altmetrics project, Altmetric as a company does a lot of work with researchers and the wider community to make our data available and help advance discussion and transparency in altmetrics. This includes:

  • Making our data freely available for research purposes

    All Altmetric data is available for any researchers who wish to use it to conduct bibliometrics studies, often resulting in publication or conference presentations.

  • Publishing the underlying data behind any studies we release

    We’re committed to making all of our own publications and supporting data open access – you can find it all on figshare.

  • Launching an Annual Research Grant

    In 2016 we launched an annual research grant to further studies in the field.

  • Supporting the Altmetric Ambassador program

    In 2015 we launched the Altmetric Ambassador program, and now work closely with a group of over 200 Ambssadors around the world to educate and encourage best practice use of altmetrics.

  • Recruiting an independent advisory board

    Run as part of our product development activities, we meet virtually and in-person with our independent expert advisory board to ensure we’re developing our tools to best meet user needs.

  • Working closely with external development partners

    Several external development partners are recruited as beta-testers or development partners for every new product we build. Their feedback is taken on board throughout the development process to ensure everything is done to the highest possible standard.

Further reading

Here are some useful readings that offer further information on the background and current activities of the NISO altmetrics project and Altmetric’s involvement in it: