altmetrics14: expanding impacts and metrics

ACM logo

An ACM Web Science Conference 2014 Workshop



  • Register now for Web Science. Registration ends June 17.
  • The Accepted Papers are up. We encourage you to comment on the papers on figshare before the workshop. Tweet with the url of the paper and #altmetrics14 these should get picked up as well.


  • Euan Adie  – founder
  • Henk Moed  – senior scientific advisor Elsevier, former Professor of Research Assessment Methodologies, Leiden University

Accepted Papers





Opening remarks by the workshop committee

Session 1



Keynote: Henk Moed, Elsevier

Altmetrics as traces of the computerization of the research process (slides – pdf)


Keynote: Euan Adie, Altmetric

Altmetrics in practice



Session 2

Altmetrics in action


Disentangling the meaning of ‘altmetrics’: content analysis of Web of Science scientific publications – Rodrigo Costas, Zohreh Zahedi and Paul Wouters


Scholarometer: A system for crowdsourcing scholarly data – Jasleen Kaur, Mohsen Jafariasbagh, Filippo Radicchi and Filippo Menczer (slides)


Exploring altmetrics in an emerging country context – Juan Pablo Alperin (slides)


An analysis of Wikipedia references across PLOS publications – Jennifer Lin and Martin Fenner (slides)



Session 3



Measuring Twitter activity of arXiv e-prints and published papers – Stefanie Haustein, Timothy D. Bowman, Benoît Macaluso, Cassidy R. Sugimoto and Vincent Larivière (slides)


The impact of retweeting on altmetrics – Kim Holmberg (slides)


Dissemination of scholarly literature in social media – Pablo Moriano, Emilio Ferrara, Alessandro Flammini and Filippo Menczer (slides)



Session 4



How consistent are altmetrics providers? Study of 1000 PLOS ONE publications using the PLOS ALM, Mendeley and APIs – Zohreh Zahedi, Martin Fenner and Rodrigo Costas (slides)


JASIST@Mendeley Revisited – Judit Bar-Ilan


Coffee break

Session 4

Crowdsourcing, standards and future directions


Visualizing readership activity of Mendeley users using VOSviewer – Zohreh Zahedi and Nees Jan Van Eck


Brainstorming community needs for standards & best practices related altmetrics – Todd Carpenter, Nettie Lagace and Martin Fenner (slides – pptx)


Discussion/open session

About the Workshop

Altmetrics intend to measure scholarly impact that is not necessarily captured by traditional, citation based metrics. These measures are mostly derived from the Web and social media. Altmetrics have already started to become a part of today’s scholarly communication and the measurement of its impact. Scientific journals are increasingly providing the number of tweets, Facebook likes and Mendeley readers as well as other social media mentions. At the same time, researchers begin to present altmetrics in their CVs and universities and funders are starting to consider the use of social media metrics to better understand the impact of their scientific output. However, the particular meaning, usefulness and validity of the different metrics is still not fully understood. Against this background, we particularly invite contributors and workshop participants to discuss the validity and meaning of social media metrics in scholarly context.

The goal of this year’s workshop is to provide a platform to present scholarly research related to altmetrics. The main goal of the workshop is to improve the understanding of altmetrics and their underlying social media platforms, technological challenges, various biases involved in data, as well as pitfalls and possibilities of these new metrics.

The workshop invites contributions on altmetrics research with particular focus on the following topics:

  • conceptualization and theoretical framework(s) for altmetrics;

  • critical reflection of altmetrics;

  • altmetrics data: sources, quality and problems;

  • techniques for collecting, monitoring, retrieving and visualizing altmetric data and measures;

  • relation between altmetrics and big data;

  • meaning, possibilities and limitations of altmetrics in research evaluation contexts;

  • relationship and complementarity of altmetrics with other measures of research impact (e.g. bibliometrics and peer review); and

  • disciplinary, temporal, institutional and individual case studies involving altmetric indicators.

This workshop is a follow-up to the successful altmetrics11 and altmetrics12 workshops held at previous ACM Web Science conferences (Koblenz, 2011 & Evanston, 2012). It will encourage collaboration and cross-pollination between research and practice, combining academic paper presentations with group discussions.

Important Dates

  • 2-page abstracts due: April 20, 2014 May 2, 2014
  • Notification of acceptance: May 20, 2014
  • Publication of abstracts: May 31, 2014
  • Open pre-workshop discussion: June 1 – June 21, 2014
  • Workshop at WebSci 2014: June 23, 2014
  • Discussion closed: June 30, 2014


Prospective authors should submit 2-page extended, structured abstracts (max. 1000 words, not including references) via EasyChair. Submissions should present new results and original work that has not been previously published. The workshop organizers will select the most relevant, original, and significant abstracts for presentation. Empirical results will be given preference, followed by technical reports on working altmetrics tools and position papers. All selected submissions will be published online for open peer review and discussion. Authors are encouraged to participate in the discussions of their wor kbefore the workshop. Based on the presentations and online discussion, selected authors may be asked to submit full papers for the PLoS ONE Altmetrics collection or peer-reviewed proceedings.

Accepted submissions should be uploaded to figshare, to be linked to the workshop website.


The workshop is hosted by the ACM Web Science Conference 2014 (Bloomington, Indiana). This interdisciplinary conference focuses on advances in studying the full range of social-technical relationships on the Web. Please visit the conference website for more information.

Registration fees

The workshop is free for registered participants of WebSci14: