Après aDORe, l'équipe à Herbert (ces Belges d'Amérique, tout de même) a encore un peu secoué les plus de 300 participants de l'OR 2008. Cette fois, avec une remise en question assez audacieuse de la bibliométrie/scientométrie à la façon d'ISI.

En gros, ce dont nous aurions besoin, ce sont des mesures basées sur deux ensembles, à savoir d'une part les usage data (données d'utilisation, sur des corpus plus larges que les seules revues recensées par ISI) et d'autre part des network metrics (c'est-à-dire, pour faire très court, les comportements des utilisateurs sur le web).
Les mesures bibliométriques ne se baseraient plus seulement sur les citations, mais sur une trilogie de mesures: l'usage, les citations, les données bibliographiques.

Bollen, Johan and Van de Sompel, Herbert (2008) MESUR: implications of usage-based evaluations of scholarly status for open repositories. In: Third International Conference on Open Repositories 2008, 1-4 April 2008, Southampton, United Kingdom.

- Résumé de la présentation (pdf)
- Site web
- Documentation
- Publications

The MESUR project at the Digital Library Research and Prototyping team of the Los Alamos National Laboratory's was funded by the Andrew W. Mellon Foundation to investigate the possibilities of usage-based scholarly evaluation metrics. MESUR's investigation is conducted on the basis of a large-scale reference data set that combines usage, citation and bibliographic data obtained from a wide variety of publishers, aggregators and institutions. Scholarly evaluation is at this point mostly conducted on the basis of metrics based on citation statistics, e.g. article citation counts, the Impact Factor and the h-index. Although citation data, possibly due to its origin in the published, peer-reviewed literature, has acquired an aura of validity and reliability, a number of shortcomings have been repeatedly identified that affect open repositories. Publication delays can cause citation data to lag scholarly developments by significant periods of time leading to an under appreciation of services that shorten the scholarly communication cycle. Most importantly, citation data frequently ignores the growing body of grey literature or non textual scholarly objects that exist outside the realm of scholarly journals and can thus not assess the growing impact of scholars that publish their research outside the limited set of journals tracked by Thomson Scientific or any particular commercial publisher collections. It has become apparent from the evolving MESUR research that usage data, in particular when aggregated across a multitude of scholarly information sources, is a promising complement to traditional citation data. This is particularly true for open repositories.

[ MESUR = MEtrics derived from the Scholarly Usage of Resources ]