Discussion papers
All available ranking outlet lists, articles on different quantitative indicators and some other general information on bibliometrics are available here.
| Information on a range of topics including: | Discussions on qualitative indicators for: |
|---|---|
|
Ranking systems and lists
Ranking systems
- Journal rankings (staff access only)
- The Eigen Factor is another
ranking system for ranking the quality and impact of journals. It is similar
to Thomson's Impact Factor however claims to have the benefits of:
- using an entire network of citations rather than local citations (much the same way Google ranks websites)
- correcting for citation differences between disciplines
- using a five year citation data set
- including journal article prices.
In theory Eigen Factor should take into account the quality of the citing journals not just the number of citing journals. Eigen Factor searches are completely free. Have a look at the Eigen Factor and compare it to Impact Factors and to your knowledge of the journals in your field.
If you have any comments on the Eigen Factor please email michael.crisp@unisa.edu.au
Articles
- Butler, L. (2006). Research assessment: moving beyond journal outputs, SPRU 40th Anniversary Conference - The Future of Science, Technology and Innovation Policy - University of Sussex.
- Butler, L. and Visser, M.S. (2006) Extending citation analysis to non-source items, Scientometrics. 66 (2), 327-343. (Available from SpringerLink)
- Caldwell, T. (2006) ISI users tracking research evolution, Information World Review, March, 4.
- Caldwell, T. (2006) Scientific publishing giants focus on Author ID, Information World Review, 10 Jul 2006.
- Clarke, Roger (2007) An exploratory study of information systems researcher impact (RTF file, 633kb).
- Council of Australian University Librarians, Bibliometrics and Research Quality Framework Performance Indicators Forum, UNSW, 1 May 2006.
- Hirsch, J. E. (2005) An index to quantify an individual's scientific research output (PDF file, 274kb), Proceedings of the National Academy of Sciences (PNAS), 102
- Jasco, P. (2005) As we may search: comparison of major features of the Web of Science, Scopus, and Google Scholar citation-based and citation-enhanced databases, Current Science, 89 (10), 1537-1547. (PDF file)
- Moed, H.F. (2005) Citation Analysis in Research Evaluation. Dordrecht: Springer, 3. Executive summary (PDF file)
- Pauly, D. and Stergiou, K.I. (2005) Equivalence of results from two citation analyses: Thomson ISI's Citation Index and Google's Scholar service, Ethics in Science and Environmental Politics, 33-35. (PDF file)
- Perneger, T. V., (2004) Relation between online 'hit counts' and subsequent citations: prospective study of research papers in the BMJ, BMJ, 329, 547.
- Pringle, J. (2005) Thomson Scientific launches web citation index: new scholarly index directs researchers to valuable content from repositories.
- Quint, B. (2006) Elsevier's Scopus introduces citation tracker: challenge to Thomson ISI's Web of Science?
- Research Evaluation and Policy Project. Quantitative indicators for research assessment – a literature review
- Thomson Scientific, (2004) The Thomson Scientific journal selection process.
- Valadkhani, Abbas and Ville, Simon (2006)
Modelling the research
output of Australian universities by discipline, University of
Wollongong Economics Working Paper Series 2006 (PDF file, 112kb).
Impact factors
- Amin, M. and Mabe, M. (2000) Impact factors: use and abuse, perspectives in publishing. (PDF file)
- Bollen, J., Van de Sompel, H., Smith, J., and Luce, R. (2005) Toward alternative metrics of journal impact: a comparison of download and citation data, Information Processing and Management, 41 (6), 1419-1440.
- Dong, P, Loh, M and Mondry, A (2005) The "impact factor" revisited.
- Garfield, E. (2005) The agony and the ecstasy: the history and meaning of the journal impact factor. (PDF file)
- Hopkins, W.G. (2004) Impact factors of journals in sport and exercise science, 2000-2003.
- Kipnis, D. (2002) Criticisms and limitations of impact factors, Jeffline Forum.
- Martyn, Christopher, Advice to a new editor - BMJ 2007; 334:586 (includes links to related articles).
- Monastersky, R. (2005). The number that's devouring science. The Chronicle of Higher Education, 52(8), A12-20.
- Nature (2005) Not-so-deep impact, Nature, 435, 1003-1004.
- Seglen, P. O. (1997) Why the impact factor of journals should not be used for evaluating research, British Medical Journal, 314 (7079), 498-502.
- Sevinc, A (2004) Manipulating impact factor: an unethical issue or an editor's choice? Swiss Medical Weekly, 134:410. (PDF file)
- Sombatsompop, N and Markpin, T (2005) Making an equality of ISI impact factors for different subject fields, Journal of the American Society for Information Science and Technology, 56, 7, 676-683
- Thomson Scientific (2006) The ISI impact factor.
- Whitehouse, G .H. (2001)
Citation rates and
impact factors: should they matter? British Journal of Radiology.
74:1-3
Citations and open access publications
- APSR, (2006) RQF and Repositories. Helpful documents and Australian Partnership for Sustainable Repositories flier (PDF file)
- Antelman, K. (2004) Do open access articles have a greater research impact? College & Research Libraries News, 65 (5), 372-382.
- Brody, T., Harnad, S. and Carr, L. (2006) Earlier web usage statistics as predictors of later citation impact. Journal of the American Association for Information Science and Technology (JASIST) 57(8) pp. 1060-1072.
- Harnad, S., Carr, L., Brody, T., & Oppenheim, C. (2003). Mandated online RAE CVs linked to university eprint archives: Enhancing UK research impact and assessment. Ariadne, 35.
- Odlyzko, A. (2006) Economic costs of toll access in Jacobs, N., Open Access: Key Strategic, Technical and Economic Aspects, Oxford: (Chandos Publishing: Oxford), 17 July 2006. (PDF file) and website
- Sale, A. (2005) Citations.
- Shadbolt, N., Brody, T., Carr, L., and Harnad, S. (2006) The open research web: a preview of the optimal and the inevitable, in Jacobs, N., Ed., Open access: key strategic, technical and economic aspects, Chandos.
- The effect of
open access and downloads ('hits') on citation impact: a bibliography of
studies.
International scholarly publishing
- Bayers, N. K. (2005) Geography of journal publishing. (ppt presentation)
- Goodfellow, J. (2006) Research Councils welcome new report on high impact of UK research.
- Jaschik, S. (2005) Radical change for tenure, Inside Higher Ed, December 30.
- Jiménez-Contreras, E., Anegón, F.M. and López-Cózar, E.D. (2003) The evolution of research activity in Spain: the impact of the National Commission for Evaluation of Research Activity (CNEIA), Research Policy, 32 (1), 123-142. (Available from Science Direct)
- Mabe, M. (2003) What do authors care about. Paper presented to the 2003 Oxford Fiesole Conference. (ppt presentation)
- Mabe, M: (2003) The growth and number of journals. Serials, 16:191-197. (PDF file)
- Mulligan, A., and Mabe, M. (2006) Journal futures: researcher behaviour at early internet maturity. UKSG conference, April. (PDF file)
- Rowlands, I. and Olivieri, R. (2006) Journals and scientific productivity. London: PRC.
- UNESCO Institute for Statistics. (2005)
What do
bibliometric indicators tell us about world scientific output? UIS
Bulletin on Science and Technology Statistics. Sept, (2) (PDF file)
University ranking tables
- Chapman, Simon, Professor of Public Health, University of Sydney, Australia punching well above its weight in international research, (RTF file, 60kb)
- Dill, D and Soo M (2005) Academic quality, league tables and public policy, Higher Education, 49, pp. 495-533 (PDF file)
- Figel, J, (2006) Commissioner for Education, Training, Culture and Multilingualism Speech, Launch of 'The Future of European Universities: Renaissance or Decay?' By Richard Lambert and Nick Butler, Brussels, 18 July 2006
- Marginson, S. (2006) Australian universities in the global context. Paper presented at the Australian Financial Review Higher Education Summit, 22-23 March 2006. (Word doc)
- Shanghai Jiao Tong University. (2005) Academic ranking of world universities. Shanghai Jiao Tong University, Institute of Higher Education.
- Van Raan, A. F. J. (2005) Challenges in ranking of universities. Paper presented at the First International Conference on World Class Universities. Shanghai Jiao Tong University, June 16-18 2005. (PDF file)
- Van Raan, A. F. J. (2005) Fatal attraction: conceptual and methodological problems in the ranking of universities by bibliometric methods, Scientometrics. 62 (1), 140. (Available from SpringerLink)
- Williams, R. (2005).
Broadening the Criteria: Lessons from the Australian Ranking. Paper
presented at the First International Conference on World Class Universities.
Shanghai Jiao Tong University, June 16-18 2005. (PDF file)
Research Assessment Exercise (RAE) - UK
- Adams, J. (2006) Research assessment and UK publication patterns - to access this journal click on the heading Serials: The Journal for the Serials Community then go to Volume 19, Number 2 / July 2006
- Sastry, T. & Bekhradnia, B. (2006) Using metrics to allocate research funds - a short evaluation of alternatives to the Research Assessment Exercise, Higher Education Policy Institute, UK.
- Sundry overview papers: UK Higher Education Policy Institute: Research Funding and Assessment: Beyond 2008 21 June 2006, The Royal Society, London.
- Roberts, G. (2004)
Research frameworks for excellence
- global perspectives (ppt presentation), NSCF seminar, Canberra, 1
June.
Business
- de Bakker, F. G. A, Groenewegen, P and den Hond, F. A research note on the use of bibliometrics to review the corporate social responsibility and corporate social performance literature. Business and Society, 45, 1, 7- 19.
- Danell, R (2000) Stratification among Journals in Management Research: A Bibliometric Study of Interaction between European and American Journals, Scientometrics. 49, 1, 23-38. (Available from SpringerLink)
- Visser, M.S., Nederhof, A.J. and van Raan, A.F.J. (2003)
Bibliometric Profiles of Management Research at the Erasmus University
1999 - 2001. Research report to the Erasmus Research Institute of
Management (ERIM), Erasmus University, Rotterdam, the Netherlands, March
2003, Leiden: Center for Science and Technology Studies (CWTS).
Computer and information sciences
- Monash University,
ICT Conference rankings - for computer science, software engineering &
other subdisciplines (NICTA and ANU). (Other
journal and conference ranking lists for
various Computer science related subjects)
Creative arts
- Coryn, C. L. S. (2006) The use and abuse of citations as indicators of research quality. Journal of MultiDisciplinary Evaluation. 4, June, 115-121. (PDF file, 44kb)
- Woodrow, R. (2005) The irrelevant consumers of culture. ACUADS 2005 Conference, Artists, designers and creative communities, School of Contemporary Arts, Edith Cowan University, Perth, Western Australia. 28-30 September 2005. (PDF file)
- McCalman, I. (2004) Excellence in the humanities, creative arts and media. National Academies Forum, Measuring excellence in research and research training, Canberra.
- Schippers, H. (2006)
The measure of creativity. The Australian Higher Education
Supplement. 4 October, 2006
Economics
- Donovan, C. and Butler, L. (2005) Testing quantitative indicators of the quality and impact of research in the social sciences: a pilot study in Economics, REPP Discussion Paper 05/2, September.
- Harzing, A-W, (2005)
Australian research output in Economics and Business: high volume, low
impact? Australian Journal of Management, 30, 2, 183-200. (PDF
file)
Humanities and social sciences
- AHRC. (2006) Notes from the meeting to discuss metrics in the arts and humanities - Warwick 25/09/06. Meeting to discuss metrics in the arts and humanities. Monday 25th September 2006. Ramphal Building, University of Warwick
- Allen Consulting Group (2005) Establishing an Australian Research Quality Framework. Summary of discussion from the Australian Academy of the Humanities workshop. Report to DEST. (RTF file)
- Altbach, P. G. (2006) The tyranny of citations. Inside Higher Ed, May 8.
- Archambault, É. and Gagné, É. V. (2004) The use of bibliometrics in the social sciences and humanities. Science-Metrix Final Report. Social Sciences and Humanities Research Council of Canada (SSHRCC), Science Metrics, Montreal, Canada. (PDF file)
- Berkowitz, P. (2005) Bibliometric indicators - use with caution. University News, March.
- British Academy. (2005) E-resources for research in the humanities and social sciences - a British Academy policy review.
- CHASS (Council for the Humanities, Arts and Social Sciences) (2005) Measures of quality and impact of publicly-funded research in the humanities, arts and social sciences. Canberra: CHASS
- Donovan, C. (2005) A review of current Australian and international practice in measuring the quality and impact of publicly funded research in the Humanities, Arts and Social Sciences. REPP Discussion Paper 05/3, November
- European Science Foundation (2006), European Reference Index for the Humanities (ERIH). A project ranking top journals and books
- HEFCE (2006) HEFCE and AHRC announce expert group on research metrics. UK project on metrics-based assessment for arts and humanities research
- Hicks, D. (2004) The four literatures of Social Science in Moed, H.F., Glänzel, W. and Schmoch, U. (eds), Handbook of Quantitative Science and Technology Research, Netherlands, Kluwer, 474 (PDF file)
- Lewison, G. (2001) 'Evaluation of books as research outputs in history'. Research Evaluation. 10(2), 89-95. (PDF file)
- UK Arts & Humanities Research Council. Quality Assessment - quantitative indicators of quality. Webpage discussing quality indicators.
- van Leeuwen, T. (2006) The application of bibliometric analyses in the evaluation of social science research. Who benefits from it, and why it is still feasible. Scientometrics, 66, 1, 133–154. (Available from SpringerLink)
Information systems
- Clarke, R. (2006)
A
pilot citation analysis of information systems researchers.
Nursing and midwifery
Paleontology
- Riedel, W.R., Polly, P.D. and Hagadorn, W. (2006)
Coming of age:
ISI and Googling.
Women's studies
- Weisbard, P. H. (2002) Ranking women's studies journals, WMST-L.