Home page
DELOS offcial website

About Workpackage
Aims & objectives
DL Evaluation Resources
Testbeds & toolkits
Discussion Forum for WP Members

This work continues the 1st DELOS Network of Excellence Working Group on Evaluation (2000-2002).

Previous Working Group Website


This is a indicative list of papers regarding multiple aspects of the evaluation of digital libraries. This list is sorted alphabeticaly.
Also available in BibTex format.

[ A-G - H-N - O-T - U-Z ]

> A-G

Aramburu Cabo, M.J., Berlanga Llavori, R. [2001], "A temporal object-oriented model for digital libraries of documents". Concurrency and Computation: Practice and Experience, vol. 13, no. 11, pp. 987-1011.

Barton, J. [2004], "Measurement, management and the digital library", Library Review, vol. 53, no. 3, pp. 138-141.

Bates, M.J. [2002], "The cascade of interactions in the digital library interface", Information Processing & Management, vol. 38, no. 3, pp. 381-400.

Bishop, A.P., Van House, N.A., Buttenfield, B.P. [2003], "Digital library use: social practice in design and evaluation", Cambridge, Mass, MIT Press.

Bishop, A.P. et al. [2002], "Digital libraries: situating use in changing information infrastructure", Journal of the American Society for Information Science, vol. 51, no. 4, pp. 394-413.

Blandford, B., Buchanan, G. [2003], "Usability of digital libraries: a source of creative tensions with technical developments",TCDL Bulletin.

Blandford, A., Stelmaszewska, H., Bryan-Kinns, N. [2001], "Use of multiple digital libraries: a case study" in Proceedings of the first ACM/IEEE-CS Joint Conference on Digital Libraries, New York, NY, ACM Press, pp. 179-188.

Bollen, J., Rocha, L.M. [2000], "An adaptive systems approach to the implementation and evaluation of digital library recommendation systems", in Lecture Notes in Computer Science, 1923, Heidelberg, Berlin, Springer-Verlag, pp. 356-359.

Bollen, J., Luce, R. [2002], "Evaluation of digital library impact and user communities by analysis of usage patterns", D-Lib Magazine, vol. 8, no. 6.

Borgman, C.L. [2002], "Challenges in building digital libraries for the 21st century" in Lecture Notes in Computer Science, 2555, Berlin, Heidelberg, Springer-Verlag, pp. 1-13.

Borgman, C.L. et. al, [2000], "Evaluating digital libraries for teaching and learning in undergraduate education: a case study of the Alexandria Digital Earth ProtoType (ADEPT)". Library Trends, vol. 49, no. 2, pp. 228-250.

Bryan-Kinns, N., Blandford, A., Thimbleby, H. [2000], "Interaction modeling for digital libraries" in Proceedings of Workshop on evaluation of information management systems.

Buenaga Rodriguez et al. [2001], "A user model based on content analysis for the intelligent personalization of a news service" in Lecture Notes in Computer Science, 2109, Berlin,Heidelberg, Springer-Verlag, pp. 216-218.

Budhu, M., Coleman, A. [2002], "The design and evaluation of interactivities in a digital library", D-Lib Magazine, vol. 8, no. 11.

Buttenfield, B.P., Kumler, M.P. [1999] "Tools for browsing environmental data: the Alexandria Digital Library interface".

Buttenfield, B. [1999], "Usability evaluation of digital libraries", Science and Technology Libraries, vol. 17, no. 3-4, pp. 39-59.

Chignell, M.H., Gwizdka, J., Bodner, R.C. [1999], "Discriminating meta-search: a framework for evaluation", Information Processing & Management, vol. 35, no. 3, pp. 337-362.

Choudhury, S. et al. [2002], "A framework for evaluating digital library services", D-Lib Magazine, vol. 8, no. 7/8.

Covey, D.T. [2002], "Usage and usability assessment: library practices and concerns"

Covi, L., Kling, R. [2002], "Digital shift or digital grift? Conceptualizing transitions from paper media to electronic publishing and digital libraries in North American universities".

D'Alessandro, D.M., Kreiter, C.D., Peterson, M.W. [2004], "An evaluation of information-seeking behaviors of general pediatricians", Pediatrics, vol. 113, no. 1, pp. 64-69.

Davies, C. [1997], "Organizational influences on the university electronic library", Information Processing & Management, vol. 33, no. 3, pp. 377-392.

Dillon, A. [2001], "Technologies of Information: HCI and the Digital Library", in Carroll, J. (ed.) Human-Computer Interaction in the New Millennium, Addison-Wesley.

Ding, Y. et al. [2000], "Bibliometric Information Retrieval System (BIRS): a web search interface utilizing bibliometric research results", Journal of the American Society for Information Science, vol. 51, no. 13, pp. 1190-1204.

Doubleday, A. et al. [1997], "A comparison of usability techniques for evaluating design" in Proceedings of the conference on "Designing interactive systems: processes, practices, methods and techniques", New York: ACM Press, pp. 101-110.

Durrance, J.C., Pettigrew, K.E. [2001], "Toward context-centered methods for evaluating public library networked community information initiatives", First Monday, vol. 6, no. 4.

Fields, B., Keith, S., Blandford, A. [2003], "Usability evaluation of digital libraries: a tutorial", Middlesex University Interaction Design Centre Technical Report: IDC-TR-2003-001.

Fox, E.A. et al. [1999], "Users, user interfaces, and objects: Envision, a digital library". Journal of the American Society for Information Science, vol. 44, no. 8, pp. 480-491

Franklin, R.A. [2003], "Re-inventing subject access for the semantic Web", Online Information Review, vol. 27, no. 2, pp. 94-101.

Fraser, B.T., McClure, C.R. [2002], "Toward a framework for assessing library and institutional outcomes", Portal: Libraries and the Academy, vol. 2, no. 4. [link to table of contents]

Fuhr et al. [2001], "Digital libraries: a generic classification and evaluation scheme" in Lecture Notes in Computer Science, 2163, Berlin, Heidelberg, Springer-Verlag, pp. 187-199.

Geyer-Schulz, A., Neumann, A., Thede, A. [2004], "Others also use: a robust recommender system for scientific libraries" in Lecture Notes in Computer Science, 2769, Berlin, Heidelberg, Springer-Verlag, pp. 113-125.

Greenstein, D. [2000], "Digital libraries and their challenges", Library Trends, vol. 49, no. 2, pp. 290-303.

back to top

> H-N

Hanani, U., Shapira, B., Shoval, P. [2001], "Information filtering: overview of issues, research and systems", User Modeling and User-Adapted Interaction, vol. 11, no. 3, pp. 203-259.

Heath, F. et al. [2003], "Emerging tools for evaluating digital library services: conceptual adaptations of LibQUAL+ and CAPM", Journal of Digital Information, vol. 4, no 2.

Hill, L.L. et al. [2002], "Alexandria Digital Library: user evaluation studies and system design". Journal of the American Society for Information Science, vol. 51, no. 3, pp. 246-259.

Hollmann, J., Ardo, A., Stenstrom, P. [2004], "An evaluation of document prefetching in a distributed digital library" in Lecture Notes in Computer Science, 2769, Berlin, Heidelberg, Springer-Verlag, pp. 276-287.

Jacobson, F.F., Ignacio, E.N., [1997], "Teaching reflection: information seeking and evaluation in a digital library environment",Library Trends, vol. 45, no. 4, pp. 771-802.

Jones, M.L.W. [1999], "Project Soup: comparing evaluations of digital collection efforts", D-Lib Magazine, vol. 5, no. 11.

Jones, S., Paynter, G.W. [2002], "Automatic extraction of document keyphrases for use in digital libraries: evaluation and applications", Journal of the American Society for Information Science and Technology, vol. 53, no. 8, pp. 653-677.

Kassim, A.R.C., Kochtanek, T.R. [2003], "Designing, implementing, and evaluating an educational digital library resource", Online Information Review, vol. 27, no. 3, pp. 160-168.

Ke, H. et al. [2002], "Exploring behavior of E-journal users in science and technology: transaction log analysis of Elsevier's ScienceDirect OnSite in Taiwan". Library & Information Science Research, no. 24, pp. 265-291.

Kelleher, J. [1997], "Evaluation of the electronic libraries programme" in Proceedings of "Beyond the beginning: the global digital library" an international conference organised by UKOLN on behalf of JISC, CNI, BLRIC, CAUSE and CAUL.

Kengeri, R. et al. [1999], "Usability study of digital libraries: ACM, IEEE-CS, NCSTRL, NDLTD", International Journal on Digital Libraries, no. 2, pp. 157-169.

Kilker, J., Gay, G. [1998], "The social construction of a digital library: a case study examining implications for evaluation", Information Technology and Libraries, vol. 17, no. 2, pp. 60-70.

King, R.J. [2003], "Building the S&T Digital Library at the Naval Research Laboratory: a report", Serials Review, vol. 29, no. 2, pp. 76-82.

Kling, R., Elliott, M., "Digital library design for usability"

Kochtanek, T.R., Hein, K.K. [1999], "Delphi study of digital libraries", Information Processing & Management, vol. 35, no. 3, pp. 245-254.

Kwak B.H. et al. [2002], "A study on the evaluation model for university libraries in digital environments", in Lecture Notes in Computer Science, 2458, Berlin, Heidelberg, Springer-Verlag, pp. 204 - 217.

Lagier, J. [2002], "Measuring usage and usability of online databases at Hartnell College an evaluation of selected electronic resources". Graduate School of Computer and Information Sciences, Nova Southeastern University (PhD dissertation).

Larson, R.R. [2004], "Distributed IR for digital libraries" in Lecture Notes in Computer Science, 2769, Berlin, Heidelberg, Springer-Verlag, pp. 487-498.

Liu, Y.Q., Zhang, J. [2001], "Digital library infrastructure: a case study on sharing information resources in China", The International Information & Library Review, vol. 33, no. 2-3, pp. 205-220.

Ma, W. [2002], "A database selection expert system based on reference librarian's database selection strategy: a usability and empirical evaluation", Journal of the American Society for Information Science and Technology, vol. 53, no. 7, pp. 567-580

Madle, G. et al. [2004], "Evaluating the changes in knowledge and attitudes of digital library users" in Lecture Notes in Computer Science, 2769, Berlin, Heidelberg, Springer-Verlag, pp. 29-40.

Marchionini, G. [2000], "Evaluating digital libraries: a longitudinal and multifaceted view", preprint from Library Trends, vol. 49, no. 2, pp. 304-333.

Marchionini, G., Plaisant, C., Komlodi, A. [1996], "Users' needs assessment for the Library of Congress' National Digital Library". Human-Computer Interaction Laboratory, Center for Automation Research.

McClure, C.R. [2002], "Statistics, measures, and quality standards for assessing digital reference library services: guidelines and procedures". Syracuse, N.Y.; Tallahassee, Fla.: Information Institute of Syracuse, School of Information Studies, Syracuse University; School of Information Studies, Information Use Management and Policy Institute, Florida State University.

Mendonca, E.A., Cimino, J.J., Johnson, S.B. [2001], "Using narrative reports to support a digital library", Journal of the American Medical Informatics Association, pp. 458-462.

Meyyappan, N., Al-Hawamdeh, S., Foo, S. [2002], "Task based design of a digital work environment (DWE) for an academic community", Information Research, vol. 7, no. 2.

Morse, E.L. [2002], "Evaluation methodologies for information management systems", D-Lib Magazine, vol. 8, no. 9.

Nicholas, D., Huntington, P., Watkinson, A. [2003], "Digital journals, big deals and online searching behaviour: a pilot study" in Aslib Proceedings, vol. 55, no.1-2, pp. 84-109.

Norman, F. [1997], "Digital libraries: a quality concept", International journal of medical informatics, vol. 47, no. 1-2, pp. 61-64.

back to top

> O-T

Park, S. [2000], "Usability, user preferences, effectiveness, and user behaviors when searching individual and integrated full-text databases: implications for digital libraries". Journal of the American Society for Information Science, vol. 51, no. 5, pp. 456-468.

Patel, A. [2001], "Access control mechanisms in digital library services", Computer Standards & Interfaces, vol. 23, no. 1, pp. 19-28.

Peterson, E. [2005], "Evaluation of digital libraries using snowball sampling", First Monday, vol. 10, no. 5.

Rapp, D.N., Taylor, H.A., Crane, G.R. [2003], "The impact of digital libraries on cognitive processes: psychological issues of hypermedia", Computers in Human Behavior, vol. 19, no. 5, pp. 609-628.

Roussel, F., Darmoni, S.J., Thirion, B. [2001], "Cost effectiveness of a medical digital library", Medical Informatics and the Internet in Medicine, vol. 26, no. 4, pp. 325 - 330.

Salampasis, M., Tait, J., Bloor, C. [1998], "Evaluation of information-seeking performance in hypermedia digital libraries", Interacting with Computers, vol. 10, no. 3, pp. 269-284.

Sandusky, R.J. [2002], "Digital library attributes: framing usability research" in A. Blandford, G. Buchanan (eds.) Usability of Digital libraries: a workshop at JCDL 2002.

Saracevic, T. [2000],"Digital library evaluation: toward an evolution of concepts". Library Trends, vol. 49, no.2, pp. 350-369.

Saracevic, T., Covi, L. [2000], "Challenges for digital library evaluation" in D.H. Kraft (ed.) Knowledge innovations: celebrating our heritage, designing out future. Proceedings of the 63rd Annual Meeting, Washington, D.C.: American Society for Information Science, pp. 341-350.

Schwartz, C. [2002], "Digital libraries: an overview", The Journal of Academic Librarianship, vol. 26, no. 6, pp. 385-393.

Seadle, M. [2003], "Outcome-based evaluation", Library Hi Tech, vol. 21, no. 1., pp. 5-7.

Stern, D. [1999], "Digital libraries: philosophies, technical design considerations, and example scenarios: pre-publication reviews, commentaries, evaluations". New York, Haworth Press.

Sugimoto, S. et al. [1995], "Enhancing usability of network-based library information system: experimental studies of a user interface for OPAC and of a collaboration tool for library services" in Digital Libraries '95.

Tang, M., Sun, Y. [2003], "Evaluation of web-based search engines using user-effort measures", Libres, vol. 13, no. 2.

Thong, J.Y.L., Hong, W., Tam, K. [2002], "Understanding user acceptance of digital libraries: what are the roles of interface characteristics, organizational context, and individual differences?", International Journal of Human-Computer Studies, vol. 57, no. 3, pp. 215-242.

Trant, J. [2004], "Image retrieval benchmark database service: a needs assessment and preliminary development plan".

back to top

> U-Z

Unruh, K.T., Pettigrew, K.E., Durrance, J.C. [2002], "Evaluation of digital community information systems" in Proceedings of the second ACM/IEEE-CS joint conference on Digital Libraries, ACM Press: New York, pp. 240 - 241.

Unruh, K.T., Pettigrew, K.E., Durrance, J.C. [2002], "Towards effective evaluation of digital community information systems", in E.G. Toms (ed.), Proceedings of the 65th Annual Meeting of the American Society for Information Science & Technology, ASIST: Philadelphia, pp. 250-259.

Van House, N.A. [1996], "User-centered iterative design for digital libraries: the Cypress experience", D-Lib Magazine.

Weiss-Lijn, M., McDonnell, J.T., James, L. [2002], "An empirical evaluation of the interactive visualization of metadata to support document use" in Lecture Notes in Computer Science, 2539, Berlin, Heidelberg, Springer-Verlag, pp. 50-64.

Wolfram, D., Xie, H.I. [2002], "Traditional IR for web users: a context for general audience digital libraries", Information Processing & Management, vol. 38, no. 5, pp. 627-648.

Xie, H., Wolfram, D. [2002], "State digital library usability: contributing organizational factors", Journal of American Society for Information Science and Technology, vol. 53, no. 13, pp. 1085-1097.

Yang, S.C. [2001], "An interpretive and situated approach to an evaluation of Perseus digital libraries", Journal of the American Society for Information Science and Technology, vol. 52, no. 14, pp. 1210-1223.

back to top

New DELOS NoE Newsletter published
Joint Conference on Digital Libraries (JCDL) 2006 Announcement
INEX 2005 Call for Participation
ICADL 2005 Call for Papers
CLEF 2005 Call for Participation
News Archive
| Last update: 26-09-05 |
| Contact with webmaster
[remove spam protection] |
DELOS offcial website