Information Retrieval Systems Evaluation: Learning and Teaching Process

Abstract

The two major disciplines that have addressed the teaching of Information Retrieval (IR) since its origins are Computer Science (CS) and Library and Information Science (LIS), both with a different teaching orientation: CS students focus on a technical approach to IR while LIS students focus on the search task as intermediaries and experts in information units. However, knowledge of the principal technical terms would be desirable for LIS students and a better understanding of user needs and how users perform a search process would be desirable for CS students. In this paper we describe how the addition of new learning tools: the WebCT forum, a wiki, and concept maps, have dramatically changed the outcomes for students with a very limited background in mathematics and CS in classes on IR systems evaluation that are taught from a technical perspective. We discuss the difficulties teachers encounter in trying to transmit technical knowledge to such students, and how the addition of these tools helps to overcome these difficulties.