Teaching key topics in computer science and information systems through a web search engine project

Advances in computer and Internet technologies have made it more and more important for information technology professionals to acquire experience in a variety of aspects, including new technologies, system integration, database administration, and project management. To provide students with a chance to acquire such skills, we designed a project called "Build Your Search Engine in 90 Days," in which students were required to build a domain-specific Web search engine in a semester. In this paper we review the tools and resources available to students and report our experiences in having students to work on this project in a course at the University of Arizona. We also review two tools, called AI Spider and AI Indexer, we developed for students in this project. We highlight a few search engines that were created by the students and suggest some future directions in improving the tools and expanding the project.

[1]  Udi Manber,et al.  WebGlimpse: combining browsing and searching , 1997 .

[2]  Richard P. Lippmann,et al.  An introduction to computing with neural nets , 1987 .

[3]  Eric Brewer,et al.  THE CONSUMER SIDE OF SEARCH , 2002 .

[4]  Sandra Poindexter.  Assessing Active Alternatives for Teaching Programming , 2003, J. Inf. Technol. Educ..

[5]  Fah-Chun Cheong.  Internet Agents: Spiders, Wanderers, Brokers, and 'Bots , 1996 .

[6]  Sriram Raghavan,et al.  Searching the Web , 2001, ACM Trans. Internet Techn..

[7]  Gerald Salton,et al.  Automatic text processing , 1988 .

[8]  Terry L. Fox.  A Case Analysis of Real-World Systems Development Experiences of CIS Students , 2002, J. Inf. Syst. Educ..

[9]  Peter B. Danzig,et al.  The Harvest Information Discovery and Access System , 1995, Comput. Networks ISDN Syst..

[10]  Ian H. Witten,et al.  Greenstone: Open-source DL software , 2001, CACM.

[11]  Marc Najork,et al.  Mercator: A scalable, extensible Web crawler , 1999, World Wide Web.

[12]  Mary J. Granger,et al.  Peer learning across the undergraduate information systems curriculum , 1999 .

[13]  Jeffrey J. McConnell,et al.  Active learning and its use in computer science , 1996, ITiCSE.

[14]  K. J. Lynch,et al.  Automatic construction of networks of concepts characterizing document databases , 1992, IEEE Trans. Syst. Man Cybern..

[15]  Reinier Post,et al.  Information Retrieval in the World-Wide Web: Making Client-Based Searching Feasible , 1994, Comput. Networks ISDN Syst..

[16]  Marilyn Wilkins,et al.  Critical Skills of IS Professionals: A Model for Curriculum Development , 2002, J. Inf. Technol. Educ..

[17]  Sergey Brin,et al.  The Anatomy of a Large-Scale Hypertextual Web Search Engine , 1998, Comput. Networks.

[18]  Michael McGill,et al.  Introduction to Modern Information Retrieval , 1983 .

[19]  Hsinchun Chen,et al.  CI Spider: a tool for competitive intelligence on the Web , 2002, Decis. Support Syst..

[20]  Albert L. Harris.  Developing the Systems Project Course , 1994, J. Inf. Syst. Educ..