Machine Learning and Information Retrieval

These references were originally collected for a seminar taught by Rik Belew and Jude Shavlik at the Univ. Wisconsin (CS838, Fall'95). It is currently being maintained by Rik Belew as a resource in support of the AAAI Spring Symposium on Machine Learning in Information Access to be held at Stanford, March 25-27, 1996. It may be maintained beyond this event if there is sufficient interest.

Materials from an overview talk on "Machine Learning Information Retrieval" which relates many of these references is also available. (Note that this outline points to several large-ish Postscript files containing subsets of the slides.)

Please send any recommended changes to rik@cs.ucsd.edu.

Background reading

• Information Retrieval by C. J. . van Rijsbergen Butterworths, London, England, 1979.

• A Symbolic and Connectionist Approach to Legal Information Retrieval, by D. E. Rose, 1994, Hillsdale, NJ: Erlbaum.

• Machine Learning: Expert Systems and Information Retrieval by Richard Forsyth, Roy Rada. Ellis Horwood, London. 1986.

• Connectionist models and information retrieval, by T. Doszkocs, J. Reggia, and X. Lin. Annual Review of Information Science & Technology 25:209-260, 1990.

• Word Sense Disambiguation Using Statistical Models of Roget's Categories Trained on Large Corpora, by David Yarowsky. Proc. COLING-92. Nantes, Aug 23-28, 1992, pp 454-460.

• Discrimination Decisions for 100,000-Dimensional Spaces, by William A Gale, Kenneth W Church, David Yarowsky, Statistical Research Reports, No. 103, Jan 16, 1992, AT&T Bell Laboratories.

Papers available online

• Category translation: Learning to understand information on the Internet, by M. Perkowitz and O. Etzioni, Proc. IJCAI-95, Montreal, Morgan Kaufmann.

• FAQ Finder: A case-based approach to knowledge navigation by K. Hammond, R. Burke, C. Martin, and S. Lytinen, Proc. 1995 AAAI Spring Symp. on Information Gathering from Heterogeneous, Distributed Environments, Stanford, March 1995, AAAI Press.

• A Learning Agent that Assists the Browsing of Software Libraries. C. Drummond, D. Ionescu and R. Holte (1995). Computer Science Dept. Technical Report TR-95-12 (51 pages).

• A Learning Apprentice For Browsing R. Holte and C. Drummond (1994). AAAI Spring Symposium on Software Agents.

• Accelerating Browsing by Automatically Inferring a User's Search Goal. C. Drummond, R. Holte and D. Ionescu (1993). Proceedings of the Eighth Knowledge-Based Software Engineering Conference, pp. 160-167.

• Collaborative interface agents (postscript), by Y. Lashkari, M. Metral, and P. Maes, Proc. 1994 AAAI Conf., Seattle, AAAI Press.

• NewsWeeder: Learning to filter NetNews, Proc. 1995 Machine Learning Conf., Lake Tahoe, CA, Morgan Kaufmann.

• WebWatcher: A learning apprentice for the World Wide Web, by R. Armstrong, D. Freitag, T. Joachims, and T. Mitchell, Proc. 1995 AAAI Spring Symp. on Information Gathering from Heterogeneous, Distributed Environments, Stanford, March 1995, AAAI Press.

• WebWatcher: Machine learning and hypertext, to appear in Fachgruppentreffen Maschinelles Lernen, Dortmund, Germany, August 1995.

• Learning from hotlists and coldlists: Towards a WWW information filtering and seeking agent, by M. Pazzani, L. Nguyen, and S. Mantik, Proc. AI Tools Conf., Washington, DC, 1995.

• An adaptive agent for automated web browsing, by M. Balabanovic, Y. Shoham, and Y. Yun. To appear in the special issue on digital libraries, Journal of Visual Communication and Image Representation 6(4), 1995. Abstract

• Learning information retrieval agents: Experiments with automated Web browsing, by M. Balabanovic and Y. Shoham, Proc. 1995 AAAI Spring Symp. on Information Gathering from Heterogeneous, Distributed Environments, Stanford, March 1995, AAAI Press Abstract

• Learning collection fusion strategies for information retrieval, by G. Towell, E. M. Voorhees, N. K. Gupta, and B. Johnson-Laird, Proc. ML-95, pp. 540-548, Lake Tahoe, 1995, Morgan Kaufmann.

• A neural network approach to topic spotting, by E. Wiener, J. O. Pedersen and A. S. Weigend, Proc. SDAIR '95, pp. 317-332, Las Vegas, NV, 1995.

• A trainable document summarizer, by J. Kupiec, J. Pederson, and F. Chen, Proc. SIGIR '95, pp. 68-73, Seattle, 1995, ACM Press.

• A comparison of classifiers and document representations for the routing problem, by H. Schutze, D. A. Hull, and J. O. Pedersen. Proc. SIGIR '95, pp. 229-237, Seattle, 1995, ACM Press.

• A sequential algorithm for training text classifiers, by D. D. Lewis, W. A. Gale. Proc. SIGIR '94, pp. 3-12. Dublin, Ireland. 1994. Springer-Verlag.

• Learning document category descriptions through the extraction of semantically significant phrases, by B. Krulwich, Proc. IJCAI-95 workshop on Data Engineering for Inductive Learning, 1995.

• Learning user interests across heterogeneous document databases, by B. Krulwich, Proc. 1995 AAAI Spring Symp. on Information Gathering from Heterogeneous, Distributed Environments, Stanford, March 1995, AAAI Press.

• Clustering full text documents, by J. Martin, Proc. IJCAI-95 workshop on Data Engineering for Inductive Learning, 1995.

• Text categorization and relational learning, by W. W. Cohen, Proc. Machine Learning '95 Conf., pp. 124-132, Lake Tahoe, CA, Morgan Kaufmann, 1995.

• An Evolutionary Connectionist Approach to Personal Information Filtering, Michael McElligott and Humphrey Sorensen. Proc. Fourth Irish Neural Network Conference. pp. 141-146. University College, Dublin. Sept. 1994.

• Machine Learning for information retrieval: Neural networks, symbolic learning and genetic algorithms. by H. Chen, JASIS 46(3):194-216, April 1995.

• A Machine Learning Approach to Document Retrievel: An Overview and an Experiment Proceedings of the 27th Annual Hawaii International Conference on System Sciences (HICSS-27), Maui, Hawaii, January 4-7, 1994.

• Latent Semantic Indexing is an optimal special case of multidimenional scaling, by B. T. Bartell, G. W. Cottrell, and R. K. Belew, Proc. SIGIR-92, New York, 1992. ACM Press. Abstract

• Automatic combination of multiple ranked retrieval systems, by B. T. Bartell, G. W. Cottrell, and R. K. Belew. Proc. SIGIR-94, Dublin, 1994, ACM Press. Abstract

• Learning the optimal parameters in a ranked retrieval system using multi-query relevance feedback, by B. T. Bartell, G. W. Cottrell, and R. K. Belew. Proc. Symp. on Document Analysis and Information Retrieval, Las Vegas, 1994. Abstract

• Exporting phrases: A statistical analysis of topical language, by A. M. Steier and R. K. Belew, Proc. 2nd Symp. on Document Analysis and Information Retrieval, pp. 179-190, 1993. Abstract

• Talking about AI: Socially-defined linguistic subcontexts in AI, by A. M. Steier and R. K. Belew, Proc. AAAI-94, pp. 715-720, Seattle, 1994, AAAI Press. Abstract

• Artificial life applied to adaptive information agents, by F. Menczer, R. K. Belew, and W. Willuhn. Proc. 1995 AAAI Spring Symp. on Information Gathering from Heterogeneous, Distributed Environments, Stanford, March 1995, AAAI Press. Abstract:

• Connectionist Information Retrieval: A Survey of Recent Work Paul Biron. 1990.

On-Line Resources

• Invited ML95 talk on Machine Learning and Information Retrieval, by B. Croft.
• A brief bibliography and resource list on NLP for IR, by D. D. Lewis and E. D. Liddy.
• Large-Scale Persistent Object Systems for Corpus Linguistics and Information Retrieval by R. Futrelle and X. Zhang
• Interactive Information Group at the Canadian NRC
• Association for Computational Linguistics (ACL)
• Computational linguistics and NLP e-prints
• Word Net
• Information Filtering Resources
• Intellectual Property and the National Information Infrastructure
• ONR's `Information Finding and Displaying' Project
• ACM SIGIR
• Ctr. Intelligent IR(UMass )
• Ed Fox's WWW List