Algorithmic Learning Theory: 13th International Conference, ALT 2002 Lübeck, Germany, November 24–26, 2002 Proceedings

425 Pages·2002·4.59 MB·English

by  Nicolò Cesa-Bianchi

Lecture Notes in Artificial Intelligence 2533
SubseriesofLectureNotesinComputerScience
EditedbyJ.G.CarbonellandJ.Siekmann
Lecture Notes in Computer Science
EditedbyG.Goos,J.Hartmanis,andJ.vanLeeuwen
3
Berlin
Heidelberg
NewYork
Barcelona
HongKong
London
Milan
Paris
Tokyo
Nicolò Cesa-Bianchi Masayuki Numao
Rüdiger Reischuk (Eds.)
Algorithmic
Learning Theory
13th International Conference,ALT 2002
Lübeck, Germany, November 24-26, 2002
Proceedings
1 3
SeriesEditors
JaimeG.Carbonell,CarnegieMellonUniversity,Pittsburgh,PA,USA
Jo¨rgSiekmann,UniversityofSaarland,Saarbru¨cken,Germany
VolumeEditors
NicolòCesa-Bianchi
UniversitàdegliStudidiMilano
DipartimentodiTecnologiedell’Informazione
viaBramante65,26013Crema(CR),Italy
E-mail:[email protected]
MasayukiNumao
TokyoInstituteofTechnology,DepartmentofComputerScience
2-12-1,OhokayamaMeguroWard,Tokyo152-8552,Japan
E-mail:[email protected]
RüdigerReischuk
UniversitätzuLübeck,InstitutfürTheoretischeInformatik
Wallstr.40,23560Lübeck,Germany
E-mail:[email protected]
Cataloging-in-PublicationDataappliedfor
AcatalogrecordforthisbookisavailablefromtheLibraryofCongress
BibliographicinformationpublishedbyDieDeutscheBibliothek
DieDeutscheBibliothekliststhispublicationintheDeutscheNationalbibliographie;
detailedbibliographicdataisavailableintheInternetat<http://dnd.ddb.de>.
CRSubjectClassification(1998):I.2.6,I.2.3,F.1,F.2,F.4.1,I.7
ISSN0302-9743
ISBN3-540-00170-0Springer-VerlagBerlinHeidelbergNewYork
Thisworkissubjecttocopyright.Allrightsarereserved,whetherthewholeorpartofthematerialis
concerned,specificallytherightsoftranslation,reprinting,re-useofillustrations,recitation,broadcasting,
reproductiononmicrofilmsorinanyotherway,andstorageindatabanks.Duplicationofthispublication
orpartsthereofispermittedonlyundertheprovisionsoftheGermanCopyrightLawofSeptember9,1965,
initscurrentversion,andpermissionforusemustalwaysbeobtainedfromSpringer-Verlag.Violationsare
liableforprosecutionundertheGermanCopyrightLaw.
Springer-VerlagBerlinHeidelbergNewYork,
amemberofBertelsmannSpringerScience+BusinessMediaGmbH
http://www.springer.de
©Springer-VerlagBerlinHeidelberg2002
PrintedinGermany
Typesetting:Camera-readybyauthor,dataconversionbyPTP-Berlin,StefanSossnae.K.
Printedonacid-freepaper SPIN:10871518 06/3142 543210
Preface
This volume contains the papers presented at the 13th Annual Conference on
AlgorithmicLearningTheory(ALT2002),whichwasheldinLu¨beck(Germany)
during November 24–26, 2002. The main objective of the conference was to pro-
videaninterdisciplinaryforumdiscussingthetheoreticalfoundationsofmachine
learning as well as their relevance to practical applications. The conference was
colocated with the Fifth International Conference on Discovery Science (DS
2002).
The volume includes 26 technical contributions which were selected by the
program committee from 49 submissions. It also contains the ALT 2002 invited
talks presented by Susumu Hayashi (Kobe University, Japan) on “Mathematics
Based on Learning”, by John Shawe-Taylor (Royal Holloway University of Lon-
don, UK) on “On the Eigenspectrum of the Gram Matrix and Its Relationship
to the Operator Eigenspectrum”, and by Ian H. Witten (University of Waikato,
New Zealand) on “Learning Structure from Sequences, with Applications in a
DigitalLibrary”(jointinvitedtalkwithDS2002).Furthermore,thisvolumein-
cludes abstracts of the invited talks for DS 2002 presented by Gerhard Widmer
(Austrian Research Institute for Artificial Intelligence, Vienna) on “In Search
of the Horowitz Factor: Interim Report on a Musical Discovery Project” and
by Rudolf Kruse (University of Magdeburg, Germany) on “Data Mining with
Graphical Models”. The complete versions of these papers are published in the
DS 2002 proceedings (Lecture Notes in Artificial Intelligence, Vol. 2534).
ALT has been awarding the E. Mark Gold Award for the most outstanding
paper by a student author since 1999. This year the award was given to Daniel
Reidenbachforhispaper“ANegativeResultonInductiveInferenceofExtended
Pattern Languages.”
This conference was the 13th in a series of annual conferences established
in 1990. Continuation of the ALT series is supervised by its steering committee
consistingof:ThomasZeugmann(Univ.Lu¨beck,Germany)Chair,ArunSharma
(Univ. of New South Wales, Australia) Co-chair, Naoki Abe (IBM T.J. Watson
Research Center, USA), Peter Bartlett (Australian National Univ., Australia),
Klaus Peter Jantke (DFKI, Germany), Roni Khardon (Tufts Univ., USA), Phil
Long (National Univ. of Singapore), Heikki Mannila (Nokia Research Center),
Akira Maruoka (Tohoku Univ., Japan), Luc De Raedt (Albert-Ludwigs-Univ.,
Germany), Takeshi Shinohara (Kyushu Institute of Technology, Japan), and
Osamu Watanabe (Tokyo Institute of Technology, Japan).
Wewouldliketothankallindividualsandinstitutionswhocontributedtothe
successoftheconference:theauthorsforsubmittingpapers,theinvitedspeakers
foracceptingourinvitationandlendingustheirinsightintorecentdevelopments
intheirresearchareasandthesponsorsfortheirgenerousfinancialsupport.We
areparticularlygratefultoMrs.LisaDra¨gerforfundingtheE.MarkGoldAward
this year.
VI Preface
Furthermore,wewouldliketoexpressourgratitudetoallprogramcommittee
membersfortheirhardworkinreviewingthesubmittedpapersandparticipating
inon-linediscussions.Wearealsogratefultotheexternalrefereeswhosereviews
made a considerable contribution to this process.
We are also grateful to DS 2002 chairs Steffen Lange (DFKI GmbH, Ger-
many) and Ken Satoh (National Institute of Informatics, Japan) for their effort
in coordinating with ALT 2002, and to Andreas Jakoby and Thomas Zeugmann
for their excellent work as the local arrangements chairs. Last, but not least,
Springer-Verlag provided excellent support in preparing this volume.
September 2002 Nicolo` Cesa-Bianchi
Masayuki Numao
Ru¨diger Reischuk
Organization
Conference Chair
Ru¨diger Reischuk Univ. Lu¨beck, Germany
Program Committee
Nicol`o Cesa-Bianchi (Univ. di Milano, Italy) Co-chair
Masayuki Numao (Tokyo Inst. of Tech., Japan) Co-chair
Naoki Abe (IBM T.J. Watson Research Center, USA)
Hussein Al-Muallim (KFUPM, Saudi Arabia)
Peter Auer (TU Graz, Austria)
Jos´e Balc´azar (Univ. Politecnica de Catalunya, Spain)
Saso Dzeroski (Jozef Stefan Institute, Slovenia)
Claudio Gentile (Univ. dell’Insubria, Italy)
Boonserm Kijsirikul (Chulalongkorn Univ., Thailand)
Robert Schapire (AT&T Labs., USA)
Kai Ming Ting (Monash Univ., Australia)
Rolf Wiehagen (Univ. Kaiserslautern, Germany)
Local Arrangements
Andreas Jacoby Univ. Lu¨beck, Germany
Thomas Zeugmann Univ. Lu¨beck, Germany
Subreferees
David Albrecht Jun’ichi Takeuchi
Marta Arias Montserrat Hermo
Albert Atserias Gabor Lugosi
Peter Bartlett Lluis Marquez
Xavier Carreras Enrique Romero
Jorge Castro Athasit Surarerks
Prabhas Chongstitvatana Manfred Warmuth
Ricard Gavalda Osamu Watanabe
Sponsoring Institutions
DFKI GmbH, Saarbru¨cken, Germany
Corpo Base, Lu¨beck
Jessen Lenz, Lu¨beck
Mrs. Lisa Dra¨ger, Lu¨beck
Table of Contents
Editors’ Introduction ............................................... 1
Nicolo` Cesa-Bianchi, Masayuki Numao, Ru¨diger Reischuk
Invited Papers
Mathematics Based on Learning ..................................... 7
Susumu Hayashi
Data Mining with Graphical Models.................................. 22
Rudolf Kruse, Christian Borgelt
On the Eigenspectrum of the Gram Matrix and Its Relationship
to the Operator Eigenspectrum ...................................... 23
John Shawe-Taylor, Chris Williams, Nello Cristianini, Jaz Kandola
In Search of the Horowitz Factor: Interim Report on a Musical
Discovery Project .................................................. 41
Gerhard Widmer
Learning Structure from Sequences, with Applications in
a Digital Library................................................... 42
Ian H. Witten
Regular Contributions
Learning Boolean Functions
On Learning Monotone Boolean Functions under the
Uniform Distribution ............................................... 57
Kazuyuki Amano, Akira Maruoka
On Learning Embedded Midbit Functions............................. 69
Rocco A. Servedio
Maximizing Agreements and CoAgnostic Learning ..................... 83
Nader H. Bshouty, Lynn Burroughs
Boosting and Margin-Based Learning
Optimally-Smooth Adaptive Boosting and Application to Agnostic
Learning.......................................................... 98
Dmitry Gavinsky
Large Margin Classification for Moving Targets ........................ 113
Jyrki Kivinen, Alex J. Smola, Robert C. Williamson
X Table of Contents
On the Smallest Possible Dimension and the Largest Possible
Margin of Linear Arrangements Representing Given Concept Classes
Uniform Distribution ............................................... 128
Ju¨rgen Forster, Hans Ulrich Simon
Learning with Queries
A General Dimension for Approximately Learning Boolean
Functions ......................................................... 139
Johannes K¨obler, Wolfgang Lindner
The Complexity of Learning Concept Classes with Polynomial
General Dimension................................................. 149
Johannes K¨obler, Wolfgang Lindner
On the Absence of Predictive Complexity for Some Games .............. 164
Yuri Kalnishkan, Michael V. Vyugin
Learning and Information Extraction
Consistency Queries in Information Extraction......................... 173
Gunter Grieser, Klaus P.Jantke, Steffen Lange
Ordered Term Tree Languages which Are Polynomial Time
Inductively Inferable from Positive Data .............................. 188
Yusuke Suzuki, Takayoshi Shoudai, Tomoyuki Uchida,
Tetsuhiro Miyahara
Inductive Inference
Reflective Inductive Inference of Recursive Functions .................. 203
Gunter Grieser
Classes with Easily Learnable Subclasses.............................. 218
Sanjay Jain, Wolfram Menzel, Frank Stephan
On the Learnability of Vector Spaces ................................. 233
Valentina S. Harizanov, Frank Stephan
Learning, Logic, and Topology in a Common Framework................ 248
Eric Martin, Arun Sharma, Frank Stephan
Inductive Logic Programming
A Pathology of Bottom-Up Hill-Climbing in Inductive Rule Learning ..... 263
Johannes Fu¨rnkranz
Minimised Residue Hypotheses in Relevant Logic ...................... 278
Bertram Fronho¨fer, Akihiro Yamamoto