Encyclopedia of Machine Learning

Claude Sammut, Geoffrey I. Webb (Eds.)

Encyclopedia of MachineLearningWith Figures and Tables

123

EditorsClaude SammutSchool of Computer Science and EngineeringUniversity of New South WalesSydneyAustralia claude@cse.unsw.edu.au

Geoffrey I. WebbFaculty of Information TechnologyClayton School of Information TechnologyMonash UniversityP.O. Box VictoriaAustralia Geoff.Webb@monash.edu

ISBN ---- e-ISBN ----Print and electronic bundle ISBN ----DOI ./----Springer New York

Library of Congress Control Number:

© Springer Science+Business Media, LLC All rights reserved.This workmay not be translated or copied in whole or in part without thewritten permission of the publisher(Springer Science+Business Media, LLC, Spring Street, New York, NY , USA), except for brief excerpts in connectionwith reviews or scholarly analysis. Use in connection with any form of information storage and retrieval, electronic adaptation,computer software, or by similar or dissimilar methodology now known or hereafter developed is forbidden.The use in this publication of trade names, trademarks, service marks, and similar terms, even if they are not identified as such,is not to be taken as an expression of opinion as to whether or not they are subject to proprietary rights.While the advice and information in this book are believed to be true and accurate at the date of going to press, neither theauthors nor the editors nor the publisher can accept any legal responsibility for any errors or omissions that may be made. Thepublisher makes no warranty, express or implied, with respect to the material contained herein.

Printed on acid-free paper

Springer is part of Springer Science+Business Media (www.springer.com)

Preface

The term “Machine Learning” came into wide-spread use following the first workshop by that name, held at Carnegie-MellonUniversity in . The papers from that workshop were published as Machine Learning: An Artificial Intelligence Approach,edited by Ryszard Michalski, Jaime Carbonell and Tom Mitchell. Machine Learning came to be identified as a research field inits own right as the workshops evolved into international conferences and journals of machine learning appeared.

Although the field coalesced in the s, research on what we now call machine learning has a long history. In his paper on “Computing Machinery and Intelligence”, Alan Turing introduced his imitation game as a means of determining if amachine could be considered intelligent. In the same paper he speculates that programming the computer to have adult levelintelligence would be too difficult. “Instead of trying to produce a programme to simulate the adult mind, why not rather tryto produce one which simulates the child’s? If this were then subjected to an appropriate course of education one would obtainthe adult brain”. Investigations into induction, a fundamental operation in learning, go backmuch further to Francis Bacon andDavid Hume in the th and th centuries.

Early approaches followed the classical AI tradition of symbolic representation and logical inference. As machine learningbegan to be used in a wide variety of areas, the range of techniques expanded to incorporate ideas from psychology, informationtheory, statistics, neuroscience, genetics, operations research and more. Because of this diversity, it is not always easy for a newresearcher to find his or her way around the machine learning landscape.The purpose of this encyclopedia is to guide enquiriesinto the field as a whole and to serve as an entry point to specific topics, providing overviews and,most importantly, references tosourcematerial. All the entries have been written by experts in their field and have been refereed and revised by an internationaleditorial board consisting of leading machine learning researchers.

Putting together an encyclopedia for such a diverse field has been a major undertaking. We thank all the authors, withoutwhom this would not have been possible.They have devoted their expertise and patience to the project because of their desire tocontribute to this dynamic and still growing field. A project as large as this could only succeed with the help of the area editorswhose specialised knowledge was essential in defining the range and structure of the entries.

The encyclopedia was started by the enthusiasm of Springer editors Jennifer Evans and Oona Schmidt and continued withthe support of Melissa Fearon. Special thanks to Andrew Spencer, who oversaw production and kept everyone, including theeditors on track.

Claude Sammut and Geoffrey I. Webb

Editors-in-Chief

Claude SammutSchool of Computer Science and EngineeringUniversity of New South WalesSydney, Australia claude@cse.unsw.edu.au

Geoffrey I. WebbFaculty of Information TechnologyClayton School of Information TechnologyMonash UniversityP.O. Box Victoria, Australia Geoff.Webb@monash.edu

Area Editors

Charu AggarwalIBM T. J. Watson Research Center Skyline DriveHawthorneNY USAcharu@us.ibm.com

Wray BuntineNICTALocked Bag Canberra ACT Australiawray.buntine@nicta.com.au

James CussensDepartment of Biology (Area )York Centre for Complex Systems AnalysisUniversity of YorkPO Box York YO YWUKjc@cs.york.ac.uk

Luc De RaedtDept. of Computer ScienceKatholieke Universiteit LeuvenCelestijnenlaan A HeverleeBelgiumluc.deraedt@cs.kuleuven.be

Peter A. FlachDepartment of Computer ScienceUniversity of BristolWoodland RoadBristol BS UBUKPeter.Flach@bristol.ac.uk

Russ GreinerDepartment of Computing ScienceUniversity of AlbertaAthabasca Hall Edmonton

Alberta TG ECanadagreiner@cs.ualberta.ca

Eamonn KeoghComputer Science & Engineering DepartmentUniversity of CaliforniaRiversideCaliforniaCA USAeamonn@cs.ucr.edu

Michael L. LittmanDepartment of Computer ScienceRutgers, the State University of New Jersey Frelinghuysen RoadPiscatawayNew Jersey -USAmlittman@cs.rutgers.edu

Sridhar MahadevanDepartment of Computer ScienceUniversity of Massachusetts Governor’s DriveAmherstMA USAmahadeva@cs.umass.edu

StanMatwinSchool of Information Technology andEngineeringUniversity of Ottawa King Edward Ave., P.O. Box Stn AOttawaOntario KN NCanadastan@site.uottawa.ca

Risto MiikkulainenDepartment of Computer SciencesThe University of Texas at Austin University Station C

x Area Editors

AustinTexasTX -USAristo@cs.utexas.edu

Dunja MladenicDepartment for Intelligent SystemsJ. Stefan InstituteJamova LjubljanaSloveniaDunja.Mladenic@ijs.si

C. David PageDepartment of Biostatistics and Medical InformaticsUniversity of Wisconsin Medical School University AvenueWisconsinMadison WI USApage@biostat.wisc.edu

Bernhard PfahringerDepartment of Computer ScienceUniversity of WaikatoPrivate Bag HamiltonNew Zealandbernhard@cs.waikato.ac.nz

Michail ProkopenkoCSIROMacquarie UniversityBuilding EB,Campus Herring RoadNorth RydeNSWAustralia

Frank StephanDepartment of MathematicsNational University of Singapore Science Drive S, Singapore Singaporefstephan@comp.nus.edu.sg

Peter StoneDepartment of Computer SciencesThe University of Texas at Austin University Station CAustinTexasTX -USApstone@cs.utexas.edu

Prasad TadepalliSchool of Electrical Engineering and Computer ScienceOregon State University Kelley Engineering CenterCorvallisOregonOR -USAtadepall@eecs.oregonstate.edu

Takashi WashioThe Institute of Scientific and Industrial ResearchOsaka University- MihogaokaOsakaIbaraki Japanwashio@ar.sanken.osaka-u.ac.jp

List of Contributors

Pieter AbbeelDepartment of Electrical Engineeringand Computer SciencesUniversity of California Sutardja Dai Hall #CA -, BerkeleyCaliforniaUSApabbeel@stanford.edu

Charu C. AggarwalIBM T. J. Watson Research Center Skyline DriveHawthorneNY USAcharu@us.ibm.com

Biliana Alexandrova-KabadjovaGeneral Directorate of Central Bank OperationsCentral Banking Operations DivisionBank of MexicoAv. de Mayo No. Col. Centro, C.P. Mexico, D.Fbalexandrova@banxico.org.mx

Periklis AndritsosThoora Inc.Toronto, ONCanadaperiklis@thoora.com

Peter AuerInstitute of Computer ScienceUniversity of LeobenFranz-Josef-Strasse LeobenAustriaauer@unileoben.ac.at

J. Andrew BagnellRobotics InstituteCarnegie Mellon University Forbes AvenuePittsburgh, PA USAdbagnell@ri.cmu.edu

Michael BainUniversity of New South WalesSydneyAustraliamike@cse.unsw.edu.au

Arindam BanerjeeDepartment of Computer Science andEngineeringUniversity of MinnesotaMinneapolis, MNUSAbanerjee@cs.umn.edu

Andrew G. BartoDepartment of Computer ScienceUniversity of Massachusetts Amherst Computer Science BuildingAmherst, MA USAbarto@cs.umass.edu

Rohan A. BaxterAnalytics, Intelligence and RiskAustralian Taxation OfficePO Box Civic Square, ACT Australiar.baxter@computer.org

Bettina BerendtKatholieke Universiteit LeuvenDepartment of Computer ScienceCelestijnenlaan A HeverleeBelgiumBettina.Berendt@cs.kuleuven.be

xii List of Contributors

Indrajit BhattacharyaIBM India Research LaboratoryNew DelhiIndia

Mustafa BilgicUniversity of MarylandAV Williams BldgRm College Park, MD USA

Mauro BirattariIRIDIAUniversité Libre de BruxellesBrusselsBelgiummbiro@ulb.ac.be

Hendrik BlockeelDepartment of Computer ScienceKatholieke Universiteit LeuvenCelestijnenlaan A HeverleeBelgiumHendrik.Blockeel@cs.kuleuven.be

Shawn BohnPacific Northwest National Laboratory

Antal van den BoschTilburg centre for Creative ComputingTilburg UniversityP.O. Box LE, TilburgThe NetherlandsAntal.vdnBosch@uvt.nl

Janez BrankDepartment for Intelligent SystemsJožef Stefan InstituteJamova LjubljanaSloveniajanez.brank@ijs.si

Jürgen BrankeInstitut für Angewandte Informatikund Formale BeschreibungsverfahrenUniversität Karlsruhe (TH) KarlsruheGermanybranke@aifb.uni-karlsruhe.de

Pavel BrazdilLIAAD-INESC Porto L.A./Faculdade de EconomiaLaboratory of ArtificialIntelligence and Computer ScienceUniversity of PortoRua de Ceuta n. .pisoPorto -Portugalpbrazdil@liaad.up.pt

Gavin BrownThe University of ManchesterSchool of Computer ScienceKilburn BuildingOxford RoadManchester, M PLUKGavin.Brown@manchester.ac.uk

Ivan BruhaDepartment of Computing & SoftwareMcMaster UniversityHamilton, ONCanadabruha@cas.mcmaster.ca

M.D. BuhmannNumerische MathematikJustus-Liebig UniversityMathematisches InstitutHeinrich-Buff-Ring GiessenGermanyMartin.Buhmann@math.uni-giessen.de

Wray L. BuntineNICTALocked Bag Canberra ACT Australiawray.buntine@nicta.com.au

List of Contributors xiii

Tibério CaetanoResearch School of Information Sciencesand EngineeringAustralian National UniversityCanberra ACT Australiatibério.caetano@nicta.com.au

Nicola CanceddaXerox Research Centre Europe, chemin de Maupertuis MeylanFrancenicola.cancedda@xrce.xerox.com

Gail A. CarpenterDepartment of Cognitive and Neural SystemsCenter for Adaptive SystemsBoston UniversityBoston, MAUSA

John CaseDepartment of Computer and InformationSciencesUniversity of DelawareNewark DE -USAcase@cis.udel.edu

Tonatiuh Peña CentenoEconomic Research DivisionBank of MexicoAv. de Mayo # Col. Centro, C.P. Mexico, D.F.

Deepayan ChakrabartiYahoo! Research st AvenueSunnyvale, CA USAdeepay@yahoo-inc.com

Philip K. ChanDepartment of Computer SciencesFlorida Institute of TechnologyMelbourne, FLUSApkc@cs.fit.edu

Massimiliano CiaramitaYahoo! Research BarcelonaOcata Barcelona Spainmassi@yahoo-inc.com

Adam CoatesDepartment of Computer ScienceStanford UniversityStanford, CAUSA

David CohnGoogle, Inc. Amphitheatre ParkwayMountain View, CA USAdavid.cohn@somerandom.com

David CorneHeriot-Watt UniversityEarl Mountbatten BuildingEdinburgh EH ASUKdwcorne@macs.hw.ac.uk

Susan CrawIDEAS Research InstituteSchool of ComputingThe Robert Gordon UniversitySt. Andrew StreetAberdeen AB HGScotlandUKs.crow@comp.rgu.ac.uk

Artur CzumajDepartment of Computer ScienceUniversity of WarwickCoventry CV ALUKaczumaj@acm.org

Walter DaelemansDepartment of LinguisticsCLIPS University of AntwerpPrinsstraat AntwerpenBelgiumwalter.daelemans@ua.ac.be

xiv List of Contributors

Sanjoy DasguptaDepartment of Computer Science and EngineeringUniversity of CaliforniaSan Diego Gilman DriveMail Code La Jolla, California -USAdasgupta@cs.ucsd.edu

Gerald DeJongDepartment of Computer ScienceUniversity of Illinois at UrbanaUrbana, ILUSAmrebl@uiuc.edu

Marco DorigoIRIDIAUniversité Libre de BruxellesAvenue Franklin Roosevelt BrusselsBelgiummdorigo@ulb.ac.be

Kurt DriessensDepartement ComputerwetenschappenKatholieke Universiteit LeuvenCelestijnenlaan A HeverleeBelgiumkurt.driessens@cs.kuleuven.be

Christopher DrummondIntegrated ReasoningNational Research Council Institutefor Information Technology Montreal RoadBuilding M-, Room Ottawa, ON KA RCanadaChristopher.Drummond@nrc-cnrc.gc.ca

Yaakov EngelAICML, Department of Computing ScienceUniversity of Alberta- Athabasca HallEdmontonAlberta TG ECanadayakiengel@gmail.com

Scott E. FahlmanLanguage Technologies InstituteCarnegie Mellon University GHC Forbes AvenuePittsburgh, PA USAsef@cs.cmu.edu

Alan FernSchool of Electrical Engineering andComputer ScienceOregon State University Kelley Engineering CenterCorvallis, OR -USAafern@eecs.orst.edu

Peter A. FlachDepartment of Computer ScienceUniversity of BristolWoodland RoadBristol, BS UBUKPeter.Flach@bristol.ac.uk

Pierre FlenerDepartment of Information TechnologyUppsala UniversityBox SE- UppsalaSwedenPierre.Flener@it.uu.se

Johannes FürnkranzTU DarmstadtFachbereich InformatikHochschulstraße DarmstadtGermanyjuffi@ke.informatik.tu-darmstadt.de

Thomas GärtnerKnowledge DiscoveryFraunhofer Institute for Intelligent Analysis andInformation SystemsSchloss Birlinghoven Sankt AugustinGermanythomas.gaertner@iais.fraunhofer.de

List of Contributors xv

João GamaLaboratory of Artificial Intelligenceand Decision SupportUniversity of PortoPortoPortugaljgama@fep.up.pt

Alma Lilia García-AlmanzaGeneral Directorate of Information TechnologyBank of MexicoAv. de Mayo No. Col. Centro, C.P. Mexico, D.F.algarcia@banxico.org.mx

Gemma C. GarrigaLaboratoire d’Informatique de Paris Universite Pierre et Marie Curie place JussieuParis Francegemma.garriga@hut.fi

Wulfram GerstnerLaboratory of Computational NeuroscienceBrain Mind InstituteEcole Polytechnique Fédérale de LausanneStation Lausanne EPFLSwitzerlandwulfram.gerstner@ep.ch

Lise GetoorDepartment of Computer ScienceUniversity of MarylandAV Williams Bldg, Rm College Park, MD USAgetoor@cs.umd.edu

Christophe Giraud-CarrierDepartment of Computer ScienceBrigham Young University TMCB ProvoUT USA

Marko GrobelnikDepartment for Intelligent SystemsJožef Stefan InstituteJamova , LjubljanaSloveniaMarko.Grobelnik@ijs.si

Stephen GrossbergDepartment of CognitiveBoston University Beacon StreetBoston, MA USAsteve@bu.edu

Jiawei HanDepartment of Computer ScienceUniversity of Illinoisat Urbana Champaign N. Goodwin AvenueUrbana, IL USAhanj@cs.uiuc.edu

Julia HandlFaculty of Life Sciences in ManchesterUniversity of ManchesterUKj.handl@manchester.ac.uk

Michael HarriesTechnology Strategy DivisionAdvanced Products Group, Citrix LabsNorth RydeNSW Australia

Jun HeDepartment of Computer ScienceAberystwyth UniversityAberystwyth SY DBWalesUKj.he@cs.bham.ac.uk

xvi List of Contributors

Bernhard HengstSchool of Computer Science & EngineeringUniversity of New South WalesSydneyNSW Australiabernhardh@cse.unsw.edu.au

Tom HeskesRadboud University NijmegenToernooiveld EDNijmegenThe Netherlandst.heskes@science.ru.nl

Geoffrey HintonDepartment of Computer Science Office PT GUniversity of Toronto King’s College RoadMS G, TorontoOntarioCanadahinton@cs.toronto.edu

Lawrence HolderSchool of Electrical Engineering and Computer ScienceBox Washington State UniversityPullman, WA USAholder@wsu.edu

Tamás HorváthDepartment of Computer Science IIIUniversity of Bonn and Fraunhofer IAISFraunhofer Institute for IntelligentAnalysis and Information SystemsSchloss Birlinghoven Sankt AugustinGermanytamas.horvath@ais.fraunhofer.de

Eyke HüllermeierKnowledge Engineering & BioinformaticsHead of the KEBI LabDepartment of Mathematics and Computer SciencePhilipps-Universität MarburgMehrzweckgebäudeHans-Meerwein-Straße MarburgGermanyeyke@informatik.uni-marburg.de

Phil HusbandsDepartment of InformaticsUniversity of SussexBrighton BNQHUKphilh@sussex.ac.uk

Marcus HutterAustralian National UniversityRSIS Room BBuilding Corner of North and Daley RoadACT CanberraAustraliamarcus.hutter@anu.edu.au

Christian IgelInstitut für NeuroinformatikRuhr-Universität BochumUniversitstr. BochumGermanyChristian.Igel@neuroinformatik.ruhr-uni-bochum.de

Sanjay JainDepartment of Computer ScienceNational University of Singapore Computing DriveSingapore Republic of Singaporesanjay@comp.nus.edu.sg

Tommy R. JensenInstitut für MathematikAlpen-Adria-Universität KlagenfurtUniversitässtr. - KlagenfurtAustriatjensen@uni-klu.ac.at

Xin JinUniversity of Illinois at Urbana-ChampaignToernooiveld EDUrbana, ILUSA

List of Contributors xvii

Antonis C. KakasDepartment of Computer ScienceUniversity of Cyprus Kallipoleos Str., P.O. Box Nicosia Cyprusantonis@ucy.ac.cy

Subbarao KambhampatiDepartment of Computer Science and EngineeringArizona State UniversityTempe, AZUSArao@asu.edu

Anne KaoThe Boeing CompanyP.O. Box MC L-Seattle, WA -USAakao@thumper.rt.cs.boeing.com

George KarypisDepartment of Computer Science and EngineeringDigital Technology Centerand Army HPC Research CenterUniversity of MinnesotaMinneapolis, MN USAkarypis@cs.umn.edu

Samuel KaskiLaboratory of Computerand Information ScienceHelsinki University of TechnologyP.O. Box TKKFinlandsamuel.kaski@tkk.fi

Carlos KavkaIstituto Nazionale di Fisica NucleareUniversity of TriesteTrieste ItalyCarlos.Kavka@ts.infn.it

James KennedyU.S. Bureau of Labor StatisticsPostal Square Building Massachusetts Ave., NEWashington, DC -USAKennedy.Jim@bls.gov

Eamonn KeoghComputer Science & Engineering DepartmentUniversity of CaliforniaRiverside, CA USAeamonn@cs.ucr.edu

Kristian KerstingKnowledge DiscoveryFraunhofer IAISSchloß Birlinghoven Sankt AugustinGermanykristian.kersting@iais.fraunhofer.de

Joshua KnowlesUniversity of Manchester

Aleksander KołczMicrosoft One Microsoft WayRedmond, WA USAalek@ir.iit.edu

Kevin B. KorbSchool of Information TechnologyMonash UniversityRoom , Bldg , Clayton, VictoriaAustraliakbkorb@gmail.com

Stefan KramerInstitut für Informatik/ITechnische Universität MünchenBoltzmannstr. Garching b. MünchenGermanykramer@in.tum.de

xviii List of Contributors

Krzysztof KrawiecInstitute of Computing SciencePoznan University of TechnologyPiotrowo- PoznanPolandkrawiec@cs.put.poznan.pl

Nicolas LachicheImage Sciences, Computer Sciences and RemoteSensing Laboratory, bld Brant llkirch-GraffenstadenFranceNicolas.Lachiche@urs.u-strasbg.fr

Michail G. LagoudakisDepartment of Electronic and Computer EngineeringTechnical University of Crete ChaniaCreteGreecelagoudakie@intelligence.tuc.gr

John LangfordYahoo ResearchNew York, NY USAjl@yahoo-inc.com

Pier Luca LanziDipartimento di Elettronica e InformazionePolitecnico di MilanoMilano Italylanzi@elet.polimi.it

Nada LavracDepartment of Knowledge TechnologiesJožef Stefan InstituteJamova LjubljanaSloveniaFaculty of Information TechnologyUniversity of Nova GoricaVipavska Nova GoricaSlovenia

Christina LeslieComputational Biology ProgramSloan-Kettering InstituteMemorial Sloan-Kettering Cancer Center York AveMail Box #New York, NY cleslie@cbio.mskcc.org

Shiau Hong LimUniversity of IllinoisILUSAshonglim@uiuc.edu

Charles X. LingThe University of Western OntarioCanadadr_charles_ling@yahoo.com

Huan LiuComputer Science and EngineeringIra Fulton School of EngineeringArizona State UniversityBrickyard Suite South Mill AvenueTempe, AZ -USAhuan.liu@asu.edu

Bin LiuFaculty of Information TechnologyMonash UniversityMelbourne Australiabin.liu@infotech.monash.edu.au

John LloydCollege of Engineering and Computer ScienceThe Australian National University, Canberra ACTAustraliajwl@mail.rise.anu.edu.au

Shie MannorDepartment of Electrical EngineeringIsrael Institute of TechnologyTechnionTechnion City HaifaIsraelshie@ee.technion.ac.il

List of Contributors xix

Eric MartinDepartment of Artificial IntelligenceSchool of Computer Science and EngineeringUniversity of New South WalesNSW SydneyAustraliaemartin@cse.unsw.edu.au

Serafín Martínez-JaramilloGeneral Directorate of Financial System AnalysisFinancial System Analysis DivisionBank of MexicoAv. de Mayo No. Col. Centro, C.P. Mexico, D.Fsmartin@banxico.org.mx

Stan MatwinSchool of Information Technology and EngineeringUniversity of OttawaOttawa, ONCanadastan@site.uottawa.ca

Julian McAuleyStatistical Machine Learning ProgramDepartment of Engineering andComputer ScienceNational University of AustraliaNICTA, Locked Bag Canberra ACT Australiajulian.mcauley@nicta.com.au

Prem MelvilleMachine LearningIBM T. J. Watson Research CenterRoute /P.O. Box Kitchawan RdYorktown Heights, NY USApmelvil@us.ibm.com

Pietro MichelucciStrategic Analysis, Inc. Wilson BlvdSuite Arlington, VA USApmichelucci@sainc.com

Rada MihalceaDepartment of Computer Scienceand EngineeringUniversity of North TexasDenton, TX -USArada@cs.unt.edu

Risto MiikkulainenDepartment of Computer SciencesThe University of Texas at Austin University Station CAustin, TX -USAristo@cs.utexas.edu

Dunja MladenicDepartment of Knowledge TechnologiesJožef Stefan InsituteJamova , LjubljanaSloveniaDunja.Mladenic@ijs.si

Katharina MorikDepartment of Computer ScienceTechnische Universität DortmundDortmundGermanykatharina.morik@tu-dortmund.de

Jun MorimotoAdvanced TelecommunicationResearch Institute International ATRKyotoJapan

Abdullah MueenDepartment of Computer Science and EngineeringUniversity California-RiversideRiverside, CA USA

Paul MunroSchool of Information SciencesUniversity of PittsburghPittsburgh, PAUSApmunro@mail.sis.pitt.edu

xx List of Contributors

Ion MusleaLanguage Weaver, Inc. Admiralty Way, Suite Marina del Rey, CA USAimuslea@languageweaver.com

Galileo NamataDepartment of Computer ScienceUniversity of MarylandCollege Park, MD USA

Sriraam NatarajanDepartment of Computer SciencesUniversity of Wisconsin Medical School University AvenueMadison, WI USAnatarasr@biostat.wisc.edu

Andrew Y. NgStanford AI LaboratoryStanford University Serra Mall, Gates Building AStanford, CA -USAang@cs.stanford.edu

Siegfried NijssenInstitut für InformatikAlbert-Ludwigs-Universität FreiburgGeorges-Köhler-Allee, Gebäude Freiburg i. Br.Germanysnijssen@informatik.uni-freiburg.de

William Stafford NobleDepartment of Genome SciencesUniversity of WashingtonSeattle, WAUSAnoble@gs.washington.edu

Petra Kralj NovakDepartment of Knowledge TechnologiesJožef Stefan InstituteJamova LjubljanaSloveniaPetra.Kralj.Novak@ijs.si

Daniel OblingerDARPA/IPTO Fairfax DriveArlington, VA USAoblinger@pobox.com

Peter OrbanzDepartment of EngineeringCambridge UniversityTrumpington StreetCambridge, CB PZUK

Miles OsborneInstitute for Communicating andCollaborative SystemsUniversity of Edinburgh Buccleuch PlaceEdinburgh EH LWScotlandUKmiles@inf.ed.ac.uk

C. David pageDepartment of Biostatistics and Medical InformaticsUniversity of Wisconsin Medical School University AvenueMadison, WI USApage@biostat.wisc.edu

Jonathan PatrickTelfer School of ManagementUniversity of Ottawa Laurier avenueOttawa, ON KN NCanadapatrick@telfer.uottawa.ca

Claudia PerlichData Analytics Research GroupIBM T.J. Watson Research CenterP.O. Box Yorktown Heights, NY USAperlich@us.ibm.com

List of Contributors xxi

Jan PetersDepartment of EmpiricalInference and Machine LearningMax Planck Institute for Biological CyberneticsSpemannstr. TuebingenGermanymail@jan-peters.net

Bernhard PfahringerDepartment of Computer ScienceUniversity of WaikatoPrivate Bag HamiltonNew Zealandbernhard@cs.waikato.ac.nz

Steve PoteetBoeing Phantom WorksP.O. Box MC L-Seattle, WAUSA

Pascal PoupartSchool of Computer ScienceUniversity of Waterloo University Avenue WestWaterlooON NL GCanadapponpart@cs.uwaterloo.ca

Rob PowersComputer Science DepartmentStanford University Serra MallStanford, CA USApowers@cs.stanford.edu

Cecilia M. ProcopiucAT&T LabsFlorham Park, NJUSAmagda@research.att.com

Martin L. PutermanCentre for Health Care ManagementSauder School of BusinessUniversity of British Columbia Main MallVancouver, BC VT ZCanadamarty@chem.ubc.ca

Lesley QuachBoeing Phantom WorksP.O. Box MC L-Seattle, WAUSA

Novi QuadriantoDepartment of Engineering and Computer ScienceAustralian National University NICTA London CircuitCanberra ACT Australianovi.quadrianto@nicta.com.au

Luc De RaedtDepartment of Computer ScienceKatholieke Universiteit LeuvenCelestijnenlaan ABE - HeverleeBelgiumluc.deraedt@cs.kuleuven.be

Dev RajnarayanNASA Ames Research CenterMail Stop -Moffett Field, CA USA

Adwait RatnaparkhiYahoo! LabsSanta ClaraCaliforniaUSAadwait_ratnaparkhi@yahoo.com

Soumya RaySchool of EECSOregon State University Kelley Engineering CenterCorvallis, ORUSAsray@eecs.oregonstate.edu

xxii List of Contributors

Mark ReidResearch School of Information Sciences andEngineeringThe Australian National UniversityCanberra, ACT Australiamark.reid@anu.edu.au

Jean-Michel RendersXerox Research Centre Europe, chemin de Maupertuis MeylanFrance

John RischPacific Northwest National Laboratory

Jorma RissanenComplex Systems Computation GroupDepartment of Computer ScienceHelsinki Institute of Information TechnologyHelsinki FinlandJorma.Rissanen@hiit.fi

Nicholas RoyMassachusetts Institute of TechnologyCambridge, MAUSA

Lorenza SaittaUniversità del Piemonte OrientaleAlessandriaItalyMichele.Sebag@lri.fr

Yasubumi SakakibaraDepartment of Biosciences and InformaticsKeio Universityyasu@bio.keio.ac.jpHiyoshiKohoku-kuJapan

Claude SammutSchool of Computer Science and EngineeringThe University of New South WalesSydneyNSW Australiaclaude@cse.unsw.edu.au

Joerg SanderDepartment of Computing ScienceUniversity of AlbertaEdmonton, ABCanadajoerg@cs.ualberta.ca

Scott SannerStatistical Machine Learning GroupNICTA, London Circuit, Tower AACT CanberraAustraliascott.sanner@nicta.com.au

Stefan SchaalDepartment of Computer ScienceUniversity of Southern CaliforniaATR Computational Neuroscience Labs Watt WayLos Angeles, CA -USAsschaal@usc.edu

Ute SchmidDepartment of Information Systemsand Applied Computer ScienceUniversity of BambergFeldkirchenstr. BambergGermanyute.schmid@uni-bamberg.de

Stephen ScottUniversity of NebraskaLincoln, NEUSA

Michele SebagLaboratoire de Recherche en InformatiqueUniversité Paris-SudBât OrsayFranceMichele.Sebag@lri.fr

Prithviraj SenUniversity of MarylandAV Williams Bldg, Rm College Park, MD USA

List of Contributors xxiii

Hanhuai ShanDepartment of Computer Science and EngineeringUniversity of MinnesotaMinneapolis, MNUSAshan@cs.umn.edu

Hossam ShararaDepartment of Computer ScienceUniversity of MarylandCollege Park, MD MarylandUSA

Victor S. ShengThe University of Western OntarioCanada

Jelber Sayyad ShirabadSchool of Information Technologyand EngineeringUniversity of Ottawa King EdwardP.O. Box Stn A, KN NOttawa, OntarioCanadajsayyad@site.uottawa.ca

Yoav ShohamComputer Science DepartmentStanford University Serra MallStanford, CA USAshoham@standford.edn

Thomas R. ShultzDepartment of Psychology andSchool of Computer ScienceMcGill University Dr. Penfield AvenueMontréalQC HA BCanadathomas.shultz@mcgill.ca

Ricardo SilvaGatsby Computational Neuroscience UnitUniversity College LondonAlexandra House Queen SquareLondon WCN ARUKrbas@gatsby.ucl.ac.uk

Vikas SindhwaniIBM T. J. Watson Research CenterRoute /P.O. Box Kitchawan RdYorktown Heights, NY USA

Moshe SipperDepartment of Computer ScienceBen-Gurion UniversityP.O. Box Beer-Sheva Israelsipper@cs.bgu.ac.il

William D. SmartAssociate ProfessorDepartment of Computer Science and EngineeringWashington University in St. LouisCampus Box One Brookings DriveSt. Louis, MO USAwds@cse.wustl.edu

Carlos SoaresLIAAD-INESC Porto L.A./Faculdade de EconomiaLaboratory of Artificial Intelligenceand Computer ScienceUniversity of PortoRua de Ceuta n. .piso, -PortoPortugal

Christian SohlerHeinz Nixdorf Institute & Computer Science DepartmentUniversity of PaderbornFuerstenallee PaderbornGermanycsohler@upb.de

xxiv List of Contributors

Frank StephanDepartment of Computer Scienceand Department of MathematicsNational University of SingaporeSingapore Republic of Singaporefstephan@comp.nus.edu.sg

Peter StoneDepartment of Computer SciencesThe University of Texas at AustinAustin, TXUSApstone@cs.utexas.edu

Alexander L. StrehlDepartment of Computer ScienceRutgers University Frelinghuysen RoadPiscataway, NJ USAstrehl@cs.rutgers.edu

Prasad TadepalliSchool of Electrical Engineering and Computer ScienceOregon State University Kelley Engineering CenterCorvallis, OR -USAtadepall@eecs.oregonstate.edu

Russ TedrakeDepartment of Computer ScienceMassachusetts Institute of Technology Vassar StreetCambridge, MA USArusst@mit.edu

Yee Whye TehGatsby Computational Neuroscience UnitUniversity College London Queen SquareLondon WCN ARUKyeewhye@gmail.com

Jon TimmisDepartment of Computer Scienceand Department of ElectronicsUniversity of YorkHeslingtonYork DDUKjtimmis@cs.york.ac.uk

Jo-Anne TingUniversity of Edinburgh

Kai Ming TingGippsland School of Information TechnologyMonash UniversityGippsland Campus Churchill, VictoriaAustraliakaiming.ting@infotech.monash.edu.au

Ljupco TodorovskiFaculty of AdministrationUniversity of LjubljanaGosarjeva LjubljanaSloveniaLjupco.Todorovski@fu.uni-lj.si

Hannu ToivonenDepartment of Computer ScienceUniversity of HelsinkiP.O. Box (Gustaf Hällströmin katu b) HelsinkiFinlandhannu.toivonen@cs.helsinki.fi

Luís TorgoDepartment of Computer ScienceFaculty of SciencesUniversity of PortoRua Campo Alegre/, –PortoPortugalltorgo@dcc.fc.up.pt

Panayiotis TsaparasMicrosoft ResearchMicrosoftMountain View, CAUSApanayiotis.tsaparas@micorsoft.com

List of Contributors xxv

Paul E. UtgoffDepartment of Computer ScienceUniversity of Massachusetts Governor’s DriveAmherst, MA –USA

William UtherNICTA and the University of New South WalesWilliam.Uther@nicta.com.au

Sethu VijayakumarUniversity of EdinburghUniversity of Southern California

Ricardo VilaltaDepartment of Computer ScienceUniversity of Houston Calhoun RdHouston, TX -USA

Michail VlachosIBM Zürich Research LaboratorySäumerstrasse RüschlikonSwitzerlandmichaliso@gmail.com

Kiri L. WagstaffMachine Learning SystemsJet Propulsion LaboratoryCalifornia Institute of TechnologyPasadena, CAUSAkiri.wagstaff@jpl.nasa.gov

Geoffrey I. WebbFaculty of Information TechnologyClayton School of Information TechnologyMonash UniversityP.O. Box Victoria AustraliaGeoff.Webb@monash.edu

R. Paul WiegandInstitute for Simulation and TrainingUniversity of Central FloridaOrlando, FLUSApaul@tesseraet.orgwiegand@ist.ucf.edu

Eric WiewioraUniversity of CaliforniaSan Diegoewiewior@cs.ucsd.edu

Anthony WirthDepartment of Computer Scienceand Software EngineeringThe University of MelbourneVictoria Australiaawirth@csse.unimelb.edu.au

Michael WitbrockCycorp, Inc. Executive Center DriveAustin, TX USAwitbrock@cyc.com

David WolpertNASA Ames Research CenterMoffett Field, CAUSAdhw@ptolemy.arc.nasa.gov

Stefan WrobelDepartment of Computer ScienceUniversity of Bonn, and Fraunhofer IAIS(Institute for Intelligent Analysis andInformation Systems) Fraunhofer IAISSchloss Birlinghoven Sankt AugustinGermany

Jason WuBoeing Phantom WorksP.O. Box MC L-Seattle, WAUSA

Zhao XuKnowledge DiscoveryFraunhofer IAISSchloß Birlinghoven Sankt AugustinGermany

xxvi List of Contributors

Ying YangAustralian Taxation Office White Horse RoadBox HillVIC AustraliaYing.Yang@ato.gov.au

Sungwook YoonPARC LabsCoyote Hill RoadPalo Alto, CAUSA

Thomas ZeugmannDivision of Computer ScienceGraduate School ofInformation Science and TechnologyHokkaido UniversitySapparoJapanthomas@ist.hokudai.ac.jp

Xinhua ZhangSchool of Computer ScienceAustralian National UniversityNICTA London CircuitCanberraAustraliaxinhua.zhang@anu.edu.au

Ying ZhaoDepartment of Computer Science and TechnologyTsinghua UniversityBeijing China

Fei ZhengFaculty of Information TechnologyMonash UniversityClayton School of I.T.Room , Bldg Wellington RoadClaytonMelbourneVictoria Australiafei.zheng@infotech.monash.edu.au

Xiaojin ZhuDepartment of Computer SciencesUniversity of Wisconsin-Madison West Dayton Street, Madison, WIUSAjerryzhu@cs.wisc.edu