machine learning - stephan robert€¦ · few good books (not necessary to buy them, just download...

Machine Learning Stephan Robert | HEIG-Vd | Summer University 2017

Upload: others

Post on 05-Jun-2020

4 views

Category:

Documents

0 download

Report

Download

Embed Size (px):

TRANSCRIPT

Machine Learning

StephanRobert|HEIG-Vd|SummerUniversity2017

Few good books (Not necessary to buy them, just download them. Free access)

•  Machine Learning, Tom Mitchell•  Machine Learning, Kevin Murphy

Web page and links... Handoutsandlectureslides

  Documentation,links,softwareresources

  Announcementsandschedule

  Email(labs)

  Slidesathttp://www.stephan-robert.ch/teaching/machine-learning

Page 5: Machine Learning - Stephan Robert€¦ · Few good books (Not necessary to buy them, just download them. Free access) • Machine Learning, Tom Mitchell • Machine Learning, Kevin

… and links...

  Kaggle.com(competitions,jobs,…)

  Datascience.net

Page 6: Machine Learning - Stephan Robert€¦ · Few good books (Not necessary to buy them, just download them. Free access) • Machine Learning, Tom Mitchell • Machine Learning, Kevin

Python tutorials and books

  docs.python.org/3/tutorial/index.html

  wiki.python.org/moin/IntroductoryBooks

Page 7: Machine Learning - Stephan Robert€¦ · Few good books (Not necessary to buy them, just download them. Free access) • Machine Learning, Tom Mitchell • Machine Learning, Kevin

Python environment

  Pythonrelease3.6

  AnacondaNavigator(Jupyter,Ipython,Spyder,…)

Page 8: Machine Learning - Stephan Robert€¦ · Few good books (Not necessary to buy them, just download them. Free access) • Machine Learning, Tom Mitchell • Machine Learning, Kevin

Python libraries

  Numpy

  Pandas

  Matplotlib

  Scikit-learn

  Scipy

Page 9: Machine Learning - Stephan Robert€¦ · Few good books (Not necessary to buy them, just download them. Free access) • Machine Learning, Tom Mitchell • Machine Learning, Kevin

Syllabus

  Lesson1:IntroductiontoMachineLeraning,GradientDescent(costfunction,manyvariables)

  Lesson2:Linearregression,logisticregression

  Lesson3:Supportvectormachines

  Lesson4:Unsupervisedlearning(PCA,k-means,K-nearestneighbor,classification)

Page 10: Machine Learning - Stephan Robert€¦ · Few good books (Not necessary to buy them, just download them. Free access) • Machine Learning, Tom Mitchell • Machine Learning, Kevin

Homeworks

  HW1:GradientDescent

  HW2:Linearandlogisticregression

  HW3:SupportVectorMachines

  HW4:Unsupervisedlearning

Page 11: Machine Learning - Stephan Robert€¦ · Few good books (Not necessary to buy them, just download them. Free access) • Machine Learning, Tom Mitchell • Machine Learning, Kevin

Eachgroupofstudents(1-2studentspergroup)mustwritetheirowncodefortheprogrammingpartPleasedon’tsearchforanswersontheweb,Google,previousyears’homeworks,etc.

  HW1,2,3:Groupoftwostudents(1fromSNU+1fromHEIG-Vd)

  HW4:Individual

Homeworks

Page 12: Machine Learning - Stephan Robert€¦ · Few good books (Not necessary to buy them, just download them. Free access) • Machine Learning, Tom Mitchell • Machine Learning, Kevin

Grading

•  4homeworks -Deadlines: HW1:August15,24:00 HW2:August16,24:00 HW3:August17,24:00 HW4:August18,24:00

•  Final written test/quiz (1 hour), August 18 (No

documentation)

Page 13: Machine Learning - Stephan Robert€¦ · Few good books (Not necessary to buy them, just download them. Free access) • Machine Learning, Tom Mitchell • Machine Learning, Kevin

Machine Learning is changing the world

Page 14: Machine Learning - Stephan Robert€¦ · Few good books (Not necessary to buy them, just download them. Free access) • Machine Learning, Tom Mitchell • Machine Learning, Kevin

Few videos...

•  NVIDIA Opening Keynote Highlights at CES 2017https://www.youtube.com/watch?v=ljSpat74w10

Page 15: Machine Learning - Stephan Robert€¦ · Few good books (Not necessary to buy them, just download them. Free access) • Machine Learning, Tom Mitchell • Machine Learning, Kevin

What is Machine Learning?

•  Study of algorithms that improve their performances at some tasks with experience

Page 16: Machine Learning - Stephan Robert€¦ · Few good books (Not necessary to buy them, just download them. Free access) • Machine Learning, Tom Mitchell • Machine Learning, Kevin

Supervised learning

•  Knowledgeofoutput

Learningwiththepresenceofanexpert(e.g.NeuralNetworks,SupportVectorMachines,DecisionTrees,BayesianClassifiers,…)

Page 17: Machine Learning - Stephan Robert€¦ · Few good books (Not necessary to buy them, just download them. Free access) • Machine Learning, Tom Mitchell • Machine Learning, Kevin

ExampleofhousespricesinLausanne

House price prediction Supervised learning: regression

Page 18: Machine Learning - Stephan Robert€¦ · Few good books (Not necessary to buy them, just download them. Free access) • Machine Learning, Tom Mitchell • Machine Learning, Kevin

House price prediction Supervised learning

Page 19: Machine Learning - Stephan Robert€¦ · Few good books (Not necessary to buy them, just download them. Free access) • Machine Learning, Tom Mitchell • Machine Learning, Kevin

House price prediction Supervised learning

Page 20: Machine Learning - Stephan Robert€¦ · Few good books (Not necessary to buy them, just download them. Free access) • Machine Learning, Tom Mitchell • Machine Learning, Kevin

House price prediction Supervised learning

Page 21: Machine Learning - Stephan Robert€¦ · Few good books (Not necessary to buy them, just download them. Free access) • Machine Learning, Tom Mitchell • Machine Learning, Kevin

Spam filtering Supervised learning: classification

NotSpamTextofemail,IPSource,… Spam

input output

Page 22: Machine Learning - Stephan Robert€¦ · Few good books (Not necessary to buy them, just download them. Free access) • Machine Learning, Tom Mitchell • Machine Learning, Kevin

Other examples Supervised learning: classification

•  Sentimentanalysis•  Personalizedmedicaldiagnosis(multiple

outputs:flu,healthy,…)

Page 23: Machine Learning - Stephan Robert€¦ · Few good books (Not necessary to buy them, just download them. Free access) • Machine Learning, Tom Mitchell • Machine Learning, Kevin

Stock prediction Supervised learning

Depends on recent historyof stock market, newsevents,…

(Vodafone)

Page 24: Machine Learning - Stephan Robert€¦ · Few good books (Not necessary to buy them, just download them. Free access) • Machine Learning, Tom Mitchell • Machine Learning, Kevin

Unsupervised learning

•  NoKnowledgeofoutput

Learningwithoutthepresenceofanexpert(e.gk-means,clusteringapproaches,…)

Page 25: Machine Learning - Stephan Robert€¦ · Few good books (Not necessary to buy them, just download them. Free access) • Machine Learning, Tom Mitchell • Machine Learning, Kevin

Unsupervised learning

news.google.com

Page 26: Machine Learning - Stephan Robert€¦ · Few good books (Not necessary to buy them, just download them. Free access) • Machine Learning, Tom Mitchell • Machine Learning, Kevin

Unsupervised learning

Clusteringimages,groupas:

•  Clouds•  Mountains•  Roads

Page 27: Machine Learning - Stephan Robert€¦ · Few good books (Not necessary to buy them, just download them. Free access) • Machine Learning, Tom Mitchell • Machine Learning, Kevin

Unsupervised learning

Otherexamples

•  UsersonWebsites(groups,activities)•  Words(Firstnames,lastnames,location

words,…)

Buyer’s Guide to AI and Machine Learning - MapR€¦ · AI and machine learning applications are worthless until you deploy them and have them start making decisions. These needs

Machine Learning Introduction Machine learningbejar/ia/transpas/teoria.mti/6-AP-aprendizaj… · Machine Learning Introduction Types of machine learning Inductive Learning: Models

machine Learning Learning

MACHINE LEARNING AN INTRODUCTION - Sas Institute · 2016-03-11 · MACHINE LEARNING - AN INTRODUCTION WHAT IS MACHINE LEARNING? Wikipedia: Machine learning, a branch of artificial

Machine Learning on Spark - UC Berkeley AMP Campampcamp.berkeley.edu/.../Machine-Learning-on-Spark... · Machine Learning on Spark Shivaram Venkataraman ... Machine learning algorithms

Bayesian Methods for Machine Learning - Machine Learning (Theory)

Research Ethics in Machine Learningcerna-ethics-allistene.org/.../54730_cerna_2017_machine_learning.pdf · What is machine learning? ... them through the specific method of multi-layer

¿Qué es Machine Learning? Usos de Machine Learning

Machine Learning: Machine Learning: Introduction Introduction

Machine Learning: Machine Learning:

Fast Track Machine Learning Part 1 (Machine Learning Overview) - Types of Machine Learning Problems

1 A Machine Learning-Driven Evolutionary Approach for ... · associated with bypassing the WAF and evolve them to generate new successful bypassing attacks. Machine learning is used

Polyphone Disambiguation with Machine Learning Approaches Disambiguation with Machine Learning...[5], among the 10 most frequent characters, 6 of them are polyphones: “ 的 ”,

Machine Learning Chapter 11. 2 Machine Learning What is learning?

Machine Learning for NLP - Ethics and Machine Learning

Machine Learning for Makers: Interactive Sensor …bjoern/papers/mellis...machine learning algorithms and rely on the user to conﬁgure them for particular domains. This approach

Machine Learning Made Easy€¦ · Machine Learning –What is Machine Learning and why do we need it? –Common challenges in Machine Learning Example 1: Human activity learning

Machine Learning – CSE4546 Kevin Jamieson University of ... · How do we choose the filters? - Hand design them (digital signal processing, c.f. wavelets) - Learn them (deep learning)

Machine learning for neuroimaging with scikit-learn · Machine learning for neuroimaging with scikit-learn. ... a Python machine learning library, ... Abraham et al. Machine learning

Data ethics and machine learning: discrimination, algorithmic bias, and how to discover them. Dino Pedreschi

An Introduction to Machine Learning - GitHub Pages · Introduction Machine learning The machine learning process What’s machine learning History Supervised learning Non-supervised

Machine Learning with MATLAB - … · 2 Agenda Machine Learning Overview Machine Learning with MATLAB –Unsupervised Learning Clustering –Supervised Learning Classification

1. Introduction to Machine - lis-lab.fr › bernard.espinasse › ... · § 1. Introduction to Machine Learning § Machine Learning Problem § Machine Learning: Supervised & Unsupervised

Machine Learning-Deep Learning Fondement et biaisfiles.meetup.com/19203187/FondetBiaisMLDLonline.pdf · Machine Learning-Deep Learning Fondement et biais Machine learning Aix-Marseille

Chapter- 6 : Machine Learning - IOE Notesioenotes.edu.np › media › ...Chapter-6-machine-learning... · Chapter- 6 : Machine Learning-Machine learning is a branch of AI that uses

Machine Learning FabSpace March 2018 - irit.fr Learning FabSpace March 2018... · Machine Learning 5 Machine Learning • Supervised : Train / test • Predictiveanalysis Machine

11 Machine Learning Important Issues in Machine Learning

Machine Learning in Logistics: Machine Learning Algorithmsltu.diva-portal.org/smash/get/diva2:1118764/FULLTEXT02.pdf · Machine Learning in Logistics: Machine Learning ... Machine

1-Machine Learning in Oracle - ITOUG2017/12/01 · – Oracle Machine Learning (on Oracle Autonomous Data Warehouse Cloud Service) – Automated Machine Learning => Machine Learning

Machine Learning - 0. Overview€¦ · Machine Learning 1. What is Machine Learning? One area of research, many names (and aspects) machine learning historically, stresses learning

CS7267 Machine Learning introduction to machine learning

Machine Learning and Azure Machine Learning

Learning with large datasets Machine Learning Large scale machine learning

Machine Learning - apiacoa.orgapiacoa.org/publications/teaching/machine-learning/machine... · Machine Learning Fabrice Rossi ... I chess program ... Machine programming I climbing

Masters of Craft: Programming - Machine Learning : Research · Masters of Craft: Programming - Machine Learning: Research Janet Choi. Machine Learning Machine Learning is a trend