eecs4404 introduction to machine learning and pattern ... · eecs4404 introduction to machine...
TRANSCRIPT
![Page 1: EECS4404 Introduction to Machine Learning and Pattern ... · EECS4404 Introduction to Machine Learning and Pattern Recognition Lecture 1 Amir Ashouri York University September 4,](https://reader030.vdocuments.site/reader030/viewer/2022040214/5ec4617317d06d7cdf35ba9a/html5/thumbnails/1.jpg)
EECS4404Introduction to Machine Learning
and Pattern RecognitionLecture 1
Amir Ashouri
York University
September 4, 2019
Contents are largely based on the slides of Prof. Ruth Urner
![Page 2: EECS4404 Introduction to Machine Learning and Pattern ... · EECS4404 Introduction to Machine Learning and Pattern Recognition Lecture 1 Amir Ashouri York University September 4,](https://reader030.vdocuments.site/reader030/viewer/2022040214/5ec4617317d06d7cdf35ba9a/html5/thumbnails/2.jpg)
Organization of the class
![Page 3: EECS4404 Introduction to Machine Learning and Pattern ... · EECS4404 Introduction to Machine Learning and Pattern Recognition Lecture 1 Amir Ashouri York University September 4,](https://reader030.vdocuments.site/reader030/viewer/2022040214/5ec4617317d06d7cdf35ba9a/html5/thumbnails/3.jpg)
Basic Information
• Instructor: Amir Ashouri ([email protected])
• Office Hours: Wednesdays (To be announced)
• Website: Currently being setup on wiki pages will be announced
![Page 4: EECS4404 Introduction to Machine Learning and Pattern ... · EECS4404 Introduction to Machine Learning and Pattern Recognition Lecture 1 Amir Ashouri York University September 4,](https://reader030.vdocuments.site/reader030/viewer/2022040214/5ec4617317d06d7cdf35ba9a/html5/thumbnails/4.jpg)
Lectures
Lecture times Mon, Wed, 14:30 - 16:00
Place CB 129, CC2 11
First lecture Today :) September 4
Last lecture Monday, December 2
Reading week October 12-18
More info https://registrar.yorku.ca/enrol/dates/fw19#2
![Page 5: EECS4404 Introduction to Machine Learning and Pattern ... · EECS4404 Introduction to Machine Learning and Pattern Recognition Lecture 1 Amir Ashouri York University September 4,](https://reader030.vdocuments.site/reader030/viewer/2022040214/5ec4617317d06d7cdf35ba9a/html5/thumbnails/5.jpg)
Evaluation
Assignments:
• 3 Assignments
• Roughly due end of September/October/November
• Mix of theoretical and programming questions
Tests:
• In-class midterm (tentatively October 23)
• Final exam (December 5 - 20)
Presentations (for graduate students)
• Short presentation (10-15 minutes) on a ML
research paper
• Paper to be selected in discussion with
instructor
![Page 6: EECS4404 Introduction to Machine Learning and Pattern ... · EECS4404 Introduction to Machine Learning and Pattern Recognition Lecture 1 Amir Ashouri York University September 4,](https://reader030.vdocuments.site/reader030/viewer/2022040214/5ec4617317d06d7cdf35ba9a/html5/thumbnails/6.jpg)
Evaluation
EECS4404
• 30 % Assignments
• 30 % Midterm
• 40 % Final exam
eecs5327
• 25 % Assignments
• 25 % Midterm
• 35 % Final exam
• 15 % Project/Paper presentation
![Page 7: EECS4404 Introduction to Machine Learning and Pattern ... · EECS4404 Introduction to Machine Learning and Pattern Recognition Lecture 1 Amir Ashouri York University September 4,](https://reader030.vdocuments.site/reader030/viewer/2022040214/5ec4617317d06d7cdf35ba9a/html5/thumbnails/7.jpg)
Textbooks
Pattern Recognition and MachineLearning (PRML)by Christopher M.Bishop. Springer.(2006).
• Available on Amazon.• Available in bookstore
Deep Learningby Ian Goodfellow, Yoshua Bengio andAaron Courville.www.deeplearningbook.org. (2016)
• Available on Amazon.
• Full content from deeplearning.orgwebsite:https://www.deeplearningbook.org/contents/TOC.html
![Page 8: EECS4404 Introduction to Machine Learning and Pattern ... · EECS4404 Introduction to Machine Learning and Pattern Recognition Lecture 1 Amir Ashouri York University September 4,](https://reader030.vdocuments.site/reader030/viewer/2022040214/5ec4617317d06d7cdf35ba9a/html5/thumbnails/8.jpg)
Material
Lectures will include a mixture of high level motivation andexplanations and low-level derivations
Material in readings and lectures will overlap but won’t beidentical. You are responsible for both!
Slides used in class will generally be posted to the course websitethe day within 24 hours after lecture.
In cases where lectures are delivered on the board, these notes maynot be posted. Don’t skip lectures and plan to catch up bylooking at the posted notes!
![Page 9: EECS4404 Introduction to Machine Learning and Pattern ... · EECS4404 Introduction to Machine Learning and Pattern Recognition Lecture 1 Amir Ashouri York University September 4,](https://reader030.vdocuments.site/reader030/viewer/2022040214/5ec4617317d06d7cdf35ba9a/html5/thumbnails/9.jpg)
Programming
Assignments to be in done in Matlab and TensorFlow:• We use Python/TensorFlow for our Deep Learning assignment• We use Matlab for the other assignments
• Available on EECS lab machines and can be installed on yourown computers
• If you are not familiar with it, start working your way through atutorialhttps://www.tensorflow.org/tutorialshttps://www.mathworks.com/support/learn-with-matlab-tutorials.html
![Page 10: EECS4404 Introduction to Machine Learning and Pattern ... · EECS4404 Introduction to Machine Learning and Pattern Recognition Lecture 1 Amir Ashouri York University September 4,](https://reader030.vdocuments.site/reader030/viewer/2022040214/5ec4617317d06d7cdf35ba9a/html5/thumbnails/10.jpg)
Applications of ML
![Page 11: EECS4404 Introduction to Machine Learning and Pattern ... · EECS4404 Introduction to Machine Learning and Pattern Recognition Lecture 1 Amir Ashouri York University September 4,](https://reader030.vdocuments.site/reader030/viewer/2022040214/5ec4617317d06d7cdf35ba9a/html5/thumbnails/11.jpg)
ML Growth
![Page 12: EECS4404 Introduction to Machine Learning and Pattern ... · EECS4404 Introduction to Machine Learning and Pattern Recognition Lecture 1 Amir Ashouri York University September 4,](https://reader030.vdocuments.site/reader030/viewer/2022040214/5ec4617317d06d7cdf35ba9a/html5/thumbnails/12.jpg)
NIPS (NeurIPS) Attendance!
![Page 13: EECS4404 Introduction to Machine Learning and Pattern ... · EECS4404 Introduction to Machine Learning and Pattern Recognition Lecture 1 Amir Ashouri York University September 4,](https://reader030.vdocuments.site/reader030/viewer/2022040214/5ec4617317d06d7cdf35ba9a/html5/thumbnails/13.jpg)
(Deep) Neural Networks
![Page 14: EECS4404 Introduction to Machine Learning and Pattern ... · EECS4404 Introduction to Machine Learning and Pattern Recognition Lecture 1 Amir Ashouri York University September 4,](https://reader030.vdocuments.site/reader030/viewer/2022040214/5ec4617317d06d7cdf35ba9a/html5/thumbnails/14.jpg)
Convolutional Neural Networks (CNNs)
![Page 15: EECS4404 Introduction to Machine Learning and Pattern ... · EECS4404 Introduction to Machine Learning and Pattern Recognition Lecture 1 Amir Ashouri York University September 4,](https://reader030.vdocuments.site/reader030/viewer/2022040214/5ec4617317d06d7cdf35ba9a/html5/thumbnails/15.jpg)
TensorFlow Assignment
![Page 16: EECS4404 Introduction to Machine Learning and Pattern ... · EECS4404 Introduction to Machine Learning and Pattern Recognition Lecture 1 Amir Ashouri York University September 4,](https://reader030.vdocuments.site/reader030/viewer/2022040214/5ec4617317d06d7cdf35ba9a/html5/thumbnails/16.jpg)
TensorFlow Example
![Page 17: EECS4404 Introduction to Machine Learning and Pattern ... · EECS4404 Introduction to Machine Learning and Pattern Recognition Lecture 1 Amir Ashouri York University September 4,](https://reader030.vdocuments.site/reader030/viewer/2022040214/5ec4617317d06d7cdf35ba9a/html5/thumbnails/17.jpg)
Bag of ML Jargons
![Page 18: EECS4404 Introduction to Machine Learning and Pattern ... · EECS4404 Introduction to Machine Learning and Pattern Recognition Lecture 1 Amir Ashouri York University September 4,](https://reader030.vdocuments.site/reader030/viewer/2022040214/5ec4617317d06d7cdf35ba9a/html5/thumbnails/18.jpg)
Machine Learning examples
![Page 19: EECS4404 Introduction to Machine Learning and Pattern ... · EECS4404 Introduction to Machine Learning and Pattern Recognition Lecture 1 Amir Ashouri York University September 4,](https://reader030.vdocuments.site/reader030/viewer/2022040214/5ec4617317d06d7cdf35ba9a/html5/thumbnails/19.jpg)
Machine Learning - examples
Recommender systems
Consumer behavior analysis
Fraud detection
Computational Biology
Computer vision
Self driving cars
Speech recognition
Automated translation
Spam filters
Stock market prediction
Medical diagnosis
Logistics
Face recognition
Community detection
Character recognition
Species preservation
![Page 20: EECS4404 Introduction to Machine Learning and Pattern ... · EECS4404 Introduction to Machine Learning and Pattern Recognition Lecture 1 Amir Ashouri York University September 4,](https://reader030.vdocuments.site/reader030/viewer/2022040214/5ec4617317d06d7cdf35ba9a/html5/thumbnails/20.jpg)
Machine Learning
![Page 21: EECS4404 Introduction to Machine Learning and Pattern ... · EECS4404 Introduction to Machine Learning and Pattern Recognition Lecture 1 Amir Ashouri York University September 4,](https://reader030.vdocuments.site/reader030/viewer/2022040214/5ec4617317d06d7cdf35ba9a/html5/thumbnails/21.jpg)
Machine Learning – Why do we need it?
Some tasks are too complex to be implemented directly:
• Self driving cars
• Speech recognition
• Complex rules for classification tasks on high dimensional data
I Fraud detectionI Document classification
→ Learn a program based on data!
![Page 22: EECS4404 Introduction to Machine Learning and Pattern ... · EECS4404 Introduction to Machine Learning and Pattern Recognition Lecture 1 Amir Ashouri York University September 4,](https://reader030.vdocuments.site/reader030/viewer/2022040214/5ec4617317d06d7cdf35ba9a/html5/thumbnails/22.jpg)
Machine Learning – Why do we need it?
Some tasks are too complex to be implemented directly:
• Self driving cars
• Speech recognition
• Complex rules for classification tasks on high dimensional data
I Fraud detectionI Document classification
→ Learn a program based on data!
![Page 23: EECS4404 Introduction to Machine Learning and Pattern ... · EECS4404 Introduction to Machine Learning and Pattern Recognition Lecture 1 Amir Ashouri York University September 4,](https://reader030.vdocuments.site/reader030/viewer/2022040214/5ec4617317d06d7cdf35ba9a/html5/thumbnails/23.jpg)
Machine Learning – Why do we need it?
Some tasks are too complex to be implemented directly:
• Self driving cars
• Speech recognition
• Complex rules for classification tasks on high dimensional data
I Fraud detectionI Document classification
→ Learn a program based on data!
![Page 24: EECS4404 Introduction to Machine Learning and Pattern ... · EECS4404 Introduction to Machine Learning and Pattern Recognition Lecture 1 Amir Ashouri York University September 4,](https://reader030.vdocuments.site/reader030/viewer/2022040214/5ec4617317d06d7cdf35ba9a/html5/thumbnails/24.jpg)
What is machine learning?
First explanation:
• Development of algorithms which allow a computer to “learn”specific tasks from training examples.
• Learning means that the computer should not just memorizethe seen examples, but predict well on previously unseeninstances
• Ideally, the computer should use the examples to extract ageneral “rule” how the specific task has to be performedcorrectly.
![Page 25: EECS4404 Introduction to Machine Learning and Pattern ... · EECS4404 Introduction to Machine Learning and Pattern Recognition Lecture 1 Amir Ashouri York University September 4,](https://reader030.vdocuments.site/reader030/viewer/2022040214/5ec4617317d06d7cdf35ba9a/html5/thumbnails/25.jpg)
What is machine learning?
First explanation:
• Development of algorithms which allow a computer to “learn”specific tasks from training examples.
• Learning means that the computer should not just memorizethe seen examples, but predict well on previously unseeninstances
• Ideally, the computer should use the examples to extract ageneral “rule” how the specific task has to be performedcorrectly.