machine learning - eden au · supervised learning is the machine learning task of learning a...
TRANSCRIPT
![Page 1: Machine Learning - Eden Au · Supervised learning is the machine learning task of learning a function that maps an input to an output based on example input-output pairs. 6](https://reader030.vdocuments.site/reader030/viewer/2022040901/5e72230b0ed6c26a5968baee/html5/thumbnails/1.jpg)
Machine LearningEden Au, James Fulton
1
![Page 3: Machine Learning - Eden Au · Supervised learning is the machine learning task of learning a function that maps an input to an output based on example input-output pairs. 6](https://reader030.vdocuments.site/reader030/viewer/2022040901/5e72230b0ed6c26a5968baee/html5/thumbnails/3.jpg)
3http://joelgrus.com/2013/06/09/post-prism-data-science-venn-diagram/
![Page 4: Machine Learning - Eden Au · Supervised learning is the machine learning task of learning a function that maps an input to an output based on example input-output pairs. 6](https://reader030.vdocuments.site/reader030/viewer/2022040901/5e72230b0ed6c26a5968baee/html5/thumbnails/4.jpg)
4https://uk.mathworks.com/discovery/machine-learning.html
![Page 5: Machine Learning - Eden Au · Supervised learning is the machine learning task of learning a function that maps an input to an output based on example input-output pairs. 6](https://reader030.vdocuments.site/reader030/viewer/2022040901/5e72230b0ed6c26a5968baee/html5/thumbnails/5.jpg)
Supervised Learning
![Page 6: Machine Learning - Eden Au · Supervised learning is the machine learning task of learning a function that maps an input to an output based on example input-output pairs. 6](https://reader030.vdocuments.site/reader030/viewer/2022040901/5e72230b0ed6c26a5968baee/html5/thumbnails/6.jpg)
“ Supervised learning is the machine learning task of learning a function that maps an input to an output based on example input-output pairs.
6
![Page 7: Machine Learning - Eden Au · Supervised learning is the machine learning task of learning a function that maps an input to an output based on example input-output pairs. 6](https://reader030.vdocuments.site/reader030/viewer/2022040901/5e72230b0ed6c26a5968baee/html5/thumbnails/7.jpg)
7
![Page 8: Machine Learning - Eden Au · Supervised learning is the machine learning task of learning a function that maps an input to an output based on example input-output pairs. 6](https://reader030.vdocuments.site/reader030/viewer/2022040901/5e72230b0ed6c26a5968baee/html5/thumbnails/8.jpg)
The Machine● Linear regression ● K-nearest neighbours ● Support Vector Machines ● Random Forest● Naïve bayes
8
![Page 9: Machine Learning - Eden Au · Supervised learning is the machine learning task of learning a function that maps an input to an output based on example input-output pairs. 6](https://reader030.vdocuments.site/reader030/viewer/2022040901/5e72230b0ed6c26a5968baee/html5/thumbnails/9.jpg)
9Wikipedia
![Page 10: Machine Learning - Eden Au · Supervised learning is the machine learning task of learning a function that maps an input to an output based on example input-output pairs. 6](https://reader030.vdocuments.site/reader030/viewer/2022040901/5e72230b0ed6c26a5968baee/html5/thumbnails/10.jpg)
Linear Regression - Ordinary Least Squares1. Linearity (solved by feature engineering e.g. polynomial regression)2. Error-free inputs (solved by generalized least squares)3. Common variance (solved by weighted least squares)
10
Wikipedia
![Page 11: Machine Learning - Eden Au · Supervised learning is the machine learning task of learning a function that maps an input to an output based on example input-output pairs. 6](https://reader030.vdocuments.site/reader030/viewer/2022040901/5e72230b0ed6c26a5968baee/html5/thumbnails/11.jpg)
K-nearest neighbours1. Inherently non-linear
(non-parametric)2. Simple3. Parameter selection4. High memory requirement -
slow prediction stage
11
![Page 12: Machine Learning - Eden Au · Supervised learning is the machine learning task of learning a function that maps an input to an output based on example input-output pairs. 6](https://reader030.vdocuments.site/reader030/viewer/2022040901/5e72230b0ed6c26a5968baee/html5/thumbnails/12.jpg)
Main Challenges - Feature Engineering
Shallow learning requires feature engineering
12
![Page 13: Machine Learning - Eden Au · Supervised learning is the machine learning task of learning a function that maps an input to an output based on example input-output pairs. 6](https://reader030.vdocuments.site/reader030/viewer/2022040901/5e72230b0ed6c26a5968baee/html5/thumbnails/13.jpg)
ArtificialNeural Network
![Page 14: Machine Learning - Eden Au · Supervised learning is the machine learning task of learning a function that maps an input to an output based on example input-output pairs. 6](https://reader030.vdocuments.site/reader030/viewer/2022040901/5e72230b0ed6c26a5968baee/html5/thumbnails/14.jpg)
Neural NetworksEach layer consists of
1. Linear regression2. Non-linear ‘activation’
Multiple layers of network enables
1. Sophisticated features to be learned
Problem:
1. So many parameters - requires much more data
14
![Page 15: Machine Learning - Eden Au · Supervised learning is the machine learning task of learning a function that maps an input to an output based on example input-output pairs. 6](https://reader030.vdocuments.site/reader030/viewer/2022040901/5e72230b0ed6c26a5968baee/html5/thumbnails/15.jpg)
ConvolutionalNeural Network
![Page 16: Machine Learning - Eden Au · Supervised learning is the machine learning task of learning a function that maps an input to an output based on example input-output pairs. 6](https://reader030.vdocuments.site/reader030/viewer/2022040901/5e72230b0ed6c26a5968baee/html5/thumbnails/16.jpg)
CNN1. Leverages spatio-temporal
relationships2. Applies discrete convolution
operations3. Kernels are the only trainable
parameters - reduce # parameters
4. Insights in kernels:
16
![Page 17: Machine Learning - Eden Au · Supervised learning is the machine learning task of learning a function that maps an input to an output based on example input-output pairs. 6](https://reader030.vdocuments.site/reader030/viewer/2022040901/5e72230b0ed6c26a5968baee/html5/thumbnails/17.jpg)
Compressing and separatinginformation
The value of each pixel does not matter, the relationships among neighbouring pixels do.
17
![Page 18: Machine Learning - Eden Au · Supervised learning is the machine learning task of learning a function that maps an input to an output based on example input-output pairs. 6](https://reader030.vdocuments.site/reader030/viewer/2022040901/5e72230b0ed6c26a5968baee/html5/thumbnails/18.jpg)
18
![Page 19: Machine Learning - Eden Au · Supervised learning is the machine learning task of learning a function that maps an input to an output based on example input-output pairs. 6](https://reader030.vdocuments.site/reader030/viewer/2022040901/5e72230b0ed6c26a5968baee/html5/thumbnails/19.jpg)
19
Challenges
1. Data quality (GIGO)2. Data quantity (overfitting)3. Black box (neural networks)4. Feature engineering (for shallow learning)5. Domain expertise6. No guarantee
![Page 20: Machine Learning - Eden Au · Supervised learning is the machine learning task of learning a function that maps an input to an output based on example input-output pairs. 6](https://reader030.vdocuments.site/reader030/viewer/2022040901/5e72230b0ed6c26a5968baee/html5/thumbnails/20.jpg)
Unsupervised Learning
![Page 21: Machine Learning - Eden Au · Supervised learning is the machine learning task of learning a function that maps an input to an output based on example input-output pairs. 6](https://reader030.vdocuments.site/reader030/viewer/2022040901/5e72230b0ed6c26a5968baee/html5/thumbnails/21.jpg)
“ Unsupervised machine learning algorithms infer patterns from data, without reference to known outcomes
21
What is the underlying structure?
![Page 22: Machine Learning - Eden Au · Supervised learning is the machine learning task of learning a function that maps an input to an output based on example input-output pairs. 6](https://reader030.vdocuments.site/reader030/viewer/2022040901/5e72230b0ed6c26a5968baee/html5/thumbnails/22.jpg)
https://www.bbc.co.uk/news/science-environment-47267081https://xkcd.com/1838/
![Page 23: Machine Learning - Eden Au · Supervised learning is the machine learning task of learning a function that maps an input to an output based on example input-output pairs. 6](https://reader030.vdocuments.site/reader030/viewer/2022040901/5e72230b0ed6c26a5968baee/html5/thumbnails/23.jpg)
Anomaly Detection
![Page 24: Machine Learning - Eden Au · Supervised learning is the machine learning task of learning a function that maps an input to an output based on example input-output pairs. 6](https://reader030.vdocuments.site/reader030/viewer/2022040901/5e72230b0ed6c26a5968baee/html5/thumbnails/24.jpg)
“ Can automatically discover unusual data points in your dataset
24
![Page 25: Machine Learning - Eden Au · Supervised learning is the machine learning task of learning a function that maps an input to an output based on example input-output pairs. 6](https://reader030.vdocuments.site/reader030/viewer/2022040901/5e72230b0ed6c26a5968baee/html5/thumbnails/25.jpg)
25
Anomaly Detection: example
- Looking for misrecorded values
Credit: National Science Foundation
![Page 26: Machine Learning - Eden Au · Supervised learning is the machine learning task of learning a function that maps an input to an output based on example input-output pairs. 6](https://reader030.vdocuments.site/reader030/viewer/2022040901/5e72230b0ed6c26a5968baee/html5/thumbnails/26.jpg)
26
Anomaly Detection: example
- Classifying extreme events
https://www.ncdc.noaa.gov/extremes/cei/definition
![Page 27: Machine Learning - Eden Au · Supervised learning is the machine learning task of learning a function that maps an input to an output based on example input-output pairs. 6](https://reader030.vdocuments.site/reader030/viewer/2022040901/5e72230b0ed6c26a5968baee/html5/thumbnails/27.jpg)
Clustering
![Page 28: Machine Learning - Eden Au · Supervised learning is the machine learning task of learning a function that maps an input to an output based on example input-output pairs. 6](https://reader030.vdocuments.site/reader030/viewer/2022040901/5e72230b0ed6c26a5968baee/html5/thumbnails/28.jpg)
“ Allows you to automatically split the dataset into groups according to similarity
28
![Page 29: Machine Learning - Eden Au · Supervised learning is the machine learning task of learning a function that maps an input to an output based on example input-output pairs. 6](https://reader030.vdocuments.site/reader030/viewer/2022040901/5e72230b0ed6c26a5968baee/html5/thumbnails/29.jpg)
Clustering
29
![Page 30: Machine Learning - Eden Au · Supervised learning is the machine learning task of learning a function that maps an input to an output based on example input-output pairs. 6](https://reader030.vdocuments.site/reader030/viewer/2022040901/5e72230b0ed6c26a5968baee/html5/thumbnails/30.jpg)
30
Clustering:Example
Antarctic ocean temperature profiles
![Page 31: Machine Learning - Eden Au · Supervised learning is the machine learning task of learning a function that maps an input to an output based on example input-output pairs. 6](https://reader030.vdocuments.site/reader030/viewer/2022040901/5e72230b0ed6c26a5968baee/html5/thumbnails/31.jpg)
31
Clustering:Example
Antarctic ocean temperature profiles
![Page 32: Machine Learning - Eden Au · Supervised learning is the machine learning task of learning a function that maps an input to an output based on example input-output pairs. 6](https://reader030.vdocuments.site/reader030/viewer/2022040901/5e72230b0ed6c26a5968baee/html5/thumbnails/32.jpg)
32
Clustering:Example
Antarctic ocean temperature profiles
![Page 33: Machine Learning - Eden Au · Supervised learning is the machine learning task of learning a function that maps an input to an output based on example input-output pairs. 6](https://reader030.vdocuments.site/reader030/viewer/2022040901/5e72230b0ed6c26a5968baee/html5/thumbnails/33.jpg)
Latent Variable Models
![Page 34: Machine Learning - Eden Au · Supervised learning is the machine learning task of learning a function that maps an input to an output based on example input-output pairs. 6](https://reader030.vdocuments.site/reader030/viewer/2022040901/5e72230b0ed6c26a5968baee/html5/thumbnails/34.jpg)
“ Decomposing the dataset into multiple components
34
![Page 35: Machine Learning - Eden Au · Supervised learning is the machine learning task of learning a function that maps an input to an output based on example input-output pairs. 6](https://reader030.vdocuments.site/reader030/viewer/2022040901/5e72230b0ed6c26a5968baee/html5/thumbnails/35.jpg)
35
Latent Variable Models
![Page 36: Machine Learning - Eden Au · Supervised learning is the machine learning task of learning a function that maps an input to an output based on example input-output pairs. 6](https://reader030.vdocuments.site/reader030/viewer/2022040901/5e72230b0ed6c26a5968baee/html5/thumbnails/36.jpg)
Non‑random correlation structures and dimensionality reduction in multivariate climate data - Martin Vejmelka et al. 36
Latent Variable Models: Example
Component Analysis
![Page 37: Machine Learning - Eden Au · Supervised learning is the machine learning task of learning a function that maps an input to an output based on example input-output pairs. 6](https://reader030.vdocuments.site/reader030/viewer/2022040901/5e72230b0ed6c26a5968baee/html5/thumbnails/37.jpg)
Autoencoder
![Page 38: Machine Learning - Eden Au · Supervised learning is the machine learning task of learning a function that maps an input to an output based on example input-output pairs. 6](https://reader030.vdocuments.site/reader030/viewer/2022040901/5e72230b0ed6c26a5968baee/html5/thumbnails/38.jpg)
“ Tries to learn how to compress data down to the most important components
38
![Page 39: Machine Learning - Eden Au · Supervised learning is the machine learning task of learning a function that maps an input to an output based on example input-output pairs. 6](https://reader030.vdocuments.site/reader030/viewer/2022040901/5e72230b0ed6c26a5968baee/html5/thumbnails/39.jpg)
39
Autoencoder:Basic Structure
Image Credit: https://www.jeremyjordan.me/autoencoders/
![Page 40: Machine Learning - Eden Au · Supervised learning is the machine learning task of learning a function that maps an input to an output based on example input-output pairs. 6](https://reader030.vdocuments.site/reader030/viewer/2022040901/5e72230b0ed6c26a5968baee/html5/thumbnails/40.jpg)
40
Autoencoder:Application
Dimensionality reduction and finding ‘extreme’ weather events
![Page 41: Machine Learning - Eden Au · Supervised learning is the machine learning task of learning a function that maps an input to an output based on example input-output pairs. 6](https://reader030.vdocuments.site/reader030/viewer/2022040901/5e72230b0ed6c26a5968baee/html5/thumbnails/41.jpg)
Topic Modelling
![Page 42: Machine Learning - Eden Au · Supervised learning is the machine learning task of learning a function that maps an input to an output based on example input-output pairs. 6](https://reader030.vdocuments.site/reader030/viewer/2022040901/5e72230b0ed6c26a5968baee/html5/thumbnails/42.jpg)
“ Latent variable models applied to text to boost your literature searches
42
![Page 43: Machine Learning - Eden Au · Supervised learning is the machine learning task of learning a function that maps an input to an output based on example input-output pairs. 6](https://reader030.vdocuments.site/reader030/viewer/2022040901/5e72230b0ed6c26a5968baee/html5/thumbnails/43.jpg)
43
![Page 44: Machine Learning - Eden Au · Supervised learning is the machine learning task of learning a function that maps an input to an output based on example input-output pairs. 6](https://reader030.vdocuments.site/reader030/viewer/2022040901/5e72230b0ed6c26a5968baee/html5/thumbnails/44.jpg)
44
![Page 45: Machine Learning - Eden Au · Supervised learning is the machine learning task of learning a function that maps an input to an output based on example input-output pairs. 6](https://reader030.vdocuments.site/reader030/viewer/2022040901/5e72230b0ed6c26a5968baee/html5/thumbnails/45.jpg)
Topic Modelling: Example
Finding the topics of active research and research network
structure
45
![Page 46: Machine Learning - Eden Au · Supervised learning is the machine learning task of learning a function that maps an input to an output based on example input-output pairs. 6](https://reader030.vdocuments.site/reader030/viewer/2022040901/5e72230b0ed6c26a5968baee/html5/thumbnails/46.jpg)
Causal Inference
![Page 47: Machine Learning - Eden Au · Supervised learning is the machine learning task of learning a function that maps an input to an output based on example input-output pairs. 6](https://reader030.vdocuments.site/reader030/viewer/2022040901/5e72230b0ed6c26a5968baee/html5/thumbnails/47.jpg)
“What are the dynamics of the system? What drives what?
47
![Page 48: Machine Learning - Eden Au · Supervised learning is the machine learning task of learning a function that maps an input to an output based on example input-output pairs. 6](https://reader030.vdocuments.site/reader030/viewer/2022040901/5e72230b0ed6c26a5968baee/html5/thumbnails/48.jpg)
Causal Inference: Example
Finding direct and indirect teleconnections
48
![Page 49: Machine Learning - Eden Au · Supervised learning is the machine learning task of learning a function that maps an input to an output based on example input-output pairs. 6](https://reader030.vdocuments.site/reader030/viewer/2022040901/5e72230b0ed6c26a5968baee/html5/thumbnails/49.jpg)
Generative Adversarial Networks
![Page 50: Machine Learning - Eden Au · Supervised learning is the machine learning task of learning a function that maps an input to an output based on example input-output pairs. 6](https://reader030.vdocuments.site/reader030/viewer/2022040901/5e72230b0ed6c26a5968baee/html5/thumbnails/50.jpg)
“ Learns the distribution function of data so that you can draw more unique samples
50
![Page 51: Machine Learning - Eden Au · Supervised learning is the machine learning task of learning a function that maps an input to an output based on example input-output pairs. 6](https://reader030.vdocuments.site/reader030/viewer/2022040901/5e72230b0ed6c26a5968baee/html5/thumbnails/51.jpg)
51
GANs:What they do- Generator takes random
input and tries to create fake image
- Discriminator tries to tell difference between real and fake images
![Page 52: Machine Learning - Eden Au · Supervised learning is the machine learning task of learning a function that maps an input to an output based on example input-output pairs. 6](https://reader030.vdocuments.site/reader030/viewer/2022040901/5e72230b0ed6c26a5968baee/html5/thumbnails/52.jpg)
https://thispersondoesnotexist.com/
52
GANs: Example
Generating new, unique examples using what the
network has discovered about the data set
![Page 53: Machine Learning - Eden Au · Supervised learning is the machine learning task of learning a function that maps an input to an output based on example input-output pairs. 6](https://reader030.vdocuments.site/reader030/viewer/2022040901/5e72230b0ed6c26a5968baee/html5/thumbnails/53.jpg)
53
GANs: Example
Used to emulate a simulator
![Page 54: Machine Learning - Eden Au · Supervised learning is the machine learning task of learning a function that maps an input to an output based on example input-output pairs. 6](https://reader030.vdocuments.site/reader030/viewer/2022040901/5e72230b0ed6c26a5968baee/html5/thumbnails/54.jpg)
Opportunities/resources
![Page 55: Machine Learning - Eden Au · Supervised learning is the machine learning task of learning a function that maps an input to an output based on example input-output pairs. 6](https://reader030.vdocuments.site/reader030/viewer/2022040901/5e72230b0ed6c26a5968baee/html5/thumbnails/55.jpg)
“ In data science, 80% of the time is spent preparing data with the remaining 20% spent complaining about the need to prepare data...
55
![Page 56: Machine Learning - Eden Au · Supervised learning is the machine learning task of learning a function that maps an input to an output based on example input-output pairs. 6](https://reader030.vdocuments.site/reader030/viewer/2022040901/5e72230b0ed6c26a5968baee/html5/thumbnails/56.jpg)
![Page 57: Machine Learning - Eden Au · Supervised learning is the machine learning task of learning a function that maps an input to an output based on example input-output pairs. 6](https://reader030.vdocuments.site/reader030/viewer/2022040901/5e72230b0ed6c26a5968baee/html5/thumbnails/57.jpg)
Questions?
![Page 58: Machine Learning - Eden Au · Supervised learning is the machine learning task of learning a function that maps an input to an output based on example input-output pairs. 6](https://reader030.vdocuments.site/reader030/viewer/2022040901/5e72230b0ed6c26a5968baee/html5/thumbnails/58.jpg)
Gaussian Processes
![Page 59: Machine Learning - Eden Au · Supervised learning is the machine learning task of learning a function that maps an input to an output based on example input-output pairs. 6](https://reader030.vdocuments.site/reader030/viewer/2022040901/5e72230b0ed6c26a5968baee/html5/thumbnails/59.jpg)
“ Fit a statistical model with minimum assumptions which will return a value and an uncertainty in that value
59
![Page 60: Machine Learning - Eden Au · Supervised learning is the machine learning task of learning a function that maps an input to an output based on example input-output pairs. 6](https://reader030.vdocuments.site/reader030/viewer/2022040901/5e72230b0ed6c26a5968baee/html5/thumbnails/60.jpg)
60
Gaussian Processes:
problem
![Page 61: Machine Learning - Eden Au · Supervised learning is the machine learning task of learning a function that maps an input to an output based on example input-output pairs. 6](https://reader030.vdocuments.site/reader030/viewer/2022040901/5e72230b0ed6c26a5968baee/html5/thumbnails/61.jpg)
Gaussian Processes:
problem
61
![Page 62: Machine Learning - Eden Au · Supervised learning is the machine learning task of learning a function that maps an input to an output based on example input-output pairs. 6](https://reader030.vdocuments.site/reader030/viewer/2022040901/5e72230b0ed6c26a5968baee/html5/thumbnails/62.jpg)
Gaussian Processes:
problem
62
![Page 63: Machine Learning - Eden Au · Supervised learning is the machine learning task of learning a function that maps an input to an output based on example input-output pairs. 6](https://reader030.vdocuments.site/reader030/viewer/2022040901/5e72230b0ed6c26a5968baee/html5/thumbnails/63.jpg)
Gaussian Processes:
example
Fitting model to fill gaps in data
63
![Page 64: Machine Learning - Eden Au · Supervised learning is the machine learning task of learning a function that maps an input to an output based on example input-output pairs. 6](https://reader030.vdocuments.site/reader030/viewer/2022040901/5e72230b0ed6c26a5968baee/html5/thumbnails/64.jpg)
Gaussian Processes:
exampleOptimising an expensive
experiment or physical model
64
![Page 65: Machine Learning - Eden Au · Supervised learning is the machine learning task of learning a function that maps an input to an output based on example input-output pairs. 6](https://reader030.vdocuments.site/reader030/viewer/2022040901/5e72230b0ed6c26a5968baee/html5/thumbnails/65.jpg)
Gaussian Processes:
example
65