quick tensorflow tutorial -...

13
Quick Tensorflow Tutorial Andreas Eitel

Upload: others

Post on 17-Aug-2020

15 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Quick Tensorflow Tutorial - uni-freiburg.deais.informatik.uni-freiburg.de/.../quick_tensorflow.pdf · 2017. 11. 6. · Quick Tensorflow Tutorial Andreas Eitel . First Organization

Quick Tensorflow Tutorial

Andreas Eitel

Page 2: Quick Tensorflow Tutorial - uni-freiburg.deais.informatik.uni-freiburg.de/.../quick_tensorflow.pdf · 2017. 11. 6. · Quick Tensorflow Tutorial Andreas Eitel . First Organization

First Organization

Computers in Pool are equipped with Nvidia GPUs GTX 1060 to train your networks

Tensorflow 1.1 is already installed

We’ll meet from now one in the computer pool every Monday to help you with the exercises

Page 3: Quick Tensorflow Tutorial - uni-freiburg.deais.informatik.uni-freiburg.de/.../quick_tensorflow.pdf · 2017. 11. 6. · Quick Tensorflow Tutorial Andreas Eitel . First Organization

What is a Tensor?

Central unit of data in TensorFlow

A tensor consists of a set of primitive values shaped into an array

A scalar is a Tensor

A vector is a Tensor

A matrix is a Tensor

Page 4: Quick Tensorflow Tutorial - uni-freiburg.deais.informatik.uni-freiburg.de/.../quick_tensorflow.pdf · 2017. 11. 6. · Quick Tensorflow Tutorial Andreas Eitel . First Organization

Tensorflow vs. Numpy

Both support Ndarrays

Both use python as front-end

Numpy does not offer methods to create tensors

Numpy has no automatic derivative computation

Numpy has no GPU support

Page 5: Quick Tensorflow Tutorial - uni-freiburg.deais.informatik.uni-freiburg.de/.../quick_tensorflow.pdf · 2017. 11. 6. · Quick Tensorflow Tutorial Andreas Eitel . First Organization

Tensorflow vs. Numpy

Page 6: Quick Tensorflow Tutorial - uni-freiburg.deais.informatik.uni-freiburg.de/.../quick_tensorflow.pdf · 2017. 11. 6. · Quick Tensorflow Tutorial Andreas Eitel . First Organization

Tensorflow vs. Numpy

Requires explicit evaluation

Page 7: Quick Tensorflow Tutorial - uni-freiburg.deais.informatik.uni-freiburg.de/.../quick_tensorflow.pdf · 2017. 11. 6. · Quick Tensorflow Tutorial Andreas Eitel . First Organization

Tensorflow Sessions

A computional graph is a series of Tensorflow operations arranged into a graph of nodes

To evaluate nodes, we must run a session

Page 8: Quick Tensorflow Tutorial - uni-freiburg.deais.informatik.uni-freiburg.de/.../quick_tensorflow.pdf · 2017. 11. 6. · Quick Tensorflow Tutorial Andreas Eitel . First Organization

Placeholders and Variables

For machine learning you want a model to take arbitrary inputs and add trainable parameters to the graph

External input using Placeholders

Trainable parameters using Variables, which are constructed with type and initial value

Page 9: Quick Tensorflow Tutorial - uni-freiburg.deais.informatik.uni-freiburg.de/.../quick_tensorflow.pdf · 2017. 11. 6. · Quick Tensorflow Tutorial Andreas Eitel . First Organization

Initialization

Variables are not initialized when calling tf.Variable

Need to call initialization

Page 10: Quick Tensorflow Tutorial - uni-freiburg.deais.informatik.uni-freiburg.de/.../quick_tensorflow.pdf · 2017. 11. 6. · Quick Tensorflow Tutorial Andreas Eitel . First Organization

Evaluation

Use the Placeholder to evaluate linear_model for several values of x

Page 11: Quick Tensorflow Tutorial - uni-freiburg.deais.informatik.uni-freiburg.de/.../quick_tensorflow.pdf · 2017. 11. 6. · Quick Tensorflow Tutorial Andreas Eitel . First Organization

Linear Regression Example

Still need labels, loss and optimizer for optimizing the paramters W,b

Page 12: Quick Tensorflow Tutorial - uni-freiburg.deais.informatik.uni-freiburg.de/.../quick_tensorflow.pdf · 2017. 11. 6. · Quick Tensorflow Tutorial Andreas Eitel . First Organization

Visualize the Graph in TensorBoard

Page 13: Quick Tensorflow Tutorial - uni-freiburg.deais.informatik.uni-freiburg.de/.../quick_tensorflow.pdf · 2017. 11. 6. · Quick Tensorflow Tutorial Andreas Eitel . First Organization

Thank you for your attention!