tokyo webmining 2017-10-28

35
2017 10 28 Web

Upload: kimikazu-kato

Post on 21-Jan-2018

2.540 views

Category:

Technology


0 download

TRANSCRIPT

Page 1: Tokyo webmining 2017-10-28

2017 10 28 Web

Page 2: Tokyo webmining 2017-10-28
Page 3: Tokyo webmining 2017-10-28

Twitter: @hamukazu

Python 5

Page 4: Tokyo webmining 2017-10-28

EC ASP

Page 5: Tokyo webmining 2017-10-28

• Scipy/Numpy

Page 6: Tokyo webmining 2017-10-28

Page 7: Tokyo webmining 2017-10-28

scikit-learn TensorFlow

Page 8: Tokyo webmining 2017-10-28

Python

•Numpy

• Cython

Page 9: Tokyo webmining 2017-10-28

s = 0 for i in range(1, 100000001):

s += i print(s)

1 1

Page 10: Tokyo webmining 2017-10-28

s = sum(range(1, 100000001)) print(s)

Page 11: Tokyo webmining 2017-10-28

import numpy as np a = np.arange(1, 100000001, dtype=np.int64) print(a.sum())

Page 12: Tokyo webmining 2017-10-28

s = 0 for i in range(1, 100000001):

s += i print(s)

s = sum(range(1, 100000001)) print(s)

import numpy as np a = np.arange(1, 100000001, dtype=np.int64) print(a.sum())

30.21

12.33

0.38

Page 13: Tokyo webmining 2017-10-28

Numpy

• Numpy

• Numpy

Page 14: Tokyo webmining 2017-10-28

Cython

• Python C

• Numpy

Page 15: Tokyo webmining 2017-10-28

Cythondef prime(n): p = [True] * (n + 1) m = 2 while m < n + 1: if p[m]: i = m * 2 while i < n + 1: p[i] = False i += m m += 1 i = n while not p[i]: i -= 1 return i

n

p(10000000)

Python 4.75 Cython 3.04

Page 16: Tokyo webmining 2017-10-28

def prime(n): p = [True] * (n + 1) m = 2 while m < n + 1: if p[m]: i = m * 2 while i < n + 1: p[i] = False i += m m += 1 i = n while not p[i]: i -= 1 return i

def prime(int n): cdef int i, m p = [True] * (n + 1) m = 2 while m < n + 1: if p[m]: i = m * 2 while i < n + 1: p[i] = False i += m m += 1 i = n while not p[i]: i -= 1 return i

3.04 3.04

Page 17: Tokyo webmining 2017-10-28

def prime(int n): cdef int m, i cdef int * p = <int * >malloc((n + 1) * sizeof(int)) for i in range(n + 1): p[i] = 1 m = 2 while m < n + 1: if p[m]: i = m * 2 while i < n + 1: p[i] = 0 i += m m += 1 i = n while not p[i]: i -= 1 free(p) return i

3.04 0.17

C

Page 18: Tokyo webmining 2017-10-28

Cython

Page 19: Tokyo webmining 2017-10-28

http://bit.ly/kimikazu20140913 http://bit.ly/kimikazu20160204

Python

PyCon JP 2014 2016

Page 20: Tokyo webmining 2017-10-28

Page 21: Tokyo webmining 2017-10-28
Page 22: Tokyo webmining 2017-10-28

Premature optimization is the root of all evil.— Donald Knuth

Page 23: Tokyo webmining 2017-10-28
Page 24: Tokyo webmining 2017-10-28

• XP

Page 25: Tokyo webmining 2017-10-28

Page 26: Tokyo webmining 2017-10-28

Page 27: Tokyo webmining 2017-10-28

XP

• ☓ ○

Page 28: Tokyo webmining 2017-10-28

Page 29: Tokyo webmining 2017-10-28

Scikit-learn

SpectralClustering

Page 30: Tokyo webmining 2017-10-28

Page 31: Tokyo webmining 2017-10-28

XTX

Page 32: Tokyo webmining 2017-10-28

Page 33: Tokyo webmining 2017-10-28

x

Softplus f(x) = log(1 + e

x

)

f(x) ⇡ x

f(1000)

Page 34: Tokyo webmining 2017-10-28

Page 35: Tokyo webmining 2017-10-28

• Python