b

a

c !p

!T-

%

1

•

• k

4

1PB :DVD

+•Facebook 10 .

10TB

• ( .) 8 .2 . 20001×

• 1PB.1000PB

•Google20PB

• 18 0 . ..

•IDC Z 2009 0.8ZB.2012 2.7ZB. 2020 35ZB

5JimGray IDC Z

•

Q ±�ÂU54.9PFLOPS

Q ±�ÂU125.436PFLOPS

% jd ep (n w N

j +%%n (,

• k• j xyjw l

• k• j j

o l

• o k• j j d ej

j jl

• k• j j r

j j jj

kb

bdO P

b

kd

k<M TMZ ,- h )%% i

!T-

KIC 84628521500

• k• j xyj l

• k• j j

o l

• o k• j j d ej

j jl

• k• j j r

j j jj

|;K� �W³, okjl �Ruª

• DWU KPMTT .., w! w jd

k e h IKP VM=MIZV VO PM La WN KWU MZ ITOWZ PU PIU ZW M I WUI KITTa PZW OP M MZ MVKM i

• 3T IaL Vh %%)i jde e i

w eh IKP VM TMIZV VO ZWOZIUU VOKWU MZ W W U bM I MZNWZUIVKM KZ MZ WVVO M IU TM LI I WZ I M MZ MVKM i

•• Input: training set X, Y; testing set X•Output: Y = f (X), or P(Y|X)

X y=f(x) Y

Y

•• Input: X• Output: Y = f (X), or P(Y|X)

X y=f(x) Y

���Agent�

�A

®� ¬�

G.�­Ã�!

�\ n4�A

�A

®�

G.bµ.

��K�Å3¬-�<h�yxvE0�

https://yoast.com/how-

to-clean-site-structure/

�\

¬�

n4�A

���Agent�

f v

�A

®� ¬�

G.

)o½#

��Áiv�)o

)o½(¬- =π(®� )

¬-§/%�

q

�A

®� ¬�

G.

��¬-

q

�A

®� ¬�

G.

H~©+,G. =1

H~F¶,G. =-1

=ECo`&G. =0

��K�Å3¬-�<h�yxvE0�

q

• /

•

��:

“5-5”

��:

“3-3”

¸�� ……¢£¸C�…… ©+!

AlphaGo/8��K� +X0K�.

»É¦SK�

���K�

( ����¹OV.)

• h kAI MZV BMKWOV WVij

Low-level sensing Pre-processing Feature extract. Feature

selection

Inference: prediction, recognition

••

••

•••

••••

••••

• s

• h kAI MZV BMKWOV WVij

Low-level sensing Pre-processing Feature extract. Feature

selection

Inference: prediction, recognition

�UK�

z

• wj• j•

• u• d p

wj s bf n

H�Ì��qMfr7�=�N:>�·100"��

z

•• m

• m• z m

• m• m

• m•

Low-level sensing Pre-processing Feature extract. Feature

selection

Inference: prediction, recognition

z

PM2.5�

•<VW TMLOM 6 KW MZa V 6I I I M h<66i

ok:2I�,z°Æ��5e§�5,H:1

�_:w�L°Æea��ok,H:S.O.S

�³:¥6�_Zd�®�9sÀ^��²

uc:ªD¥6�³9�Î���J±*���]¤� t

d Nv O P l N

•

okjl

okTg{ ¡±K

Ï^ª±��Ruª

|;K� Í@�³

• h3Z N K IT V MTT OMVKMij

x3 j

b

m

)

b )

)

)(

m

• o t

•• tv k V HWVM j HWVMh

i tv j

• v t kd esd e d e jj ”

• d e j d ev j

j j ”

• oR v ”

• R ”!

s

• R

l ! %

l r r r !C OUW L

• h =Ai

o

d

f

≈

x

t

•A53 y

Nx22xN≈

2x2

X

•A53 y

2x2

2xN N2≈

f

d

x

t

• x L t

•

•••

• tR

• k j x

• k r “ j

r

• tRA53 53

• k j “

• k r j r

�[1

�[2

�[3

�[n

}Ç

f w

Ì� ~

y

t ≈X

tX ≈

X ≈

tX ≈

X ≈

28CD8 8 4 B .84D

•• j

• v j

t

• o k

•y k

• k

• k

•

••• B .=B

. 6

• . .

d e

8layers

19layers

22layers

AlexNet (2012) VGG(2014) GoogleNet (2014)

16.4%

7.3%

6.7%

http://cs231n.stanford.e

du/slides/winter1516_le

cture8.pdf

AlexNet

(2012)

VGG

(2014)

GoogleNet

(2014)

152layers

3.57%

ResidualNet

(2015)

16.4%

7.3% 6.7%

Special

structure

162layersd e

•r

0

10000

20000

30000

40000

50000

60000

70000

80000

90000

100000

~«25�

NÑ71�

N�7�

��32�

��90�

VGG19�?114��

≈

����"

�_��"

��"¿mo¯�r��"�ok�'��o���

c %

P

GPS

0

m R dm

m Rk

k 5T MZ VO

okÊ

¨� ~

k 5T MZ VO

•• j u v

j

vE0Cluster�È�º�vP0Cluster�

$ĺ�

´p

oK

B´

W I WV

Handclap Traffic Tidal

Sheep Flock

AnimalMobility

AnimalBehavior

Fish School

All contain patterns

W I WV

PhysicalSpace Pattern

Space

Z OWIT

Input:

• / I IT MU WZIT I MZV• GP KP IZMI IZM V PM IUM I IT I MZV 2 +B G• GPI MU WZIT I MZV M V Z IV ZINN K2 2• :W ZINN K WKK Z M MMV I IT I MZV P L NNMZMV MU WZITI MZV 2 28 4 B 8 88 6B G 4 7 D

Urbanbigdata

Our Works

I ZWIL

TaxiGPSinBeijing BeijingMap BeijingPOI

Input:

Tools:

RegularizedNon-negativeTensorDecomposition

Output:

Spatio-temporal

patterns

AZW TMU LMN V WV

•0Z O V M VI WV 3UM MV WZ• ! ! P MTMUMV / PM ZINN K WT UM NZWU PWZ O V bWVM W P LM VI WV bWVM V P UM

ODnetwork

Tensor

AODTtensorTimeevolving

ODnetwork

AZW TMU LMN V WV

•6MKWU W M PM MV WZ I PZMM ZWRMK WVUI Z M IVL I KWZM MV WZ

ODTtensor

Coretensor

O projectionMatrix

D projectionMatrix

T projectionMatrix

C I IT I MZV ZWRMK WV

Urbanzones Urbancommunities

DMU WZIT I MZV ZWRMK WV

UrbanrhythmUrbantraffic

min

BMO TIZ bML ?WV VMOI M D KSMZ 6MKWU W WV

• 4I K D KSMZ LMKWU W WV

• 0 86 8 9G 6 B

•5PITTMVOM• FIT M V PM MV WZ MZa IZ M WVTa - VWV bMZWMTMUMV• EZ IV ZINN K I MZV PI M KTW M ZMTI WV P Z IVKWV M ! KP I A

ODTtensor OMatrix TMatrix

Coretensor DMatrix

• WLMT Z IV KWV M IT VNWZUI WV• 3 U WV/ IZMI P U TIZ A VNWZUI WVPW TL PI M PM U TIZ Z IV Z K ZM

• 5WV Z K IZMI IZMI U TIZ a UI Z

•0 86 8 9G 6 B

min

BMO TIZ bML ?WV VMOI M D KSMZ 6MKWU W WV

BMO TIZ bML ?WV VMOI M D KSMZ 6MKWU W WV

• ISM I MZV UWZM M TI VI TM•?WV VMOI M KWV ZI V

• = ZMO TIZ bI WV• 5WZM MV WZ/ VTa SMM ZWVO V MZIK WV

• AZWRMK WV UI Z / UISM MIKP KT MZ UWZM UMIV VON T IVLMVPIVKM V MVM

BMO TIZ bML ?WV VMOI M D KSMZ 6MKWU W WV

• 8 VIT W RMK WV N VK WV

•: UIV UW T a IVL Z IV KWV M IZM RW V TaW U bML

Modelurban

contextual

information (POI)

Model traffic

information

Makeresults

sparse

Makeresults

non-negative

U bI WV

•4TWKS 5WWZL VI M 6M KMV 456

•3T MZVI VO AZW UIT 9ZIL MV 3A9

Experiments

6I I

•4M R VO 9AC LI I• 9AC ZIRMK WZa WN %%%% 4M R VO I M ! %%- IVL %

•4M R VO ZINN K IVITa bWVM UI• +%% bWVM V PM P Z VO ZWIL V 4M R VO

•AW WV WN V MZM VO A V 4M R VO• (-%!%%% W V

4M R VO PW KI M

ODTtensor

Coretensor

O projectionMatrix

D projectionMatrix

T projectionMatrix

Spatialpatterns

Temporalpatterns

Relations

DMU WZIT I MZV

Morningpeak

Mid-day

Aftereveningpeak

Eveningpeak

DMU WZIT I MZV

2008 2012

4M R VO PW KI M

ODTtensor

Coretensor

O projectionMatrix

D projectionMatrix

T projectionMatrix

Spatialpatterns

Temporalpatterns

Relations

C I IT I MZV

2008 2012

C I IT I MZV

2008 2012

C I IT I MZV

2008 2012

C I IT I MZV

2008 2012

4M R VO PW KI M

ODTtensor

Coretensor

O projectionMatrix

D projectionMatrix

T projectionMatrix

Spatialpatterns

Temporalpatterns

Relations

5WZM MV WZ

Morning Midday

Evening Night

WZV VO

Origin Destination

LLIa

Origin Destination

7 MV VO

Origin Destination

? OP

Origin Destination

8 VK WV WN Z IV bWVM

8 VK WV WN Z IV bWVM

2008 2012

WhereisthecenterofBeijing?

s

• 1m

？�'$�����+ �*�

Obama

Hillary

Trump

Bush

……

%��"�

ImageNet���Y96.5%

��)�"�

？

�Â

ÏÂ

s

R• r m• g m• r m

h R• h i h i

No-congestion

Congestion

s

R…

Error

Input Matrix Convolution Pooling Error

feedback Output

¼&ok

s

R

��

VT=

vs,t vs+1,t vs+m,tvs-1,tvs-m,t

�����

���

�� ��

v:,t

v:,t-1

v:,t-n

��

vs-m,: vs+m,:vs,:�� ��

��

��

there exist a number of local patterns (spatio-temporal trends) in the spatio-temporal input matrix

Spatio-temporaltrends

Convolution layer: using several filters to convolute the input matrix

Pooling layer: using average pooling to down sampling the convolution neuro matrix

s

R ” jg

…

Error

LI LC LP LeR LO

Input Matrix Convolution Pooling Error

feedback Output

Error feedback recurrent neural networkeRNN�#�������!�

s

•7ZZWZ NMML IKS ZMK ZZMV VM ZIT VM WZS” hMB??i

m

82

Lout

Lhidden

Lin

Lout

Lhidden

Lin

Recurrent

Lout

Lhidden

Lin

Error

Error Feedback

NN RNN eRNNR

ecurrent

s

R wjj

)(��&

Transfer learning

-,)��&

R vZWIL MOUMV v g g

g

s

R a h % ( +n l)%% x v l v i

rqj

q

0)SU P—9AC

R

R

ARIMA: Auto Regression Integrated Moving Average; SVR: Support Vector Regression; SAE: Stacked Auto Encoders; 1D-CNN: 1D Convolutional Neural Network; CNN: Convolutional Neural Network

s

t R

8

2

s

t R j

s

t R

Yj= f

X11

X22

Xii

.

.

.

.j

ij -

i

-

!"#!$%

1'((!"#

!$%#)

s

k sy

k

! yvy

G6����

G104����

G106����S315

���

����

���

���

����

S213

� �

�

S11

���

S315G104���

G106���

G6���

���

������

G109���

G4���

G1���

� �

���

s

•t R

E-mail�jywang@buaa.edu.cnWeibo�@�˾BUAA