big data overview: people, technologies, companies and hong kong
DESCRIPTION
This is the fourth version of the big data talk I have been giving around Hong Kong lately. This is probably the last time I'll use this content, which is almost identical to previous versions. But I wanted to have this slightly different one online for those that attended my University of Hong Kong talk. In his presentation I provide an overview of big data terminology and technology. I provide vivid examples of big data at work and discuss trends in Asia and Hong Kong.TRANSCRIPT
definitions
technologies
timing and hype
peoplehong kong
future
the common definition
velocityvolume
varietyveracity
the subjective definition
the easy definition
the real challenge:
what to do with all these data?
components: creating value from data
hardware software
people
servers
storage
networks
appliances
platforms
traditional dbms
columnar db’s
nosql
hadoop
platform architects
stats. people
comp. scientists
traditional it
visualization
hot components
hardware software
people
servers
storage
networks
appliances
platforms
traditional dbms
columnar db’s
nosql
hadoop
platform architects
stats. people
comp. scientists
traditional IT
visualization
applications
a few examples
why now?
• cheap storage• unbounded compute• data accessibility and world datafication• internet scale: Yahoo! and Google– offspring of Hadoop
visi
bilit
y/ex
pect
ation
s
time
trigger inflated expectations
disillusionment
enlightenment
productivity
adapted from gartner hype cycle
visi
bilit
y/ex
pect
ation
s
time
trigger inflated expectations
disillusionment
enlightenment
productivity
adapted from gartner hype cyclebig data: where are we
today?
this will be caused bya lack of data scientists
data scientist
statistics,math
comp. sci.,applications
businessacumen
asia
busi
ness
inte
rest
time
global
usa
asia
hong kong
http://www.infoincog.com/big-data-in-asia-pacific/
enterprise it adoption
hong kong
thinking about work?
us orhk
it or other
cs and ds skills most valued ($$$)most disruptive (fun!) techstough to manage visa
cs skills not valued; ds skills valued ($$)non-disruptive tech; back-end supporttough to manage visa
us companies hiring sales teams, not developersvery few it companies based in hkfew skilled people, skills not heavily in demand
many jobs in financenon-disruptive tech; back-end supporteasiest path to stay in hk
location
company
us,it
us,non-it
hk,it
hk,non-it
consider grad school for visa and route to employment
consider start-up
want to get involved?
• want to learn more?– join hkbd* community, ask scott for reading
recommendations• want to meet other developers?– come to odhk meetings and hkbd meetings
• want a project for fyp, to build your resume, or just for fun?– datasets and software projects are everywhere! as scott for
more info• want a job?– scott knows some recruiters and hiring businesses
(*) Hong Kong Big Data on Google+
want more?
Google+: Hong Kong Big Datahttp://www.infoincog.com/
all content by Scott Brady Drummonds – [email protected]