![Page 1: Data Science Vancouverdatascholars.com/data/post/2013/03/29/don_turnbull_data... · 2013-12-01 · Data Science Vancouver Don Turnbull, PhD @donturn #datascienceyvr . Overview !](https://reader034.vdocuments.site/reader034/viewer/2022042314/5f028a337e708231d404c4d1/html5/thumbnails/1.jpg)
Data Science Vancouver
Don Turnbull, PhD
@donturn
#datascienceyvr
![Page 2: Data Science Vancouverdatascholars.com/data/post/2013/03/29/don_turnbull_data... · 2013-12-01 · Data Science Vancouver Don Turnbull, PhD @donturn #datascienceyvr . Overview !](https://reader034.vdocuments.site/reader034/viewer/2022042314/5f028a337e708231d404c4d1/html5/thumbnails/2.jpg)
Overview
! Goals for Data Science Vancouver
! My Background
! Philosophy & Thoughts on Data Science ! Advantages of Experience
! Research as an Advantage
! A (few) Projects
! Meeting our Goals
![Page 3: Data Science Vancouverdatascholars.com/data/post/2013/03/29/don_turnbull_data... · 2013-12-01 · Data Science Vancouver Don Turnbull, PhD @donturn #datascienceyvr . Overview !](https://reader034.vdocuments.site/reader034/viewer/2022042314/5f028a337e708231d404c4d1/html5/thumbnails/3.jpg)
What I Did ! Software Developer
! Expert Systems, SGML/Hypertext, CASE
! M.S. @ Georgia Tech
! Software Designer, Manager, Technical Architect
! Ph.D. @ U Toronto ! KDD - (Web) Behavioral & Informetric Modeling
! IR & ISeek - Systems to Augment Web Browsing and Search
! Principal @ Startup (Google) ! Personalized IR
! Asst. Professor @ University of Texas
![Page 4: Data Science Vancouverdatascholars.com/data/post/2013/03/29/don_turnbull_data... · 2013-12-01 · Data Science Vancouver Don Turnbull, PhD @donturn #datascienceyvr . Overview !](https://reader034.vdocuments.site/reader034/viewer/2022042314/5f028a337e708231d404c4d1/html5/thumbnails/4.jpg)
What I Do
! Consultant - Research & Development ! Data Science & Intellectual Property
! Plain, old Computer Science Research
! Startup Advisor ! IR, Text Analysis, Analytics, Sentiment, CF
! Tapstream ! Research on Marketing Attribution Analytics, Device and
Behavior Profiling, Graph Analysis etc.
![Page 5: Data Science Vancouverdatascholars.com/data/post/2013/03/29/don_turnbull_data... · 2013-12-01 · Data Science Vancouver Don Turnbull, PhD @donturn #datascienceyvr . Overview !](https://reader034.vdocuments.site/reader034/viewer/2022042314/5f028a337e708231d404c4d1/html5/thumbnails/5.jpg)
A Philosophy
![Page 6: Data Science Vancouverdatascholars.com/data/post/2013/03/29/don_turnbull_data... · 2013-12-01 · Data Science Vancouver Don Turnbull, PhD @donturn #datascienceyvr . Overview !](https://reader034.vdocuments.site/reader034/viewer/2022042314/5f028a337e708231d404c4d1/html5/thumbnails/6.jpg)
A Pracitcal Philosophy
![Page 7: Data Science Vancouverdatascholars.com/data/post/2013/03/29/don_turnbull_data... · 2013-12-01 · Data Science Vancouver Don Turnbull, PhD @donturn #datascienceyvr . Overview !](https://reader034.vdocuments.site/reader034/viewer/2022042314/5f028a337e708231d404c4d1/html5/thumbnails/7.jpg)
The fox knows many things, but the hedgehog knows one big thing. Archilochus
Ways of Knowing & Doing
![Page 8: Data Science Vancouverdatascholars.com/data/post/2013/03/29/don_turnbull_data... · 2013-12-01 · Data Science Vancouver Don Turnbull, PhD @donturn #datascienceyvr . Overview !](https://reader034.vdocuments.site/reader034/viewer/2022042314/5f028a337e708231d404c4d1/html5/thumbnails/8.jpg)
I’m a Hedgehog
![Page 9: Data Science Vancouverdatascholars.com/data/post/2013/03/29/don_turnbull_data... · 2013-12-01 · Data Science Vancouver Don Turnbull, PhD @donturn #datascienceyvr . Overview !](https://reader034.vdocuments.site/reader034/viewer/2022042314/5f028a337e708231d404c4d1/html5/thumbnails/9.jpg)
Except When I’m Not
![Page 10: Data Science Vancouverdatascholars.com/data/post/2013/03/29/don_turnbull_data... · 2013-12-01 · Data Science Vancouver Don Turnbull, PhD @donturn #datascienceyvr . Overview !](https://reader034.vdocuments.site/reader034/viewer/2022042314/5f028a337e708231d404c4d1/html5/thumbnails/10.jpg)
One Big Thing
Is realy a lot of smaller things
(nothing to do with “Big Data”)
![Page 11: Data Science Vancouverdatascholars.com/data/post/2013/03/29/don_turnbull_data... · 2013-12-01 · Data Science Vancouver Don Turnbull, PhD @donturn #datascienceyvr . Overview !](https://reader034.vdocuments.site/reader034/viewer/2022042314/5f028a337e708231d404c4d1/html5/thumbnails/11.jpg)
Science
![Page 12: Data Science Vancouverdatascholars.com/data/post/2013/03/29/don_turnbull_data... · 2013-12-01 · Data Science Vancouver Don Turnbull, PhD @donturn #datascienceyvr . Overview !](https://reader034.vdocuments.site/reader034/viewer/2022042314/5f028a337e708231d404c4d1/html5/thumbnails/12.jpg)
Data Science
![Page 13: Data Science Vancouverdatascholars.com/data/post/2013/03/29/don_turnbull_data... · 2013-12-01 · Data Science Vancouver Don Turnbull, PhD @donturn #datascienceyvr . Overview !](https://reader034.vdocuments.site/reader034/viewer/2022042314/5f028a337e708231d404c4d1/html5/thumbnails/13.jpg)
What does the world look like to a Data Scientist?
![Page 14: Data Science Vancouverdatascholars.com/data/post/2013/03/29/don_turnbull_data... · 2013-12-01 · Data Science Vancouver Don Turnbull, PhD @donturn #datascienceyvr . Overview !](https://reader034.vdocuments.site/reader034/viewer/2022042314/5f028a337e708231d404c4d1/html5/thumbnails/14.jpg)
![Page 15: Data Science Vancouverdatascholars.com/data/post/2013/03/29/don_turnbull_data... · 2013-12-01 · Data Science Vancouver Don Turnbull, PhD @donturn #datascienceyvr . Overview !](https://reader034.vdocuments.site/reader034/viewer/2022042314/5f028a337e708231d404c4d1/html5/thumbnails/15.jpg)
! And Science runs on Quantitative Methods ! Understanding what people actually do instead
of what they say they do
! Making comparisons (over time)
! Generalizable and extensible
! The toolbox for interpreting and analyzing other people’s results
Data Science is really Science
![Page 16: Data Science Vancouverdatascholars.com/data/post/2013/03/29/don_turnbull_data... · 2013-12-01 · Data Science Vancouver Don Turnbull, PhD @donturn #datascienceyvr . Overview !](https://reader034.vdocuments.site/reader034/viewer/2022042314/5f028a337e708231d404c4d1/html5/thumbnails/16.jpg)
! It is a discipline ! Hypothesis based
! More applicable to peer review & verfication
! It requires a set of skills that have a (much) higher market value
! Many characteristics examined are constants ! Human Behavior
! Physical traits and abilities
The power of (Data) Science
![Page 17: Data Science Vancouverdatascholars.com/data/post/2013/03/29/don_turnbull_data... · 2013-12-01 · Data Science Vancouver Don Turnbull, PhD @donturn #datascienceyvr . Overview !](https://reader034.vdocuments.site/reader034/viewer/2022042314/5f028a337e708231d404c4d1/html5/thumbnails/17.jpg)
! Our time is now ! Yottabyte, Teraflop, GPU, Cloud…
! Fights fire with Fire ! Numbers speak the language of business
& technology (C-level execs) ! (Almost) infallible results ! Qualitative decisions for Quantitative
measurement
The Rise of Data Science
![Page 18: Data Science Vancouverdatascholars.com/data/post/2013/03/29/don_turnbull_data... · 2013-12-01 · Data Science Vancouver Don Turnbull, PhD @donturn #datascienceyvr . Overview !](https://reader034.vdocuments.site/reader034/viewer/2022042314/5f028a337e708231d404c4d1/html5/thumbnails/18.jpg)
Even Normal People are starting to get it!
![Page 19: Data Science Vancouverdatascholars.com/data/post/2013/03/29/don_turnbull_data... · 2013-12-01 · Data Science Vancouver Don Turnbull, PhD @donturn #datascienceyvr . Overview !](https://reader034.vdocuments.site/reader034/viewer/2022042314/5f028a337e708231d404c4d1/html5/thumbnails/19.jpg)
And they want to do it!
![Page 20: Data Science Vancouverdatascholars.com/data/post/2013/03/29/don_turnbull_data... · 2013-12-01 · Data Science Vancouver Don Turnbull, PhD @donturn #datascienceyvr . Overview !](https://reader034.vdocuments.site/reader034/viewer/2022042314/5f028a337e708231d404c4d1/html5/thumbnails/20.jpg)
![Page 21: Data Science Vancouverdatascholars.com/data/post/2013/03/29/don_turnbull_data... · 2013-12-01 · Data Science Vancouver Don Turnbull, PhD @donturn #datascienceyvr . Overview !](https://reader034.vdocuments.site/reader034/viewer/2022042314/5f028a337e708231d404c4d1/html5/thumbnails/21.jpg)
![Page 22: Data Science Vancouverdatascholars.com/data/post/2013/03/29/don_turnbull_data... · 2013-12-01 · Data Science Vancouver Don Turnbull, PhD @donturn #datascienceyvr . Overview !](https://reader034.vdocuments.site/reader034/viewer/2022042314/5f028a337e708231d404c4d1/html5/thumbnails/22.jpg)
Data Science in Practice
![Page 23: Data Science Vancouverdatascholars.com/data/post/2013/03/29/don_turnbull_data... · 2013-12-01 · Data Science Vancouver Don Turnbull, PhD @donturn #datascienceyvr . Overview !](https://reader034.vdocuments.site/reader034/viewer/2022042314/5f028a337e708231d404c4d1/html5/thumbnails/23.jpg)
Practical Data Science
“A Data Scientist is someone who can obtain, scrub, explore, model and interpret data, blending hacking, statistics and machine learning.”!
Hilary Mason, Chief Data Scientist @ Bit.ly!
![Page 24: Data Science Vancouverdatascholars.com/data/post/2013/03/29/don_turnbull_data... · 2013-12-01 · Data Science Vancouver Don Turnbull, PhD @donturn #datascienceyvr . Overview !](https://reader034.vdocuments.site/reader034/viewer/2022042314/5f028a337e708231d404c4d1/html5/thumbnails/24.jpg)
! Data Acquisition
! Computational power & networked systems
! We need new modeling techniques, even new metaphors to examine the complex systems we interact with
! Augment and Extend - Finance, Psychology, Physics & Computer Science ! Isomorphic!
Why Data Science Now?
![Page 25: Data Science Vancouverdatascholars.com/data/post/2013/03/29/don_turnbull_data... · 2013-12-01 · Data Science Vancouver Don Turnbull, PhD @donturn #datascienceyvr . Overview !](https://reader034.vdocuments.site/reader034/viewer/2022042314/5f028a337e708231d404c4d1/html5/thumbnails/25.jpg)
The (New) Era of Instrumentation
! We are undoubtedly in a new era of reasoning
! Scientific Engineering enabled the original Age of Reason
! Build understanding of intent & interactions
! Build (better) models of the world
![Page 26: Data Science Vancouverdatascholars.com/data/post/2013/03/29/don_turnbull_data... · 2013-12-01 · Data Science Vancouver Don Turnbull, PhD @donturn #datascienceyvr . Overview !](https://reader034.vdocuments.site/reader034/viewer/2022042314/5f028a337e708231d404c4d1/html5/thumbnails/26.jpg)
![Page 27: Data Science Vancouverdatascholars.com/data/post/2013/03/29/don_turnbull_data... · 2013-12-01 · Data Science Vancouver Don Turnbull, PhD @donturn #datascienceyvr . Overview !](https://reader034.vdocuments.site/reader034/viewer/2022042314/5f028a337e708231d404c4d1/html5/thumbnails/27.jpg)
A New Kind of Empirical Science
![Page 28: Data Science Vancouverdatascholars.com/data/post/2013/03/29/don_turnbull_data... · 2013-12-01 · Data Science Vancouver Don Turnbull, PhD @donturn #datascienceyvr . Overview !](https://reader034.vdocuments.site/reader034/viewer/2022042314/5f028a337e708231d404c4d1/html5/thumbnails/28.jpg)
Predict everything?
![Page 29: Data Science Vancouverdatascholars.com/data/post/2013/03/29/don_turnbull_data... · 2013-12-01 · Data Science Vancouver Don Turnbull, PhD @donturn #datascienceyvr . Overview !](https://reader034.vdocuments.site/reader034/viewer/2022042314/5f028a337e708231d404c4d1/html5/thumbnails/29.jpg)
Sometimes you can’t
![Page 30: Data Science Vancouverdatascholars.com/data/post/2013/03/29/don_turnbull_data... · 2013-12-01 · Data Science Vancouver Don Turnbull, PhD @donturn #datascienceyvr . Overview !](https://reader034.vdocuments.site/reader034/viewer/2022042314/5f028a337e708231d404c4d1/html5/thumbnails/30.jpg)
![Page 31: Data Science Vancouverdatascholars.com/data/post/2013/03/29/don_turnbull_data... · 2013-12-01 · Data Science Vancouver Don Turnbull, PhD @donturn #datascienceyvr . Overview !](https://reader034.vdocuments.site/reader034/viewer/2022042314/5f028a337e708231d404c4d1/html5/thumbnails/31.jpg)
! Making qualitative judgments (heuristics) to apply methods
! Look for isomorphic problems that have been solved
! Variability & Applicability is often wide ! Technique is critical ! (Peer) Review
Don’t Reinvent the Wheel
Isn’t experience qualitative?
![Page 32: Data Science Vancouverdatascholars.com/data/post/2013/03/29/don_turnbull_data... · 2013-12-01 · Data Science Vancouver Don Turnbull, PhD @donturn #datascienceyvr . Overview !](https://reader034.vdocuments.site/reader034/viewer/2022042314/5f028a337e708231d404c4d1/html5/thumbnails/32.jpg)
WWxD?
! Finance - WWQD?
! Statistics - WWBED?
! Computer Science – WW*D?
! Math – WW*D?
![Page 33: Data Science Vancouverdatascholars.com/data/post/2013/03/29/don_turnbull_data... · 2013-12-01 · Data Science Vancouver Don Turnbull, PhD @donturn #datascienceyvr . Overview !](https://reader034.vdocuments.site/reader034/viewer/2022042314/5f028a337e708231d404c4d1/html5/thumbnails/33.jpg)
![Page 34: Data Science Vancouverdatascholars.com/data/post/2013/03/29/don_turnbull_data... · 2013-12-01 · Data Science Vancouver Don Turnbull, PhD @donturn #datascienceyvr . Overview !](https://reader034.vdocuments.site/reader034/viewer/2022042314/5f028a337e708231d404c4d1/html5/thumbnails/34.jpg)
Solving Data Science Problems
! Isomorphic Problems
! Apply theory from other fields to solve problems
! Use these modeling techniques and transform them in sync with computational power
![Page 35: Data Science Vancouverdatascholars.com/data/post/2013/03/29/don_turnbull_data... · 2013-12-01 · Data Science Vancouver Don Turnbull, PhD @donturn #datascienceyvr . Overview !](https://reader034.vdocuments.site/reader034/viewer/2022042314/5f028a337e708231d404c4d1/html5/thumbnails/35.jpg)
Data Science History
! Cryptography
! Knowledge Discovery in Databases ! At least 30 years of Research in KDD
! Superb Tools & Techniques
! Even more research from isomorphic solutions
![Page 36: Data Science Vancouverdatascholars.com/data/post/2013/03/29/don_turnbull_data... · 2013-12-01 · Data Science Vancouver Don Turnbull, PhD @donturn #datascienceyvr . Overview !](https://reader034.vdocuments.site/reader034/viewer/2022042314/5f028a337e708231d404c4d1/html5/thumbnails/36.jpg)
The KDD Process
![Page 37: Data Science Vancouverdatascholars.com/data/post/2013/03/29/don_turnbull_data... · 2013-12-01 · Data Science Vancouver Don Turnbull, PhD @donturn #datascienceyvr . Overview !](https://reader034.vdocuments.site/reader034/viewer/2022042314/5f028a337e708231d404c4d1/html5/thumbnails/37.jpg)
My KDD Bootstrap
![Page 38: Data Science Vancouverdatascholars.com/data/post/2013/03/29/don_turnbull_data... · 2013-12-01 · Data Science Vancouver Don Turnbull, PhD @donturn #datascienceyvr . Overview !](https://reader034.vdocuments.site/reader034/viewer/2022042314/5f028a337e708231d404c4d1/html5/thumbnails/38.jpg)
KDD Work ! Frequency Analysis (Statistics)
! Behavioral Data Mining
! Log Analysis > Transaction Log Analysis
! Recommender Systems & Collaborative Filtering
! Financial Analysis (Behavioral, Hybrid Time Series)
! Advertising Efficacy ! Traffic Analysis (~)
! Semantics
!
![Page 39: Data Science Vancouverdatascholars.com/data/post/2013/03/29/don_turnbull_data... · 2013-12-01 · Data Science Vancouver Don Turnbull, PhD @donturn #datascienceyvr . Overview !](https://reader034.vdocuments.site/reader034/viewer/2022042314/5f028a337e708231d404c4d1/html5/thumbnails/39.jpg)
WebKDD Example
! Pilot = client app logs of Web use
! Full = network logs of Web use ! Longer study period, lots more users
! Many orders of magnitude of data to analyze means subtle patterns may be discovered
! Substantive evidence of patterns of behavior
! Larger than all previous studies of Web use combined… 3000% more
![Page 40: Data Science Vancouverdatascholars.com/data/post/2013/03/29/don_turnbull_data... · 2013-12-01 · Data Science Vancouver Don Turnbull, PhD @donturn #datascienceyvr . Overview !](https://reader034.vdocuments.site/reader034/viewer/2022042314/5f028a337e708231d404c4d1/html5/thumbnails/40.jpg)
That’s a big twinkie
![Page 41: Data Science Vancouverdatascholars.com/data/post/2013/03/29/don_turnbull_data... · 2013-12-01 · Data Science Vancouver Don Turnbull, PhD @donturn #datascienceyvr . Overview !](https://reader034.vdocuments.site/reader034/viewer/2022042314/5f028a337e708231d404c4d1/html5/thumbnails/41.jpg)
My Ongoing Projects
! Tapstream
! Twitter Text Analysis ! Recommender System
! Behavioral Modeling & User Studies ! Whales, Use Frequency, Popularity
![Page 42: Data Science Vancouverdatascholars.com/data/post/2013/03/29/don_turnbull_data... · 2013-12-01 · Data Science Vancouver Don Turnbull, PhD @donturn #datascienceyvr . Overview !](https://reader034.vdocuments.site/reader034/viewer/2022042314/5f028a337e708231d404c4d1/html5/thumbnails/42.jpg)
Everything is Better
! Tools
! Methods
! People
! Groups
![Page 43: Data Science Vancouverdatascholars.com/data/post/2013/03/29/don_turnbull_data... · 2013-12-01 · Data Science Vancouver Don Turnbull, PhD @donturn #datascienceyvr . Overview !](https://reader034.vdocuments.site/reader034/viewer/2022042314/5f028a337e708231d404c4d1/html5/thumbnails/43.jpg)
Where to Look
! Academic Work ! GoogleScholar or Microsoft Academic Search
! Patents
! Classes
! Coursera, CodeAcademy, Cloudera…
! Conferences
! SIGIR, SIGKDD, CIKM, WWW Conf
! Meetups
![Page 44: Data Science Vancouverdatascholars.com/data/post/2013/03/29/don_turnbull_data... · 2013-12-01 · Data Science Vancouver Don Turnbull, PhD @donturn #datascienceyvr . Overview !](https://reader034.vdocuments.site/reader034/viewer/2022042314/5f028a337e708231d404c4d1/html5/thumbnails/44.jpg)
![Page 45: Data Science Vancouverdatascholars.com/data/post/2013/03/29/don_turnbull_data... · 2013-12-01 · Data Science Vancouver Don Turnbull, PhD @donturn #datascienceyvr . Overview !](https://reader034.vdocuments.site/reader034/viewer/2022042314/5f028a337e708231d404c4d1/html5/thumbnails/45.jpg)
Vancouver Data Science Goals
! What can we do in person that is optimal? ! Jobs
! Interactive Tool Demos
! Paper Reviews and Walkthroughs
! People ! @reiver @DataScholars @josh_wills
! Group Problem Solving