farming dinosaurs
TRANSCRIPT
© 2017 Delphix. All Rights Reserved. Private and Confidential. © 2017 Delphix. All Rights Reserved. Private and Confidential.
Kellyn Pot’Vin-Gorman | Technical Intelligence Manager | September, 2017
Farming Dinosaurs And Avoiding Meteor Showers
© 2017 Delphix. All Rights Reserved. Private and Confidential. 2
Kellyn Pot’Vin-GormanTechnical Intelligence Manager, Delphix• Multi-platform DBA, (Oracle, MSSQL, MySQL,
Sybase, Postgres…..)• Oracle ACE Director, (Alumni)• Oak Table Network• APEX Women in Technology Award, CTA 2014• STEM education with Raspberry Pi and Python• President, Rocky Mtn Oracle User Group• Liaison, Denver SQL Server User Group• Author, blogger, (http://dbakevlar.com)
© 2017 Delphix. All Rights Reserved. Private and Confidential.
Technology is Changing
• Some kind of autonomous database?? • 83% new cloud initiatives
• When we look back in history and I don’t mean from a recent standpoint, have we come in addressing it?
http://www.devx.com/enterprise/devops-drives-revenue-for-it-shops-ca-study.html
© 2017 Delphix. All Rights Reserved. Private and Confidential.
History Will Show us…
1837
1876
1919
1943
1966
1981
1995
2014
Today
© 2017 Delphix. All Rights Reserved. Private and Confidential.
The Economics of Data
• Data has cost- i.e., databases have a COST Based Optimizer • It has a cost in IO • Cost in Memory and Compute • Cost in Network
• How far have we come in addressing those costs?
© 2017 Delphix. All Rights Reserved. Private and Confidential.
Why the Economics of Data Is Important
• Who is Jim Gray? • Why his papers on the Economics of Data are so
important • Open Source hardware that creates more productivity
with data for many scientists
https://jimgray.azurewebsites.net/
© 2017 Delphix. All Rights Reserved. Private and Confidential.
Yet, We Go Back to von Neumann…
• Born in Budapest • Child prodigy • Graduated with two degrees by 1927- Chemistry
and Mathematics • Great supporter of why we use binary digit as the
unit of compute memory. • And as our focus today, vonNeumann Architecture
and Bottleneck
© 2017 Delphix. All Rights Reserved. Private and Confidential.
Von Neumann Architecture
• Based off the work of John von Neumann in 1945. • Based on ALU, control unit, memory and I/O devices • Storage of numbers and a limited groups of integers. • Was a huge improvement on pure-plugboard computing popular at that
time. • Von Neumann literally is parallel processing vs. Harvard Architecture • Smart memory differs from von Neumann is that it often removes CPU
and focuses just on a ton of memory, with each memory cell supporting FETCH/STORE and ALU operations.
https://www.computerscience.gcse.guru/theory/von-neumann-architecture
© 2017 Delphix. All Rights Reserved. Private and Confidential.
Von Neumann Bottleneck
• Percentage of compute power vs. what is available in total. • Introduce parallel to compensate. • In turn, we then run into bottleneck of the width of the data bus. • We then can increase the I/O clock rate, but then the increase of
running signals across the circuit board begin to fail/error out. • The final end to this circle is that we need to upgrade the original
memory devices to move the bottleneck another step forward. • Only significant changes will change this bottleneck.
© 2017 Delphix. All Rights Reserved. Private and Confidential.
Why Von Neumann’s is Important
CPU Memory
Von Neumann Bottleneck
© 2017 Delphix. All Rights Reserved. Private and Confidential.
Shannon’s Law
• From Shannon-Hartley theorem. • Based on telephony technology back in late 1920’s • Maximum rate information can be transmitted over a
communications channel minus errors, (noise) • Very dependent upon channel capacity • Infiniband vs. traditional network communication
© 2017 Delphix. All Rights Reserved. Private and Confidential.
Why Is Shannon’s Law Important
• Network is the new bottleneck, even with so many new network technologies.
• Noise across the network, especially to the cloud is considerably impactful to migration and hybrid environment success.
© 2017 Delphix. All Rights Reserved. Private and Confidential.
The 1854 Broad St. Cholera Outbreak
• Cholera = black death • Soho area of London • Germ theory wasn’t confirmed until 1862 via Louis Pasteur • Poor sanitary conditions and huge influx of people • Over 14K people died between 1832-1849 in the area • Poor medical knowledge and no data research believed it was
transferred via air, (i.e. miasmata) • Research by John Snow, (not that John Snow…J)
© 2017 Delphix. All Rights Reserved. Private and Confidential.
Pump
Brewery Monastery
Likes Taste
https://www1.udel.edu/johnmack/frec682/cholera/snow_map.png
© 2017 Delphix. All Rights Reserved. Private and Confidential.
Failure of Taking Data Seriously
• Everything pointed back to the water pump where people got their water from.
• For those children that died that didn’t live where the water pump supplied water, they went to schools that did.
• None took him seriously, the science wasn’t there.
https://www.pinterest.co.uk/explore/john-snow-cholera-map/?lp=true
© 2017 Delphix. All Rights Reserved. Private and Confidential.
Finally…
…John was able to convince the constable to let him take the handle off
the water pump.
The epidemic stopped.
© 2017 Delphix. All Rights Reserved. Private and Confidential.
Data Can Save Lives• Although removing the handle from the pump
stopped the epidemic, no one believed Snow, (fake news.)
• Years later enhancements to the system were placed in London
• 1883, Dr. Robert Koch researched and discovered the bacteria that caused cholera.
• 19th century then ended the ongoing plague epidemics common to European and US cities.
© 2017 Delphix. All Rights Reserved. Private and Confidential.
Now Let’s Talk About TodayBy 2020, • 1.7MB of data will be created for every person on the plant every
second. • We’ll also have 44ZB of data, vs. only 5.8ZB currently. • A 1/3 of all data will be in the cloud. • Big Data integrations could, COULD reduce overall costs by $1K a year
per person. • A common Fortune 1000 company, increasing access to data, could
benefit by $65 million in net income. • Retailers could increase operating margins by almost 60%.
Currently, less than .5% of data is analyzed and used.
© 2017 Delphix. All Rights Reserved. Private and Confidential.
So…History has shown us: • The Economics of Data • Architecture • Compute Bottleneck • Network Law • How Data Can Save Us
• We’ve come far with new releases and the cloud, but even with what you hear this week…
© 2017 Delphix. All Rights Reserved. Private and Confidential. © 2017 Delphix. All Rights Reserved. Private and Confidential.
Are We Still Farming Dinosaurs?
Twitter: @DBAKevlar Linkedin: Kellyn Pot’Vin-Gorman
Email: [email protected] or [email protected]