farming dinosaurs

26
© 2017 Delphix. All Rights Reserved. Private and Confidential. © 2017 Delphix. All Rights Reserved. Private and Confidential. Kellyn Pot’Vin-Gorman | Technical Intelligence Manager | September, 2017 Farming Dinosaurs And Avoiding Meteor Showers

Upload: kellyn-potvin-gorman

Post on 29-Jan-2018

283 views

Category:

Technology


1 download

TRANSCRIPT

© 2017 Delphix. All Rights Reserved. Private and Confidential. © 2017 Delphix. All Rights Reserved. Private and Confidential.

Kellyn Pot’Vin-Gorman | Technical Intelligence Manager | September, 2017

Farming Dinosaurs And Avoiding Meteor Showers

© 2017 Delphix. All Rights Reserved. Private and Confidential. 2

Kellyn Pot’Vin-GormanTechnical Intelligence Manager, Delphix•  Multi-platform DBA, (Oracle, MSSQL, MySQL,

Sybase, Postgres…..)•  Oracle ACE Director, (Alumni)•  Oak Table Network•  APEX Women in Technology Award, CTA 2014•  STEM education with Raspberry Pi and Python•  President, Rocky Mtn Oracle User Group•  Liaison, Denver SQL Server User Group•  Author, blogger, (http://dbakevlar.com)

© 2017 Delphix. All Rights Reserved. Private and Confidential.

© 2017 Delphix. All Rights Reserved. Private and Confidential.

© 2017 Delphix. All Rights Reserved. Private and Confidential.

Technology is Changing

•  Some kind of autonomous database?? •  83% new cloud initiatives

•  When we look back in history and I don’t mean from a recent standpoint, have we come in addressing it?

http://www.devx.com/enterprise/devops-drives-revenue-for-it-shops-ca-study.html

© 2017 Delphix. All Rights Reserved. Private and Confidential.

Why Do You Think This Exists?

© 2017 Delphix. All Rights Reserved. Private and Confidential.

History Will Show us…

1837

1876

1919

1943

1966

1981

1995

2014

Today

© 2017 Delphix. All Rights Reserved. Private and Confidential.

Data is Heavy

© 2017 Delphix. All Rights Reserved. Private and Confidential.

The Economics of Data

•  Data has cost- i.e., databases have a COST Based Optimizer •  It has a cost in IO •  Cost in Memory and Compute •  Cost in Network

•  How far have we come in addressing those costs?

© 2017 Delphix. All Rights Reserved. Private and Confidential.

Why the Economics of Data Is Important

•  Who is Jim Gray? •  Why his papers on the Economics of Data are so

important •  Open Source hardware that creates more productivity

with data for many scientists

https://jimgray.azurewebsites.net/

© 2017 Delphix. All Rights Reserved. Private and Confidential.

Yet, We Go Back to von Neumann…

•  Born in Budapest •  Child prodigy •  Graduated with two degrees by 1927- Chemistry

and Mathematics •  Great supporter of why we use binary digit as the

unit of compute memory. •  And as our focus today, vonNeumann Architecture

and Bottleneck

© 2017 Delphix. All Rights Reserved. Private and Confidential.

Von Neumann Architecture

•  Based off the work of John von Neumann in 1945. •  Based on ALU, control unit, memory and I/O devices •  Storage of numbers and a limited groups of integers. •  Was a huge improvement on pure-plugboard computing popular at that

time. •  Von Neumann literally is parallel processing vs. Harvard Architecture •  Smart memory differs from von Neumann is that it often removes CPU

and focuses just on a ton of memory, with each memory cell supporting FETCH/STORE and ALU operations.

https://www.computerscience.gcse.guru/theory/von-neumann-architecture

© 2017 Delphix. All Rights Reserved. Private and Confidential.

Still In Use Today

© 2017 Delphix. All Rights Reserved. Private and Confidential.

Von Neumann Bottleneck

•  Percentage of compute power vs. what is available in total. •  Introduce parallel to compensate. •  In turn, we then run into bottleneck of the width of the data bus. •  We then can increase the I/O clock rate, but then the increase of

running signals across the circuit board begin to fail/error out. •  The final end to this circle is that we need to upgrade the original

memory devices to move the bottleneck another step forward. •  Only significant changes will change this bottleneck.

© 2017 Delphix. All Rights Reserved. Private and Confidential.

Why Von Neumann’s is Important

CPU Memory

Von Neumann Bottleneck

© 2017 Delphix. All Rights Reserved. Private and Confidential.

Shannon’s Law

•  From Shannon-Hartley theorem. •  Based on telephony technology back in late 1920’s •  Maximum rate information can be transmitted over a

communications channel minus errors, (noise) •  Very dependent upon channel capacity •  Infiniband vs. traditional network communication

© 2017 Delphix. All Rights Reserved. Private and Confidential.

Why Is Shannon’s Law Important

•  Network is the new bottleneck, even with so many new network technologies.

•  Noise across the network, especially to the cloud is considerably impactful to migration and hybrid environment success.

© 2017 Delphix. All Rights Reserved. Private and Confidential.

Now, Why Data Matters

© 2017 Delphix. All Rights Reserved. Private and Confidential.

The 1854 Broad St. Cholera Outbreak

•  Cholera = black death •  Soho area of London •  Germ theory wasn’t confirmed until 1862 via Louis Pasteur •  Poor sanitary conditions and huge influx of people •  Over 14K people died between 1832-1849 in the area •  Poor medical knowledge and no data research believed it was

transferred via air, (i.e. miasmata) •  Research by John Snow, (not that John Snow…J)

© 2017 Delphix. All Rights Reserved. Private and Confidential.

Pump

Brewery Monastery

Likes Taste

https://www1.udel.edu/johnmack/frec682/cholera/snow_map.png

© 2017 Delphix. All Rights Reserved. Private and Confidential.

Failure of Taking Data Seriously

•  Everything pointed back to the water pump where people got their water from.

•  For those children that died that didn’t live where the water pump supplied water, they went to schools that did.

•  None took him seriously, the science wasn’t there.

https://www.pinterest.co.uk/explore/john-snow-cholera-map/?lp=true

© 2017 Delphix. All Rights Reserved. Private and Confidential.

Finally…

…John was able to convince the constable to let him take the handle off

the water pump.

The epidemic stopped.

© 2017 Delphix. All Rights Reserved. Private and Confidential.

Data Can Save Lives•  Although removing the handle from the pump

stopped the epidemic, no one believed Snow, (fake news.)

•  Years later enhancements to the system were placed in London

•  1883, Dr. Robert Koch researched and discovered the bacteria that caused cholera.

•  19th century then ended the ongoing plague epidemics common to European and US cities.

© 2017 Delphix. All Rights Reserved. Private and Confidential.

Now Let’s Talk About TodayBy 2020, •  1.7MB of data will be created for every person on the plant every

second. •  We’ll also have 44ZB of data, vs. only 5.8ZB currently. •  A 1/3 of all data will be in the cloud. •  Big Data integrations could, COULD reduce overall costs by $1K a year

per person. •  A common Fortune 1000 company, increasing access to data, could

benefit by $65 million in net income. •  Retailers could increase operating margins by almost 60%.

Currently, less than .5% of data is analyzed and used.

© 2017 Delphix. All Rights Reserved. Private and Confidential.

So…History has shown us: •  The Economics of Data •  Architecture •  Compute Bottleneck •  Network Law •  How Data Can Save Us

•  We’ve come far with new releases and the cloud, but even with what you hear this week…

© 2017 Delphix. All Rights Reserved. Private and Confidential. © 2017 Delphix. All Rights Reserved. Private and Confidential.

Are We Still Farming Dinosaurs?

Twitter: @DBAKevlar Linkedin: Kellyn Pot’Vin-Gorman

Email: [email protected] or [email protected]