drivescale - summer 2018 v15sgo.drivescale.com/rs/451-esr-800/images/drivescale... · § improving...

DriveScale Confidential & Proprietary 2018

1

DriveScale Inc &

“Software Composable Infrastructurefor Modern Workloads”

Alan ButlerVP, Global Alliances & Business Development


2

Founded by Computer and Network Technologists

Pioneered Software Composable Infrastructure for hyper-scale applications

Gartner “2018 Cool Vendor for Cloud Infrastructure”


On Premise Solution with Cloud like agility to run Modern Workloads at a fraction of the cost

3


Key Message – DriveScale

4

▪ DriveScale has solved how to disaggregate Compute from Storage– iSCSI and NVMeoF; bare metal for HDD & NVMe SSD– HDD and NVMe with the same DriveScale SW– Scales to over 10k nodes, and 100k drives– Block storage; HDD are per unit; Flash drives can be carved up to multiple nodes– Supports persistent storage in Kubernetes including RedHat OpenShift– Fully certified in Hadoop (Cloudera, Hortonworks, MapR)– DriveScale does to Clusters what VM’s did to Servers.

▪ DellEMC, with DriveScale, can now solve specific customer challenges– Use standard DellEMC x86 servers (Linux), Dell Networking, & DellEMC JBODS– Connected with DriveScale technology– See DellEMC blog on disaggregation benefits

• https://blog.dellemc.com/en-us/server-disaggregation-sometimes-the-sum-of-the-parts-is-greater-than-the-whole/?cmp=soc-sprinklr-3497-1185778910&linkId=45302178


Two 2 min video’s - DriveScale

5

Why DriveScale? 2 min vídeo

Watch now

- Customer reference (Public to PrivateCloud)- 2 min vídeo

Watch now

https://drivescale.com/say-yes-video-2/

https://drivescale.com/customers/clearsense/


Phil RousseyCo-Founder, EVP

Bell Micro

DriveScale Founders and Key Advisors

6

Satya Nishtala, CTO • Fellow, System Architect: Nuova (Cisco UCS)• Lead architect: Sun - UltraSPARC workstations

and work-group servers, Storage

Tom Lyon, Chief Scientist• Founder: Nuova Emp#1(Cisco - UCS)• Founder: Ipsilon (Nokia – IP Switching)• Sun Microsystems Emp#8 – NFS, SunOS, SPARC

F O U N D E R S

Amr AwadallahFounder/CTO

Cloudera

Herb CunitzPresident

Hortonworks

Whit DiffiePioneer of Public

Key Cryptography

Scott McNealyFounder, CEO

Sun Microsystems

A D V I S O R S


The Right Team

7

Satya Nishtala

Cisco UCS Systems

NetContinuum

IP Switching atIpsilon

Zero Motorcycles

SunLink Networking/NFSTom Lyon

Gene BanmanVP/GM

Brian PawlowskiNFS/Storage

CTO

Chief Architect


Relationship: Dell Technologies & DriveScale

8

▪ Strong BU engagement– DellEMC - Server BU – NGM Product Line – MX7000– DellEMC – Storage BU - ECS (Elastic Cloud Storage) – Pivotal – GreenPlum

▪ Field Enablement efforts– Member of DellEMC S&P / EI Reseller Program – Member of Pivotal ISV Program– Fully validated and tested by Dell Server & Storage CTO and BU office– Solution Center - Deployed in Austin RR3 Solution Center (expanding worldwide)– Existing joint wins already deployed, live, and fully referenceable– DellEMC Channel Partners alignment including WWT, Ingram Micro / ProMark, Round Tower, etc.– Sponsor of DellEMC World 2017 & 2018; Dell Tech Summit (Aug 2018, Americas & EMEA), etc.

▪ Under development– Joint Reference Architectures – HPE take out campaign ”No HoPE”


Joint Customers: DellEMC & DriveScale

9

§ #2 Online Advertising company (Google DoubleClick is #1)§ 2200 server nodes and 7 data centers running big data appsWhy they chose DriveScale:

§ Improving utilization, breaking down silos, moving resources to best use§ Separating compute and storage life cycle management

Timothy Smith, SVP of Technical Operations - “DriveScale will help us reduce excess resources trapped in siloed clusters and thus contribute directly to our bottom line.”

§ Healthcare analytics service improves patient outcomes by applying ML to electronic medical records§ Started in AWS, but moved to private cloudWhy they chose DriveScale:

§ Problems with performance, cost and provisioning time using public cloud§ Wanted to maintain flexibility of public cloud, but with bare metal performance and lower cost

Charles Boicey, Chief Innovation Officer - “We found we were paying for our servers every 4 months. Why not pay for them every 4 years instead!”


DriveScaleISV’s- SoftwareComposableInfrastructureforModernWorkloads

BigData NoSQL/NewSQL Containers Storage/Archival

MPPDatabases


Focus #1: DellEMC & DriveScale vs HPE – “No HoPE”

qHPE Big Data (Synergy & Apollo)– Single points of failure = YES, Customer Pain!– List 150% more expensive that a combined Dell EMC w/DriveScale solution– Limited Capacity and Choice (40 drives for a max of 8 servers, limits the storage to

5 drives/server. Limited choice of HPE compatible blades, SAN, NAS or SDS. – HPE Synergy storage module does not support 3.5” drives. Limited DAS oriented

workloads with higher capacity SAN

qCustomer Benefits with DellEMC & DriveScale – No single points of failure – 35% lower cost– Increased Choice - Works with any DellEMC blade, rack servers & supported JBODs.– Flexibility - Use the same solution for compute or storage intensive applications– Composability - Workloads achieve composability at the data center level


Focus #2: Cold Storage

qOperational Benefits – Agile Infrastructure – IT administrators, can modify the existing Hadoop cluster by adding or

removing more drives to the existing compute nodes or more compute nodes without provisioning any additional storage

– You can connect 100’s of drives to the same server (use case specific)

qReliability Benefits – Node Failure – In case of a node failure, the entire drives can be moved to a spare node

instantly to avoid any data loss and network flooding due to data replication– Disk Failure Management – Today manual vs automated via DriveScale– Disk Replacement – From the DS UI IT administrators can reallocate a spare disk in <2 minutes

vs weeks/months today

qEnhanced Security– Full drive at rest encryption and data in-flight encryption – iSCSI CHAP authentication support for all end points


Focus #3: Hadoop On-Demand; On-Prem Big Data Analyticsq Storage and Compute Expansion & Disaggregation

– With DriveScale the Big Data environment is not limited to the physical storage capacity in the server node – Storage expansion of the cluster on the fly– Compute expansion of the cluster on the fly– Separation of Compute vs Storage expansion as desired

q Cluster performance– Performance - Performance equivalent to bare metal servers with direct attached storage– Data local data locality is maintained to achieve faster execution and high throughput

q Enhanced Security– Full drive at rest encryption and data in-flight encryption – iSCSI CHAP authentication support for all end points

q Operational Benefits – Disk Failure Management – Today manual vs automated via DriveScale– Disk Replacement – From the DriveScale UI IT administrators can reallocate a spare disk in <2 minutes vs

weeks or months today– Node Failure – In case of a node failure, the entire drives can be moved to a spare node instantly to avoid

any data loss and network flooding due to data replication– Agile Infrastructure – IT administrators, can modify the existing Hadoop cluster by adding or removing more

drives to the existing compute nodes or more compute nodes without provisioning any additional storage


DellEMC & DriveScale – Mutual Competition

14

1. Big Data in the Public Cloud• Good for experiments, but not production or scale• Expensive in steady production

2. HPE Big Data Architecture• Using Apollo servers as “storage nodes”• Not robust; single points of failure• Expensive - HPE 4200 is 150% (list) more expensive than

combined DellEMC w/DriveScale

DriveScale Confidential & Proprietary 2018©2017 DriveScale Inc. All Rights Reserved.

15

How DriveScale does Composability


What is Software Composable Infrastructure?

16

1) Disaggregate servers into…• Compute resources (diskless servers)

• Storage resources (JBODs, NVMe EBOFs)

2) Compose nodes and clusters by…• Combining servers with storage via software• Dynamically re-compose as needs change

Two Simple Steps:


Step 1: Disaggregate the Servers

TypicalRackServerConfiguration

Insteadofbuyingserverswithinternaldrives…

Startbuyingdisklessserverswithexternaldrives

DriveScalePooledResources

DisklessServers

HDDorFlashStorage


Step 2: Dynamically Compose Servers and Clusters

Ø Easilycomposesoftware-defined physicalnodesandclusterson-the-fly

Ø Combinejustthecomputeandstorageresourcesneededperworkload

Ø Easilyadd,removeorbalanceresources,evenbetweenclusters– nomoresilos!

Ø Performanceequivalenttobaremetalserverswithdirectattachedstorage

Ø Nochangesneededtotheapplicationstack

DriveScalePooledResources

DisklessServers

HDDorFlashStorage


DriveScale Composer• CollectsinventoryfromAgentsandHDD/NVMeAppliances• Nodeandclustercompositionandconfiguration• Constraintmanagement• Viewcluster/server/drivestatus• Encryption,RAID,driveshredding

DriveScale Solution Software Components

DriveScale Central• Cloud-basedportalforadministrationofallsites• Downloadsoftwareupdates,viewlogfiles,documentation,etc.

DriveScale Agent• LightweightagentrunsonLinuxservers• ProvidesservernodeinventorytoDMS• Includesserverconfigurationandmonitorsstatus

DriveScale Agent

Copyright2018


DellEMC Compute, Networking & Storage (JBOD/JBOF)

DriveScale worksDellEMCCompute,Networking,andJBODstoragesolutions

ComputeOptions• RackServers• BladeServers• ModularServers

StorageOptions• SASHDD/SSDinJBODs• NVMeEBOF(Ethernet-attachedBunchofFlash)

DriveScale HDDAppliancewithDellEMCSASJBOD

DriveScale NVMeAppliance


DellEMC & DriveScale – Call to Action

21

1. Internal Dell EMC - Look in your SFDC and identify focused opportunities• HPE Compete (Apollo or Synergy)

• Cold Storage (eg. Can connect >100 drives to one node today)

• Big Data, Hadoop (fully certified Cloudera, Hortonworks, MapR)

2. Contact [email protected]• Engage - @ the TECHNICAL level to validate

• Leverage - our existing joint references in the field

• POC - Consider a joint POC (when appropriate)


THANK YOU

Questions - Discussion

22


23

Appendix


DriveScale Customer Case Study: AppNexus

24

▪ #2 Online Advertising company (Google DoubleCllick #1)▪ Serves 10s of billions ad buys per day; revenue > $2B annually▪ 2200 Server Nodes and 7 data centers running Big Data apps▪ Why they chose DriveScale

– Flexibly re-allocate servers from one application to another without ‘laying hands’ on the hardware– Significantly reduced operations workload– Increased velocity of delivering new products and features to their customer base– They can now add compute-only nodes (their customers are asking for this)– Reduce Operational impact of refreshing their servers– Reduce Datacenter footprint, power, cooling (they are out of space)– Looking to deploy DriveScale for all NAS applications, using containers

Timothy Smith, SVP of Technical Operations at AppNexus“Storage and server technology upgrades move on two different timetables. Without DriveScale, we are forced into

storage refresh cycles that aren't strictly necessary, and are very cumbersome. Separating storage from compute allows us to upgrade or reallocate compute resources independent of storage. “

“DriveScale significantly decreases the operations workload, as a result increasing the velocity of delivering new products and features to our customer base. DriveScale will also help us reduce wasted resources trapped in siloed clusters and thus contribute directly to our bottom line.”


DriveScale Customer Reference - Clearsense

25

▪ Healthcare Analytics Technology company which transforms data from electronic medical records (EMRs), supporting source systems, & legacy databases to enable new revenue streams for healthcare

▪ Hadoop responsiveness is something that they tout to their customers, and DriveScale technology gives them this infrastructure flexibility

▪ Why they chose DriveScale– DriveScale helped them move back from Amazon AWS public cloud and build a private cloud

• After 18 months in production at AWS, they were unhappy with responsiveness and costs– Future Proof Adaptability, Scalability, and Investment Protection

▪CharlesBoicey,ChiefInnovationOfficeratClearSense“DriveScalehelpsusbuilda‘future-proof’infrastructure.Asourcustomerneedsincrease,wecannowrespondmorequicklyand

withouthavingtomakemassivecapitalexpenditures.”

“Wespentalotoftimeengineeringoursoftwareenvironmentaroundreal-timeneeds,ensuringaproductive,scalableandeconomicallyviableenvironment.Now,withDriveScale,wehavetheabilitytodothesamethingwithhardware,”


26

DellEMC with DriveScale vs

HPE Apollo 4200


DellEMC and DriveScale vs HPE Apollo 4200q Availability

§ Apollo 4200 which may serve as the storage node has a single controller and hence becomes a single point of failure (SPOF) for any application or workload.

Ø If a node fails all of the 28 drives needs to be replicated on the other storage nodes and drives. Ex: If the drives are 6TB each then, the network is flooded with 168 TB of data at once.

Ø The network is flooded with the data from the 28 drives to be replicated and the ongoing jobs will be delayed and are affected with the data replication

Ø Spare Apollo 4200 storage nodes might be required to be used when a node fails.

Ø Max memory configuration supported is 1.5 TB.

§ OS maintenance on data nodes:

Ø If there an OS update required, then the entire node with 28 drives needs to be put under maintenance mode and that would also trigger replication of data across the other available storage nodes.

Ø Firmware upgrades of storage nodes poses a similar issue as above


DellEMC and DriveScale vs HPE Apollo (Cont..)

q Savings Ø TCO for DellEMC and DriveScale solution is approximately 33% cheaper just for HPE

hardware costs

q Benefits of DellEMC with DriveScale Ø Significant cost savings

Ø Have 4 path to each drive in the JBOD with dual IO controllers.

Ø You can sustain with 1 JBOD IO controller, 1 switch and 1DSA failures.

Ø Worker nodes can have better compute (CPU and memory) configuration.

Ø Customers do not need spare JBODs as backup.


29


HPE Apollo 6500/2000


DellEMC and DriveScale vs HPE Apollo (Cont..)

q Availability§ Apollo 6500/2000 which may serve as the compute node has a single controller and hence

becomes a single point of failure (SPOF) for any application or workload.

Ø Storage is limited with the high compute configurations. HPE needs to employ Apollo 4200 for storage. (Refer above for disadvantages)

Ø If a node fails the compute and storage both are unusable until they are replaced.

Ø The drives (storage) can not be assigned to another node for continued use of the data.

Ø Max memory configuration supported is 1 TB.

q Cost§ Composability at data center level. Customers can add blades and rack servers in the same rack and still use the

same DriveScale-DellEMC solution.

§ HPE still has some very expensive composability story, while currently DellEMC does not have a composability story.

§ Together with DriveScale, DellEMC has a very compelling, cost effective, good performing composability story at a data center level meeting the requirements of all modern workloads and applications.

©2017DriveScaleInc.AllRightsReserved.


31


HPE Synergy


DellEMC and DriveScale vs HPE Synergy

q GeneralØ Too many components required for getting started (Synergy 12000 Frame + Synergy composer + Storage

Modules {DAS/SAN/Software-Defined Storage) + Synergy Fabric + optional Synergy Image Streamer management appliance + Synergy Compute modules}.

Ø For a minimum configuration, you can only get 40 drives for a max of 8 servers which limits the storage to 5 drives/server. For getting more storage you would have to add SAN or SDS or another frame.

qCapacity & Cost - 3.5” drives provide larger capacity point than 2.5” drives. Ø Today’s HPE Synergy storage module does not support 3.5” drives.

Ø High capacity workloads can still be serviced using a SAN, but there are a few DAS oriented applications which require very large capacity and primarily do not need any performance.

Ø In such cases, Synergy may not provide the most cost effective storage solution, if any application requires both performance and dense storage, Synergy is still a platform of choice for such workload..



DellEMC and DriveScale vs HPE Synergy (Cont..)

Ø Limited choice of HPE compatible blades, SAN, NAS or SDS.

Ø Basically customers can only choose from their list of compute, fabric, storage and frame options.

q Customer Benefits - DellEMC with DriveScale Ø Can work with any DellEMC blade, rack servers & JBODs.

Ø Can use the same DriveScale and DellEMC solution for compute or storage intensive applications or workloads with optimal performance.

Ø Customers can achieve composability at a data center to meet requirements for all modern workloads or applications level rather than per application and workload level (as in the case of HPE Synergy).



DellEMC & DriveScale vs HPE References

Ø http://bladesmadesimple.com/2016/04/a-first-look-at-hpe-synergy-hardware/

Ø https://h20195.www2.hpe.com/v2/Library.aspx?doctype=41&doccompany=HPE&footer=41&filter_doctype=no&filter_doclang=no&country=&filter_country=no&cc=us&lc=en&status=A&filter_status=rw#doctype-41&doccompany-HPE&prodtype_oid-1008596877&status-a&sortorder-csdisplayorder&teasers-off&isRetired-false&isRHParentNode-false&titleCheck-false

Ø https://blogs.vmware.com/virtualblocks/2017/05/04/hpe-synergy-first-composable-infrastructure-now-certified-vsan/

Ø https://www.span.com/product/HPE-D6020-Modular-Disk-System-K2Q28A-19-Rack-5U-SAS-12Gb-JBOD-Enclosure-for-70x-3-5-Drives~58792

Ø https://h22174.www2.hpe.com/SimplifiedConfig/Welcome#


DriveScale HDD Appliance▪ High Performance SAS-Ethernet Bridge

– 1RU appliance w/ dual power supplies– 4 controllers (2 x 10 GE, 2 x 12Gb 4 lane SAS)– 80 Gb throughput

▪ Leverages Ethernet for optimal performance and cost

▪ Multipath redundancy (4 paths from any server to any drive)

▪ Patented traffic balancing algorithms

ToR Switches10 GE

Diskless Servers

DriveScale HDD Appliance

SAS JBOD

Card 4Card 3

Card 2Card1

Node N

Node 1

Controller 1

Controller 2

…

SAS

10GE


ToR Switches100/25/10 GbE

DriveScale NVMe Appliance

Node N

Node 1

X86 Ctrl 1

…

X86 Ctrl 2

DriveScale NVMe Appliance▪ High Performance NVMe Flash System

– 2RU appliance w/ dual x86 controllers– 24 x 2.5” form factor SSD drive bays– 4 x 100Gb ethernet (2 per controller; 200Gb total

throughput)– High availability design (dual power supplies)

▪ Supports iSCSI and RoCEv2 protocols▪ Drives can be sliced and portions attached to

servers▪ Works with single and dual-port drives

– Single port uses interposer card for HA

▪ Commodity pricing for drives (customer provided)

100GE

10/25GE

Diskless Servers


Gene Banman, CEO• CEO: Zero Motorcycles,

NetContinuum• VP/GM Desktops, Sun

Micro• President of Sun Japan

Satya Nishtala, Chief Architect

• Fellow, System Architect: Nuova (Cisco UCS)

• DE, Lead architect: Sun -UltraSPARC workstations and work-group servers, Storage

Tom Lyon, Chief Scientist• Founder: Nuova (Cisco UCS), • Founder: Ipsilon (Nokia)• Emp #8: Sun Micro – SunOS,

SPARC, SunScreen

F O U N D E R S

DriveScale Leadership

Jeff Raice, VP Sales• VP Biz Dev, Natero• Founder, EVP Marketing, Packet Design• Precept Software, Network Computing

Devices, Sun Microsystems, Daisy Systems

Jean-Francois Remy, VP Engineering• 12 year veteran in various industries• Led Technicolor gateway stack redesign • Consumer electronics, Network security• Applied mathematics and Computer Science

Alan Butler, VP Global Alliances & BD• Managing Dir. of Channel Sales, Dell EMC• VP Partner Sales and BD, Astute Networks• Sr. Director, America Sales, Adobe Systems• Sr. Director, Global Sales, Sun Microsystems

Laura Lilyquist, VP of Marketing• Sr. Dir, Product Marketing VMWare• VP of Marketing, LiveHive• Univ. of Wisconsin, BS Applied Math

minor in CS

Brian Pawlowski, CTO• CTO: Net App• VP & Chief Architect: Pure

Storage• BOD: The Linux Foundation


Reseller Partners…


DriveScale Featured in...


● EMAVendortoWatch:DriveSale● CRNEmergingVendors

○ DataCenterStartups● NetworkProductGuideITWorldAwards

○ MostInnovativeITSoftware● NeuralytixDistinguishedInnovatorAward● AmericanBusinessAwards

○ StartupoftheYear● CIOReviewTop20HadoopVendors

Industry Accolades

● TechTarget2016ProductsoftheYear● TechTrailblazerAwards

○ BigDataTrailblazers● TechTrailblazerPersonoftheYear

○ GeneBanman,CEO○ TomLyon,ChiefScientist&Co-founder

● TechTargetModernInfrastructureImpactAwards○ BestSystemsManagement

● DSAAwards○ BestData/StorageNewcomer


Software Composable Infrastructurefor Modern Workloads

Give your data center the agility of thepublic cloud at a fraction of the cost.

41

drivescale - summer 2018 v15sgo.drivescale.com/rs/451-esr-800/images/drivescale... · § improving...

Documents