spc performance report - silverton consultingsilvertonconsulting.com/nwsa/scispc160226-010.pdf ·...

6
TWITTER.COM/RAYLUCCHESI|RAYONSTORAGE.COM|GREYBEARDSONSTORAGE.COM|1-720-221-7270|SILVERTONCONSULTING.COM © 2016 SILVERTON CONSULTING, INC. ALL RIGHTS RESERVED SPC performance report Silverton Consulting, Inc. StorInt™ Dispatch This Storage Intelligence (StorInt™) dispatch covers Storage Performance Council (SPC) results 1 . There have been three new (and one updated) SPC-1/1E and one new SPC-2 submissions since our last report last November. The new SPC-1/1E results are for the DataCore SANSymphoney V10, the MacroSAN MS5520 and the NEC Storage M510 and the new SPC2 submission was Huawei OceanStor 6800 V3. We have a mix of all flash, hybrid and all disk storage systems this time. SPC-1 results We begin our discussion with top ten SPC-1 LRT™ (Least Response Time) results shown in Figure 1. Figure 1 Top 10 SPC-1 LRT results The new DataCore SANSymphony V10 is our new #1 with an LRT of 80μsec. SANSymphony in this submission acted as a hyper converged, software defined storage system, only with 16 SATA attached, SFF Samsung 480GB SSDs and 8 15Krpm 300GB disk drives, with about 419GB of DRAM cache. Even at 100% of IO workload their response time was only 0.32msec. There are some advantages to using hyper converged solution for SPC: 1) there’s no storage network you have to traverse, they were using a internal loop back Virtual iSCSI logical 1 All SPC results available from http://www.storageperformance.org/home/ as of 26Feb2016

Upload: vuthien

Post on 10-Apr-2018

224 views

Category:

Documents


7 download

TRANSCRIPT

Page 1: SPC performance report - Silverton Consultingsilvertonconsulting.com/nwsa/SCISPC160226-010.pdf · SPC performance report ... there’s a slight advantage to the pricing here for the

TWITTER.COM/RAYLUCCHESI|RAYONSTORAGE.COM|GREYBEARDSONSTORAGE.COM|1-720-221-7270|SILVERTONCONSULTING.COM©2016SILVERTONCONSULTING,INC.ALLRIGHTSRESERVED

SPC performance report SilvertonConsulting,Inc.StorInt™DispatchThisStorageIntelligence(StorInt™)dispatchcoversStoragePerformanceCouncil(SPC)results1.Therehavebeenthreenew(andoneupdated)SPC-1/1EandonenewSPC-2submissionssinceourlastreportlastNovember.ThenewSPC-1/1EresultsarefortheDataCoreSANSymphoneyV10,theMacroSANMS5520andtheNECStorageM510andthenewSPC2submissionwasHuaweiOceanStor6800V3.Wehaveamixofallflash,hybridandalldiskstoragesystemsthistime.

SPC-1resultsWebeginourdiscussionwithtoptenSPC-1LRT™(LeastResponseTime)resultsshowninFigure1.

Figure1Top10SPC-1LRTresults

ThenewDataCoreSANSymphonyV10isournew#1withanLRTof80µsec.SANSymphonyinthissubmissionactedasahyperconverged,softwaredefinedstoragesystem,onlywith16SATAattached,SFFSamsung480GBSSDsand815Krpm300GBdiskdrives,withabout419GBofDRAMcache.Evenat100%ofIOworkloadtheirresponsetimewasonly0.32msec.TherearesomeadvantagestousinghyperconvergedsolutionforSPC:1)there’snostoragenetworkyouhavetotraverse,theywereusingainternalloopbackVirtualiSCSIlogical1AllSPCresultsavailablefromhttp://www.storageperformance.org/home/asof26Feb2016

Page 2: SPC performance report - Silverton Consultingsilvertonconsulting.com/nwsa/SCISPC160226-010.pdf · SPC performance report ... there’s a slight advantage to the pricing here for the

26February2016 SCISPCPERFORMANCEREPORT PAGE2OF6

TWITTER.COM/RAYLUCCHESI|RAYONSTORAGE.COM|GREYBEARDSONSTORAGE.COM|1-720-221-7270|SILVERTONCONSULTING.COM©2015SILVERTONCONSULTING,INC.ALLRIGHTSRESERVED

interfacetothestorageand2)theygettosharethememorywiththeSPCbenchmarkdriver,sooncethedatawasincacheitwasamemorytomemorytransfertoreadorwriteitfrom/tothestoragesystem.WetalkedwithDataCoreonthisSPC-1submissionandtheysaidtheotherthingwhichhelpedthemisenhancedparallelism.Itseemsliketheyhavere-discoveredmulti-thread/multi-corecodedesign.DataCoreseemedtohavecomeofageinhighperformancecomputingenvironmentandwhentheywenttostoragevirtualizationtheyhadtolimittheirmulti-processing/parallelism.Butwithallthecoresintoday’s,offtheshelf,servers,theywereabletoeliminatemost,ifnotalltheselimitationsandtheresultsarewhatyouseeabove.Iamjustnotsurethisisentirelyfairtotheothervendors,manymajor[andminor]vendorsoffersoftwaredefinedstorageoptionsoftheirsystemsandanyofthemcouldhavesubmittedaSPC-1benchmark.ButIwillgiveDataCorecreditforbeingthefirsthereandseewhattheindustryresponselookslikeovertime.Next,weturntooneofSCI’sflashbasedmetrics,toptenSPC-1IOPS/GB-NANDinFigure2.

Figure2SPC-1Top10IOPS™/GB-NAND

Page 3: SPC performance report - Silverton Consultingsilvertonconsulting.com/nwsa/SCISPC160226-010.pdf · SPC performance report ... there’s a slight advantage to the pricing here for the

26February2016 SCISPCPERFORMANCEREPORT PAGE3OF6

TWITTER.COM/RAYLUCCHESI|RAYONSTORAGE.COM|GREYBEARDSONSTORAGE.COM|1-720-221-7270|SILVERTONCONSULTING.COM©2015SILVERTONCONSULTING,INC.ALLRIGHTSRESERVED

Firstletmeclarify,whenIclaimaSPC-1submissionas“all-SSD”or“all-flash”Iamconsideringanysystemwithmorethan50%ofASUcapacityinSSDsasanall-flashsystem.Yesmanyofthesehavediskdrives(e.g.DataCore)butthevastmajorityoftheircapacityisinflashandIbelieveit’sonlyfairtoplacethemintheallflashbucket.InFigure2,againwecanseetheresultsfromDataCore’ssubmission,whichcameinat#5ontheIOPS/GB-NANDmetric.HistoricallywehaveusedaIOPS/drivemetrictogaugetheefficiencyofdisk-onlystoragesystemsbutwehaveyettosettleononemeasureforflashorhybridbasedsystemsbuthavebeenmigratingtoIOPS/GB-NAND,asNANDiscommoditypricedraw-storageandseemstobeareasonablecounterparttodrivenormalization.WehaveusedSSDsinthepastaswell.Butforsomereasonthischartseemstodisplayamorediverseproductlistfromhigh-endenterprisesolutionsdowntoSMBstorageareallonthistop10.TheotherthingthatarguesforIOPS/GB-NANDvs.IOPS/SSDisthatsomevendorscreatetheirownflashmodulesandassuchhaveanunfairadvantagewhenitcomestoSSDs.ButthedebateisstillonandlastquarterweshowedIOPS/SSDsothisquarterwewentwithIOPS/GB-NAND.ThelastSPC-1chartisthetopten$/IOPSorSPC-1PricePerformanceinFigure3.

Page 4: SPC performance report - Silverton Consultingsilvertonconsulting.com/nwsa/SCISPC160226-010.pdf · SPC performance report ... there’s a slight advantage to the pricing here for the

26February2016 SCISPCPERFORMANCEREPORT PAGE4OF6

TWITTER.COM/RAYLUCCHESI|RAYONSTORAGE.COM|GREYBEARDSONSTORAGE.COM|1-720-221-7270|SILVERTONCONSULTING.COM©2015SILVERTONCONSULTING,INC.ALLRIGHTSRESERVED

Figure3SPC-1Top$/IOPS

InFigure3,wedisplaySPC-1’sPricePerformancetoptenandDataCoreisournew#1hereaswell.With~460KIOPSandapriceunder$40Ktheywereabletoreach$0.08$/IOPS.Yetagainthere’saslightadvantagetothepricinghereforthesoftwaredefinedstoragesystembuttheydidincludetheLenovahardware,storage,andvarioussoftwarelicenses,soit’shardtofaultthem.ButtheyhadnoneedforHBA/NICsorFClinecardsthatothersystemswouldneedtodostandardstoragebenchmarks.Butevenat$8Kforapairofthem,itwouldn’tmakemuchofadentintheirplacementhere,theymightreachallthewayupto$0.10/IOPS.

Page 5: SPC performance report - Silverton Consultingsilvertonconsulting.com/nwsa/SCISPC160226-010.pdf · SPC performance report ... there’s a slight advantage to the pricing here for the

26February2016 SCISPCPERFORMANCEREPORT PAGE5OF6

TWITTER.COM/RAYLUCCHESI|RAYONSTORAGE.COM|GREYBEARDSONSTORAGE.COM|1-720-221-7270|SILVERTONCONSULTING.COM©2015SILVERTONCONSULTING,INC.ALLRIGHTSRESERVED

SPC-2resultsInFigure4weshowourSPC-2MBPSspiderorradarchart,whichdepictstheachievementsforthethreeworkloadswhichmakeuptheSPC-2aggregateMBPS.

Figure4Top10SPC-2MBPSresults,spiderchart

ThenewHuaweiOceanStore6800V3camein4thplacewithanimpressiveMBPS42.8GB/sec.TheywouldhavedoneevenbetterwithalittleimprovementintheirVoDworkloadperformance.It’salsoimpressivethattheydidthiswith800diskdrivesratherthanflashthatthe#1&#2used.Thereappearstobeacontinuingmarketforall-disksystemsatleastforbandwidthintensiveworkloads..

SignificanceIt’salwaysgoodtoseenewSPC-1and-2submissions.Wehadagoodmixofflashanddiskonlysystemsthisquarterandoneofthedisk-onlysystemsmadeitintothetopten(forthroughput).DataCore’ssoftwaredefinedstoragerepresentsanewclassofsystemsatleastforSPC-1submissionsanditcameinwithimpressiveeconomicsaswellasresponsetime,anyresponsetimesub0.1msecseemsalmostmagicalinastoragesystem.

(5,000)

15,000

35,000

55,000

75,000HP3PARStoreServ20850

EMCVMAX400K

HPXP7

HuaweiOceanStor6800v3

Kaminario K2

OracleZFSStorageZS4-4Appliance

OracleZFSStorageZS3-4

OracleZFSStorageZS3-2appliance

FujitsuETERNUSDX8700S2

IBMDS8870

Top10SPC-2*SubsystemMB/sforworkloadsasof24Feb2016

LDQMB/s LFPMB/s VODMB/s

Page 6: SPC performance report - Silverton Consultingsilvertonconsulting.com/nwsa/SCISPC160226-010.pdf · SPC performance report ... there’s a slight advantage to the pricing here for the

26February2016 SCISPCPERFORMANCEREPORT PAGE6OF6

TWITTER.COM/RAYLUCCHESI|RAYONSTORAGE.COM|GREYBEARDSONSTORAGE.COM|1-720-221-7270|SILVERTONCONSULTING.COM©2015SILVERTONCONSULTING,INC.ALLRIGHTSRESERVED

Wearestillplayingwithhowtomeasureflasheffectiveness.ThisquarterweusedIOPS/GB-NANDlastquarterIOPS/SSD.It’sunclearwhichisthesuperiormetricbuthopefullysomedaywewillreachclarityonthis.Asalways,suggestionsonhowtoimproveanyofourperformanceanalysesarewelcomed.Additionally,ifyouareinterestedinmoreblockstorageperformanceinformation,checkoutourrecentlyupdated(February,2016),SANStorageBuyingGuideavailableforpurchasefromourwebsite2.IntheBuyingGuidewenowprovidetop30resultsforsomeofourSPCperformancechartsandnew,SCIderived,OLTP,ThroughputandEmailChampionsCharts™forenterprise,all-flash,mid-rangeandSMBclassSANstoragesystems.

Silverton Consulting, Inc., is a U.S.-based Storage, Strategy & Systems consulting firm offering products and services to the data storage community

SANStorageBuyingGuideURLinQRcodeNewslettersignupURLinQRcode)

2Availableathttp://silvertonconsulting.com/cms1/products/san-storage-briefing/