spc performance report - silverton consultingsilvertonconsulting.com/nwsa/scispc160226-010.pdf ·...
TRANSCRIPT
TWITTER.COM/RAYLUCCHESI|RAYONSTORAGE.COM|GREYBEARDSONSTORAGE.COM|1-720-221-7270|SILVERTONCONSULTING.COM©2016SILVERTONCONSULTING,INC.ALLRIGHTSRESERVED
SPC performance report SilvertonConsulting,Inc.StorInt™DispatchThisStorageIntelligence(StorInt™)dispatchcoversStoragePerformanceCouncil(SPC)results1.Therehavebeenthreenew(andoneupdated)SPC-1/1EandonenewSPC-2submissionssinceourlastreportlastNovember.ThenewSPC-1/1EresultsarefortheDataCoreSANSymphoneyV10,theMacroSANMS5520andtheNECStorageM510andthenewSPC2submissionwasHuaweiOceanStor6800V3.Wehaveamixofallflash,hybridandalldiskstoragesystemsthistime.
SPC-1resultsWebeginourdiscussionwithtoptenSPC-1LRT™(LeastResponseTime)resultsshowninFigure1.
Figure1Top10SPC-1LRTresults
ThenewDataCoreSANSymphonyV10isournew#1withanLRTof80µsec.SANSymphonyinthissubmissionactedasahyperconverged,softwaredefinedstoragesystem,onlywith16SATAattached,SFFSamsung480GBSSDsand815Krpm300GBdiskdrives,withabout419GBofDRAMcache.Evenat100%ofIOworkloadtheirresponsetimewasonly0.32msec.TherearesomeadvantagestousinghyperconvergedsolutionforSPC:1)there’snostoragenetworkyouhavetotraverse,theywereusingainternalloopbackVirtualiSCSIlogical1AllSPCresultsavailablefromhttp://www.storageperformance.org/home/asof26Feb2016
26February2016 SCISPCPERFORMANCEREPORT PAGE2OF6
TWITTER.COM/RAYLUCCHESI|RAYONSTORAGE.COM|GREYBEARDSONSTORAGE.COM|1-720-221-7270|SILVERTONCONSULTING.COM©2015SILVERTONCONSULTING,INC.ALLRIGHTSRESERVED
interfacetothestorageand2)theygettosharethememorywiththeSPCbenchmarkdriver,sooncethedatawasincacheitwasamemorytomemorytransfertoreadorwriteitfrom/tothestoragesystem.WetalkedwithDataCoreonthisSPC-1submissionandtheysaidtheotherthingwhichhelpedthemisenhancedparallelism.Itseemsliketheyhavere-discoveredmulti-thread/multi-corecodedesign.DataCoreseemedtohavecomeofageinhighperformancecomputingenvironmentandwhentheywenttostoragevirtualizationtheyhadtolimittheirmulti-processing/parallelism.Butwithallthecoresintoday’s,offtheshelf,servers,theywereabletoeliminatemost,ifnotalltheselimitationsandtheresultsarewhatyouseeabove.Iamjustnotsurethisisentirelyfairtotheothervendors,manymajor[andminor]vendorsoffersoftwaredefinedstorageoptionsoftheirsystemsandanyofthemcouldhavesubmittedaSPC-1benchmark.ButIwillgiveDataCorecreditforbeingthefirsthereandseewhattheindustryresponselookslikeovertime.Next,weturntooneofSCI’sflashbasedmetrics,toptenSPC-1IOPS/GB-NANDinFigure2.
Figure2SPC-1Top10IOPS™/GB-NAND
26February2016 SCISPCPERFORMANCEREPORT PAGE3OF6
TWITTER.COM/RAYLUCCHESI|RAYONSTORAGE.COM|GREYBEARDSONSTORAGE.COM|1-720-221-7270|SILVERTONCONSULTING.COM©2015SILVERTONCONSULTING,INC.ALLRIGHTSRESERVED
Firstletmeclarify,whenIclaimaSPC-1submissionas“all-SSD”or“all-flash”Iamconsideringanysystemwithmorethan50%ofASUcapacityinSSDsasanall-flashsystem.Yesmanyofthesehavediskdrives(e.g.DataCore)butthevastmajorityoftheircapacityisinflashandIbelieveit’sonlyfairtoplacethemintheallflashbucket.InFigure2,againwecanseetheresultsfromDataCore’ssubmission,whichcameinat#5ontheIOPS/GB-NANDmetric.HistoricallywehaveusedaIOPS/drivemetrictogaugetheefficiencyofdisk-onlystoragesystemsbutwehaveyettosettleononemeasureforflashorhybridbasedsystemsbuthavebeenmigratingtoIOPS/GB-NAND,asNANDiscommoditypricedraw-storageandseemstobeareasonablecounterparttodrivenormalization.WehaveusedSSDsinthepastaswell.Butforsomereasonthischartseemstodisplayamorediverseproductlistfromhigh-endenterprisesolutionsdowntoSMBstorageareallonthistop10.TheotherthingthatarguesforIOPS/GB-NANDvs.IOPS/SSDisthatsomevendorscreatetheirownflashmodulesandassuchhaveanunfairadvantagewhenitcomestoSSDs.ButthedebateisstillonandlastquarterweshowedIOPS/SSDsothisquarterwewentwithIOPS/GB-NAND.ThelastSPC-1chartisthetopten$/IOPSorSPC-1PricePerformanceinFigure3.
26February2016 SCISPCPERFORMANCEREPORT PAGE4OF6
TWITTER.COM/RAYLUCCHESI|RAYONSTORAGE.COM|GREYBEARDSONSTORAGE.COM|1-720-221-7270|SILVERTONCONSULTING.COM©2015SILVERTONCONSULTING,INC.ALLRIGHTSRESERVED
Figure3SPC-1Top$/IOPS
InFigure3,wedisplaySPC-1’sPricePerformancetoptenandDataCoreisournew#1hereaswell.With~460KIOPSandapriceunder$40Ktheywereabletoreach$0.08$/IOPS.Yetagainthere’saslightadvantagetothepricinghereforthesoftwaredefinedstoragesystembuttheydidincludetheLenovahardware,storage,andvarioussoftwarelicenses,soit’shardtofaultthem.ButtheyhadnoneedforHBA/NICsorFClinecardsthatothersystemswouldneedtodostandardstoragebenchmarks.Butevenat$8Kforapairofthem,itwouldn’tmakemuchofadentintheirplacementhere,theymightreachallthewayupto$0.10/IOPS.
26February2016 SCISPCPERFORMANCEREPORT PAGE5OF6
TWITTER.COM/RAYLUCCHESI|RAYONSTORAGE.COM|GREYBEARDSONSTORAGE.COM|1-720-221-7270|SILVERTONCONSULTING.COM©2015SILVERTONCONSULTING,INC.ALLRIGHTSRESERVED
SPC-2resultsInFigure4weshowourSPC-2MBPSspiderorradarchart,whichdepictstheachievementsforthethreeworkloadswhichmakeuptheSPC-2aggregateMBPS.
Figure4Top10SPC-2MBPSresults,spiderchart
ThenewHuaweiOceanStore6800V3camein4thplacewithanimpressiveMBPS42.8GB/sec.TheywouldhavedoneevenbetterwithalittleimprovementintheirVoDworkloadperformance.It’salsoimpressivethattheydidthiswith800diskdrivesratherthanflashthatthe#1used.Thereappearstobeacontinuingmarketforall-disksystemsatleastforbandwidthintensiveworkloads..
SignificanceIt’salwaysgoodtoseenewSPC-1and-2submissions.Wehadagoodmixofflashanddiskonlysystemsthisquarterandoneofthedisk-onlysystemsmadeitintothetopten(forthroughput).DataCore’ssoftwaredefinedstoragerepresentsanewclassofsystemsatleastforSPC-1submissionsanditcameinwithimpressiveeconomicsaswellasresponsetime,anyresponsetimesub0.1msecseemsalmostmagicalinastoragesystem.
(5,000)
15,000
35,000
55,000
75,000HP3PARStoreServ20850
EMCVMAX400K
HPXP7
HuaweiOceanStor6800v3
Kaminario K2
OracleZFSStorageZS4-4Appliance
OracleZFSStorageZS3-4
OracleZFSStorageZS3-2appliance
FujitsuETERNUSDX8700S2
IBMDS8870
Top10SPC-2*SubsystemMB/sforworkloadsasof24Feb2016
LDQMB/s LFPMB/s VODMB/s
26February2016 SCISPCPERFORMANCEREPORT PAGE6OF6
TWITTER.COM/RAYLUCCHESI|RAYONSTORAGE.COM|GREYBEARDSONSTORAGE.COM|1-720-221-7270|SILVERTONCONSULTING.COM©2015SILVERTONCONSULTING,INC.ALLRIGHTSRESERVED
Wearestillplayingwithhowtomeasureflasheffectiveness.ThisquarterweusedIOPS/GB-NANDlastquarterIOPS/SSD.It’sunclearwhichisthesuperiormetricbuthopefullysomedaywewillreachclarityonthis.Asalways,suggestionsonhowtoimproveanyofourperformanceanalysesarewelcomed.Additionally,ifyouareinterestedinmoreblockstorageperformanceinformation,checkoutourrecentlyupdated(February,2016),SANStorageBuyingGuideavailableforpurchasefromourwebsite2.IntheBuyingGuidewenowprovidetop30resultsforsomeofourSPCperformancechartsandnew,SCIderived,OLTP,ThroughputandEmailChampionsCharts™forenterprise,all-flash,mid-rangeandSMBclassSANstoragesystems.
Silverton Consulting, Inc., is a U.S.-based Storage, Strategy & Systems consulting firm offering products and services to the data storage community
SANStorageBuyingGuideURLinQRcodeNewslettersignupURLinQRcode)
2Availableathttp://silvertonconsulting.com/cms1/products/san-storage-briefing/