"building high performance search feature" by setyo legowo (urbanindo)

BuildingHighPerformanceSearchFeatureMobileDevelopmentStageTechinAsiaProductDevelopmentConference2017

August10th,2017

WhoamI?

• SetyoLegowo (@setyolegowo)

• CurrentlyworkasSoftwareEngineerinUrbanindo

• InformaticsgraduatefromInstitut Teknologi Bandung(ITB)

TechinAsia- PDC17,MobileDevStage

Outline

• Whysearchfeaturematter

• Allaboutapplicationperformance

• Performancetesting

• Tipsforoptimizations



Product NameKey / Terms Driver

List of ProductRelevance sites Closest driver


Input

Search result

Challenges

• Use-casesvariation

• Bugs

• Missioncriticalfeature


“3”PerformanceIndicators

Memory


Processor

I/Oo Loadsearchresultand

assetstomemoryo Cachingo Compression

o Queryo Context

o Renderassetso CPUutilizationo Concurrency

Relevance

o Serverresponsetimeo Datausageo Offline

LazyLoad

• Loadorrenderwhatneededtobeappearedonthescreen

• Mostlydelayloadingonassetsimage;pagingsearchresult(occasionally)


Cache(Client)

• Saveassetsintoapplocalstorage,butdonotsaveallofit

• Veryusefulwhenoffline

• “Garbagecollection”strategy• Reusehighfrequencyloadedassets

• Specificcachestrategywhichparallelwithbusiness


Cache(Server)

• UseContentDeliveryNetwork(CDN)• Lowbandwidthand/orCPUusagetoserver

• Cachehighfrequencyqueryanditsresultset• Cachemustbefasterthandatabase

• Easytomaintainifthecachedatabasecomplementwithusecase


Concurrency

• Process/renderin“parallel”

• Pooltheprocessorthethreads• Betterifusethrottlingorqueuemechanism

• ThinktheprocessinDirectedAcyclicGraph



Source:https://upload.wikimedia.org/wikipedia/commons/thumb/4/4b/Directed_acyclic_graph.svg/800px-Directed_acyclic_graph.svg.png

Compression

• Compressassetsasmuchasyoucan

• Minimizestoragespaceusage

• Reducedatatransfercost

• Usebinarydatatransfer insteadofalphabetbase

• Disadvantages:usemoreCPU


SearchResultRelevance

• Usequerylanguage

• Pronetoambiguous

• Advance:Usetextsimilarityalgorithm


Thereareanydrawbacks?

• Architecturetendtobemorecomplex

• Optimizationtendstomakecodehardertounderstandand

maintain

• Overfocusoninsignificantperformanceimprovement


PerformanceTesting

• Definethemetrics(e.g.SLA)andobeytoit

• Applicationprofiling

• Findbottleneckorhotspot


TipsforOptimization(ingeneral)

• Findthebottleneck/hotspotasearlyaspossible

• Follow80/20rules

• Definemetrics• Numberof search,uniquesearch,result,…

• Measuretherightloadbetweenmemory,CPU,andI/O

• Cleancode


TipsforOptimization(searchfeature)

• Progressiveupdate• Rendersearchresulteagerly“only”theappearedcontentorpanel

• Cacheasmuchaspossible

• Abletoruninofflinemode


Anyquestion?


ThankYou


"building high performance search feature" by setyo legowo (urbanindo)

Technology