ecommerce performance: what is it costing you, and what can you do about it? appdynamics
DESCRIPTION
TRANSCRIPT
eCommerce Performance
What is it costing you, and what can you do about it?
Peter HolditchTechnologist
The Business Impact of One Second
“One second increase in Amazon’s page load would annually cost $1.6 billion in sales”
Borland Research - March 2013
3
Because a 1 second delay equates to…
11% fewer page views
A 16% decrease in customer satisfaction
A 7% loss in conversions
4
Google and Microsoft research
• Experiments to introduce delay into web searches to measure the impact
http://velocityconf.com/velocity2009/public/schedule/detail/8523http://vimeo.com/5310021
Server Delays Experiment: Results
• Strong negative impacts• Roughly linear changes with increasing delay• Time to Click changed by roughly double the delay
50ms - - - - - -200ms - - - -0.3% -0.4% 500500ms - -0.6% -1.2% -1.0% -0.9% 12001000ms -0.7% -0.9% -2.8% -1.9% -1.6% 19002000ms -1.8% -2.1% -4.3% -4.4% -3.8% 3100
- Means no statistically significant change
6
Impact measured by
• Slower performance abandoned searches• More active users more sensitive to this• Effect got worse over time, and persisted once
performance was restored
da
ily
se
arc
he
s p
er
us
er
rela
tiv
e t
o c
on
tro
l
w k1 w k2 w k3 w k4 w k5 w k6
-1%
-0.8
%-0
.6%
-0.4
%-0
.2%
0%
0.2
%
2 0 0 m s d e la y4 0 0 m s d e la y
a c tua ltre nd
Im p a c t o f P o s t-he a d e r D e la ys O ve r Tim e
da
ily
se
arc
he
s p
er
us
er
rela
tiv
e t
o c
on
tro
l
w k3 w k4 w k5 w k6 w k7 w k8 w k9 w k1 0 w k1 1
-1%
-0.8
%-0
.6%
-0.4
%-0
.2%
0%
0.2
%
de
lay
rem
ov
ed
P e rs is te nt Im p a c t o f P o s t-he a d e r D e la y
2 0 0 m s d e la y4 0 0 m s d e la y
a c tua ltre nd
7
Conclusion
• Revenue is a function of user behaviour• User behaviour is quite sensitive to performance• Effects of poor performance outlast the problems
• It is necessary to have a constant watch on performance of critical transactions, fix problems quickly and continuously improve over time
8
BIG DATA
HadoopCassandraMongoDB
Coherence
Memcached
CLOUD
Amazon EC2Windows Azure
VMWare
This is made very hard by the modern technology landscape
DistributedMonolithic
LoginSearch Flight
View Flight StatusMake Reservation
Weblogic Oracle
.NET
MQ
ATG, Vignette,Sharepoint
SQL Server
JBoss
Tomcat
Tomcat
Mule, Tibco, AG
ESB
.NET
Tomcat
SOA
WEB 2.0
Browser LogicAJAXWeb Frameworks
Release 3.4Release 3.5Release 3.6Release 4.0
AGILE
Release 1.1Release 1.2Release 1.23Release 1.5
Release 4.4Release 4.5Release 4.6Release 5.0
Release 2.4Release 2.5Release 2.6Release 3.0
Release 1.4Release 1.5Release 1.6Release 2.0
Release 1.4Release 1.5Release 1.6Release 2.0
9
BIG DATA
HadoopCassandraMongoDB
Coherence
Memcached
CLOUD
Amazon EC2Windows Azure
VMWare
Where and what is the problem?
Weblogic Oracle
.NET
MQ
ATG, Vignette,Sharepoint
SQL Server
JBoss
Tomcat
Tomcat
Mule, Tibco, AG
ESB
.NET
Tomcat
SOA
WEB 2.0
Browser LogicAJAXWeb Frameworks
Release 3.4Release 3.5Release 3.6Release 4.0
AGILE
Release 1.1Release 1.2Release 1.23Release 1.5
Release 4.4Release 4.5Release 4.6Release 5.0
Release 2.4Release 2.5Release 2.6Release 3.0
Release 1.4Release 1.5Release 1.6Release 2.0
Release 1.4Release 1.5Release 1.6Release 2.0
LoginSearch Flight
View Flight StatusMake Reservation
10
BIG DATA
HadoopCassandraMongoDB
Coherence
Memcached
CLOUD
Amazon EC2Windows Azure
VMWare
Where and what is the problem?
Weblogic Oracle
.NET
MQ
ATG, Vignette,Sharepoint
SQL Server
JBoss
Tomcat
Tomcat
Mule, Tibco, AG
ESB
.NET
Tomcat
SOA
WEB 2.0
Browser LogicAJAXWeb Frameworks
Release 3.4Release 3.5Release 3.6Release 4.0
AGILE
Release 1.1Release 1.2Release 1.23Release 1.5
Release 4.4Release 4.5Release 4.6Release 5.0
Release 2.4Release 2.5Release 2.6Release 3.0
Release 1.4Release 1.5Release 1.6Release 2.0
Release 1.4Release 1.5Release 1.6Release 2.0
LoginSearch Flight
View Flight StatusMake Reservation
11
BIG DATA
HadoopCassandraMongoDB
Coherence
Memcached
CLOUD
Amazon EC2Windows Azure
VMWare
What if the problem is outside the application?
Weblogic Oracle
.NET
MQ
ATG, Vignette,Sharepoint
SQL Server
JBoss
Tomcat
Tomcat
Mule, Tibco, AG
ESB
.NET
Tomcat
SOA
LoginSearch Flight
View Flight StatusMake Reservation
WEB 2.0
Browser LogicAJAXWeb Frameworks
Release 3.4Release 3.5Release 3.6Release 4.0
AGILE
Release 1.1Release 1.2Release 1.23Release 1.5
Release 4.4Release 4.5Release 4.6Release 5.0
Release 2.4Release 2.5Release 2.6Release 3.0
Release 1.4Release 1.5Release 1.6Release 2.0
Release 1.4Release 1.5Release 1.6Release 2.0
Real-User Monitoring gets Real Results*
12
>10% decrease in end-user complaints
>30% increase in App Availability
>91% transactioncompletion
End-users ‘completely satisfied’
19%
4%
22%
10%
27%
18%
14%
2%
Bus
ines
ses
doin
g R
eal U
ser
Mon
itorin
gB
usinesses NO
T doing R
eal User
Monitoring
*Sou
rce:
Abe
rdee
n G
roup
, Jul
y 20
12
13
BIG DATA
HadoopCassandraMongoDB
Coherence
Memcached
CLOUD
Amazon EC2Windows Azure
VMWare
And beyond performance monitoring…
Weblogic Oracle
.NET
MQ
ATG, Vignette,Sharepoint
SQL Server
JBoss
Tomcat
Tomcat
Mule, Tibco, AG
ESB
.NET
Tomcat
SOA
WEB 2.0
Browser LogicAJAXWeb Frameworks
Release 3.4Release 3.5Release 3.6Release 4.0
AGILE
Release 1.1Release 1.2Release 1.23Release 1.5
Release 4.4Release 4.5Release 4.6Release 5.0
Release 2.4Release 2.5Release 2.6Release 3.0
Release 1.4Release 1.5Release 1.6Release 2.0
Release 1.4Release 1.5Release 1.6Release 2.0
LoginSearch Flight
View Flight StatusMake Reservation
14
Case Study – One Year
Dev QA Ops Business
ProductionPre-Production
• Agile Releases 12 > 18• Spent 3,060 hours less firefighting • Delivered More Innovation
• Identify & Fix Defect 20 hours > 13 hours• Spent 4,024 hours less testing• Faster Time to Market
• Availability 99.91% > 99.95%• MTTR 40 hours > 22 hours• 1,528 hours less troubleshooting
• End User Experience 500ms > 150ms• $167,475 lost revenue savings• $627,691 productivity savings• $795,166 Total savings
15
Want to learn more?
Visit the AppDynamics BoothNear the eCommerce Theatre and Mobile & Social Media World Theatre
Download free monitoring solution: Bit.ly/IWLite
Follow @AppDynamics
