ebay: transactions on a massive scale
Post on 08-May-2015
664 Views
Preview:
TRANSCRIPT
1
eBay: Transactions on a Massive ScaleChristian Rohrer
UIE Web Application Summit
2 eBay Inc. confidential
© 2007 eBay Inc. All rights reserved.
No part of these materials may be reproduced or transmitted in any form, by any means (electronic, photocopying, recording, or otherwise) without the prior permission of eBay Inc.
eBay and the eBay logo are registered trademarks of eBay Inc.
PayPal and the PayPal logo are registered trademarks of PayPal, Inc.
Other trademarks and brands are the property of their respective owners.
Please do not take our picture or record the class without asking permission.
2
3 eBay Inc. confidential
• Introduction to eBay and current status• History
– Single interface for many types of items – Why?No product catalogFlexibilityCost savings (storage)
– June 1999 24-hour crash => 99.9999 uptime– Global platform – pros and cons (Europe, Asia diffs)
• Implications for web application design – Seven step process for making any changes to the site– Well-defined product development process– Lead to page-by-page engineering versus overall experience design
Checkout: eBay – PayPal flow
• NPV method of evaluating projects– SYI 2.0 -> 3.0: strong ROI, but compared to what?– SYI 3.0 Motors worse than 2.0
• The emergence of “TSEs”– Motors– Express and Half– Kijiji & Craigslist
• What about RIA?
4 eBay Inc. confidential
eBay – In the beginning…
• Pierre Omidyar on Labor Day Weekend, 1995
• Simple interface (the same for any type of item)
• No product catalog
• Basic principle: people would do the right thing (pay total strangers)
• Final Value Fees – needed to pay ISP bill
• Feedback: among the web’s first reputation systems
• Met some core user need: Rapid growth
3
5 eBay Inc. confidential
• A vehicle sells every minute
• A motors part or accessory sells every second
• A diamond ring sells every 2 minutes
• Approximately 1.3 million sellers around the
world use eBay as a primary or secondary
source of income.*
eBay Today
On an average day on eBay…
eBay users trade about $1,640 worth of goods on the site every second.
* (Source: ACNielsen International Research, June 2006)
6 eBay Inc. confidential
Q1Q2Q3Q4Q1Q2Q3Q4Q1Q2Q3Q4Q1Q2Q3Q4Q1Q2Q3Q4Q1Q2Q3Q4Q1Q2Q3Q4Q1Q2Q3Q4Q1Q2
eBay’s growth has been amazing
203MillionUsers
1999 2000 2001 2002 20031998 2004 2005
596Million
Listings*
2006
• eBay has a global presence in 33 markets.
• eBay has 203 million registered users worldwide, with 90 million users in the U.S. and 113 million users in eBay’s international markets.
• If eBay were a country, it would be the fifth most populous country in the world behind China, India, the U.S. and Indonesia. (Source: U.S. Census Bureau, International Data Base, April 2005)
• Approximately 1.3 million sellers around the world use eBay as a primary or secondary source of income.
* As of Q2-2006. (Source: ACNielsen International Research, June 2006)
4
7 eBay Inc. confidential
Site Statistics: in a typical day…
NA91 M0API Calls
59x16 Gbps268 Mbps
Peak Network Utilization
50x99.94%~97%Availability
16x874 M54 MTotal Page Views
35x35 M1 MOutbound Emails
GrowthDecember2005
June1999
8 eBay Inc. confidential
1999 Outage
• Site down 22 hours on June 10,1999
• Estimated $3-5 M lost in revenue
• Stock price affected
• Dominated corporate priorities thereafter
• Significant impact on – Engineering investment– Engineering Mgmt– Hardware investment– Software development
process
• Nearly perfect uptimebecame a top priority
5
9 eBay Inc. confidential
eBay Methods and Processes
• eBay Product Approval (7 steps)
• Success Metrics for a UX Organization
• Delivering Experiences – how all the pieces fit together (or don’t)– Designing Experiences Page by Page– Designing Experiences Holistically
10 eBay Inc. confidential
Summary of Project Approval Process
1. Understand the project approval steps.2. Know the levers that drive your business.3. Proactively research UX issues.4. Select a product area to improve.5. Estimate the ROI.6. Present proposal on equal footing.7. Follow up after the project launches --
quantify results and inform future project decisions.
6
11 eBay Inc. confidential
Who approves projects?
What criteria do they use to approve projects?
At eBay:• Submission open
Anyone (designer, researcher, business analyst, product manager) can make a project proposal
• Senior staff approves projectsApproval is comprehensive
• Criteria for approval is standard and objectiveBased on return on investment (ROI), short- and long-term goals
1. Understand Project Approval Procedures
12 eBay Inc. confidential
2. Know Levers That Drive Your Business
At eBay, business levers include:• Registered users• Bids• Listings
Know the value of those levers:• Example: “What’s the monetary value to eBay of each
registered user?”
Know how the UX can affect those levers:• Example: “Improving the registration user experience will
increase the % of users who complete the registration process”
7
13 eBay Inc. confidential
3. Proactively Research UX Issues with Your Current Product
Inform project proposals and design directions through:
• Heuristic analysis and best practices • Customer support contacts• Site usage statistics• Baseline usability studies• Field studies, surveys, focus groups
14 eBay Inc. confidential
4. Select a Product Area to Improve
Select a specific product area where:• Business benefits will be significant, measurable,
and attributed back to your project• Cost and risks will be relatively low• Business benefits are expected to be high• Chances of success are expected to be high
8
15 eBay Inc. confidential
5. Estimate the ROI for Your Project
Estimate the cost• How much does it cost to build and maintain?
Estimate the benefit:• Identify business levers your project will affect• Understand the current user experience• Use the impact of previous projects as a
relative gauge• Be conservative
16 eBay Inc. confidential
6. Present proposal on equal footing
Justify project according to standard criteria (ROI).
• Don’t position your project as “special” or different.
Justify results, not process.• The ends (e.g. increase % of users who complete registration) will
justify the means.
Know your audience.• Speak to their issues and speak their language.
9
17 eBay Inc. confidential
7. Follow up after the project launches
Quantify results.• Determine incremental benefit of the project
Communicate those results within the company.• Project success can create a virtuous cycle.
Initiative
Increased investmentMore resources (people, finances, and time for new initiatives).
Success
Responsibility
18 eBay Inc. confidential
Example: Consistent Pagination (Before)
10
19 eBay Inc. confidential
Example: Consistent Pagination (NPV)
Identify the levers:• Increased bids• Reduced development costs
Estimate the benefit:• Determine number of bids for items listed beyond
page 10 as a percentage of all bids• Estimate increase in bids due to this project• Estimate cost savings for future development
20 eBay Inc. confidential
Example: Consistent Pagination (After)
11
21 eBay Inc. confidential
View Item (Before)
22 eBay Inc. confidential
View Item (After)
Contextual:When the user has been outbid, provide the bid box
12
23 eBay Inc. confidential
Page by Page Experience Across Sites: Checkout
• This experience problem stems from analyzing user experiences page by page, rather than thinking about the lifecycle or the experience through a flow.– Issues: consistency, iconography, number of steps
• This can happen when you have a hugely successful website (millions of emails and billions of PVs)– It can be hard to think systematically that far ahead
24 eBay Inc. confidential
PayPal Guest User Flow
1
7
6
54
3
2 • Header change• Logo change• Inconsistent style• Repetitive information
13
25 eBay Inc. confidential
PayPal Registered User Flow1
7
6
54
3
2• Header change• Logo change• Inconsistent style• Repetitive information
26 eBay Inc. confidential
Page by Page: SYI 2.0 to 3.0
Evolution of “Sell Your Item” (SYI) linear flow
• Sell Your Item 1.0: 1 pager
• Sell Your Item 2.0: Multiple pages for more feature selection
• Sell Your Item 3.0: Fewer pages, better content, better help, and better design
14
27 eBay Inc. confidential
Evolution of the Sell Hub
User Research in 2004 showed us…
• No clear call to action for starting the selling process
• Not clear what to type in text field• Design is very category focused
User Research in 2006 showed us…
• Clear call to action as to how to begin selling
• Participants knew what to type and where• Decreased emphasis on Category
28 eBay Inc. confidential
Evolution of the Category Selector
• Found selecting a category very easy and straightforward
• No difficulty adding a second category
• Difficulty figuring out how to select a second category
• Feared they would overwrite the first category selection
User Research in 2004 showed us…
User Research in 2006 showed us…
15
29 eBay Inc. confidential
Evolution of the Customization of SYI
• Made the layer look more like a window• Made the layer draggable like a window• Exposed most of the options by default • Plus icon removed
• Plus icon confusing• Pop-up layer cumbersome, not movable,
blocked view
User Research in 2004 showed us…
User Research in 2006 showed us…
30 eBay Inc. confidential
SYI 3.0 Research
7 User Experience Research methods were utilized to address the main questions:
Lab tests (Steve)
RITE Test: Qualitative – Focus on improve the design using prototype and iterative rapid test.
Visits: Qualitative – The big picture in a natural environment, the “why”, the “aha’s”, the things we may not otherwise see in lab or via survey
Longitudinal: Quantitative and qualitative – Identify how pervasive the issues are, ability to compare across designs, by user segment, and over time. Objective and subjective measures.
Public Opt-in: Quantitative and qualitative – Can track feature usage and compare to past usage, collect open-ended feedback, and the “opt-in” nature leaves Community with a sense of Voice regarding the design.
Public Opt-In(5/06)
LongitudinalKeynote Study (2/05)
Visits(1/05)
11 Rounds of RITE Lab Tests (6/04-3/05)
Post-Launch Usability Study (5/06)
Usability Study(11/05)
Usability Study: Qualitative – Controlled environment allows quickly identify usability issues and causes of those issues.
Surveys(12/05-8/06)
Survey: Quantitative, can track user attitudes, preferences, feature usage, and collect open-ended feedback
Usability Study: Qualitative – quickly get the holistic view of the product post-launch. Help identify additional issues.
16
31 eBay Inc. confidential
SYI 2.0
32 eBay Inc. confidential
SYI 3.0
17
33 eBay Inc. confidential
SYI 3.0: Business Results
• Both first time sellers and experiences sellers had higher completion rates
• Both were also quite a bit faster
• Feature revenue also increased
• Return on investment in UX was worth it
• Note: eBay Motors SYI customization
34 eBay Inc. confidential
18
35 eBay Inc. confidential
36 eBay Inc. confidential
19
37 eBay Inc. confidential
38 eBay Inc. confidential
20
39 eBay Inc. confidential
40 eBay Inc. confidential
21
41 eBay Inc. confidential
42 eBay Inc. confidential
22
43 eBay Inc. confidential
TSEs allow eBay to design experiences holistically
•Motors
•Kijiji
•eBay Express
44 eBay Inc. confidential
23
45 eBay Inc. confidential
46 eBay Inc. confidential
Kijiji has demonstrated strong consumer traction
0
1
2
3
4
5
6
7
8
9
10
Mar
-05
Apr-05
May
-05
Jun-
05
Jul-0
5
Aug-
05
Sep-
05
Oct
-05
Nov
-05
Dec
-05
Jan-
06
Feb-
06
Mar
-06
Apr-06
May
-06
Jun-
06
Jul-0
6
Aug-
06
CanadaKoreaIndiaTaiwanJapanChinaItalySwitzerlandAustriaFranceGermany
Kijiji Unique Visitors
• During its first 18 months, Kijiji has grown quickly
8.7 Million
24
47 eBay Inc. confidential
Kijiji: Global consumer research indicates strong consumer appeal
“I at first visited other website, like Yahoo, but later, I shift to Kijiji. In Kijiji, it’s easy to operate, you just simply post information there.”
Taiwan
“It’s safe, people are friendly, you just go to their home and buy it.”
China
“This site is quite simple to operate –easy and convenient”
Canada
“This site is clearly laid out – it is easy to start straight away”
Germany
Right from the startyou feel
that it’s easy and open to all
France
Simplicity and ease of use are
meaningful benefits globally that consumers appreciate and
value
48 eBay Inc. confidential
25
49 eBay Inc. confidential
50 eBay Inc. confidential
26
51 eBay Inc. confidential
Desirability
Elements of a User Experience
It starts by being useful…
Functionally, people mustbe able to use it…
The way it looks mustbe pleasing…
This helps createan overall brand experience
Executing well on all of these areas is what creates a great user experience. Research is needed for each.
Usability
UtilityIt is useful
to me.It meets
my needs.
Marketingcampaigns
Brand experience
52 eBay Inc. confidential
The Roles of the User Experience Team
27
53 eBay Inc. confidential
UED at eBay: Guiding Principles
User Experience & Design (UED) collaborates across the organization to design high quality user experiences.
Support - UED designs the user experience that supports the vision and goals of the eBay brand, the business units, the functions and the company at large
Educate - UED promotes the value of a great user experience across all organizations within the company
Champion - UED leads the definition of the user experience, champions the eBay user and drives ease of use initiatives
Influence - UED shares insights which shape business strategies
top related