growing the business on the mainframe. - tpfug · 2019-04-10 · growing the business on the...

25
Growing the Business on the Mainframe. Misha Kravchenko - Marriott VP Mainframe Delivery David Morley - Marriott z/TPF Technical Architect TPF User Group – Denver 2019 Keynote Session 1

Upload: others

Post on 24-May-2020

2 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Growing the Business on the Mainframe. - TPFUG · 2019-04-10 · Growing the Business on the Mainframe. Misha Kravchenko - Marriott VP Mainframe Delivery ... •The MongoDB on z initiative

Growing the Business on the Mainframe.

Misha Kravchenko - MarriottVP Mainframe Delivery

David Morley - Marriottz/TPF Technical Architect

TPF User Group – Denver 2019Keynote Session

1

Page 2: Growing the Business on the Mainframe. - TPFUG · 2019-04-10 · Growing the Business on the Mainframe. Misha Kravchenko - Marriott VP Mainframe Delivery ... •The MongoDB on z initiative

AGENDA

Marriott• Starwood Merger• z/Story at Marriott – High Level Architecture Overview

Why MongoDB?• Shopping and other demands on our system• Create a Team – Partners with products and services

Our POC• And a look into production and beyond

NOTE: Statements of possible direction do not equal any commitments

Q&A encouraged throughout the session.

2

Page 3: Growing the Business on the Mainframe. - TPFUG · 2019-04-10 · Growing the Business on the Mainframe. Misha Kravchenko - Marriott VP Mainframe Delivery ... •The MongoDB on z initiative

AGENDA

Marriott• Starwood Merger• z/Story at Marriott – High Level Architecture Overview

Why MongoDB?• Shopping and other demands on our system• Create a Team – Partners with products and services

Our POC• And a look into production and beyond

NOTE: Statements of possible direction do not equal any commitments

Q&A encouraged throughout the session.

3

Page 4: Growing the Business on the Mainframe. - TPFUG · 2019-04-10 · Growing the Business on the Mainframe. Misha Kravchenko - Marriott VP Mainframe Delivery ... •The MongoDB on z initiative

Pre-Merger MARSHA and Valhalla in 2016

0

1000

2000

3000

4000

5000

6000

MARSHA Valhalla

Properties

MARSHA Valhalla

MARSHA Valhalla

Costs

MARSHA Valhalla

Page 5: Growing the Business on the Mainframe. - TPFUG · 2019-04-10 · Growing the Business on the Mainframe. Misha Kravchenko - Marriott VP Mainframe Delivery ... •The MongoDB on z initiative

Over 6,900 Properties in 130 Countries across 30 brandsStill growing by approximately two properties a day

Page 6: Growing the Business on the Mainframe. - TPFUG · 2019-04-10 · Growing the Business on the Mainframe. Misha Kravchenko - Marriott VP Mainframe Delivery ... •The MongoDB on z initiative

AGENDA

Marriott• Starwood Merger• z/Story at Marriott – High Level Architecture Overview

Why MongoDB?• Shopping and other demands on our system• Create a Team – Partners with products and services

Our POC• And a look into production and beyond

NOTE: Statements of possible direction do not equal any commitments

Q&A encouraged throughout the session.

6

Page 7: Growing the Business on the Mainframe. - TPFUG · 2019-04-10 · Growing the Business on the Mainframe. Misha Kravchenko - Marriott VP Mainframe Delivery ... •The MongoDB on z initiative

High Level z/Story at Marriott

SYSA SYSB SYSR

SYSCCost Avoidance Processor

(CAP) for SASSSI ties z/VM

systems together

10 GB Network

10 GB Network

z/Linux

z/TPF

z/Linux DR

z/OS and z/TPF DR

z/Linux

SAS

z/OS

DR SiteMarriott Datacenter

z14

z13s

z14 z14

DR with 30 minute RTO for all workloadsData Mirroring

z/Linux

7

Page 8: Growing the Business on the Mainframe. - TPFUG · 2019-04-10 · Growing the Business on the Mainframe. Misha Kravchenko - Marriott VP Mainframe Delivery ... •The MongoDB on z initiative

AGENDA

Marriott• Starwood Merger• z/Story at Marriott – High Level Architecture Overview

Why MongoDB?• Shopping and other demands on our system• Create a Team – Partners with products and services

Our POC• And a look into production and beyond

NOTE: Statements of possible direction do not equal any commitments

Q&A encouraged throughout the session.

8

Page 9: Growing the Business on the Mainframe. - TPFUG · 2019-04-10 · Growing the Business on the Mainframe. Misha Kravchenko - Marriott VP Mainframe Delivery ... •The MongoDB on z initiative

Shopping Traffic, Bad Calls, Dynamic Pricing… and the impacts to MARSHA, our reservation system

Best Prices Guaranteed at Marriott.com

• Rate information is collected and cached by whole sale distributors for public consumption.

• All travel and transportation services need to have this type of data available today.

Page 10: Growing the Business on the Mainframe. - TPFUG · 2019-04-10 · Growing the Business on the Mainframe. Misha Kravchenko - Marriott VP Mainframe Delivery ... •The MongoDB on z initiative

Revenue Management (RM) and Shopping Activity

10

Automated Revenue Management facilitates repricing of inventory in near real-time.

Update frequency has gone from once every 3 days to 3 times a day.

For every 4% increase in RM activity we get a ~2.5% increase in shopping activity, mostly from 3rd parties.

RM activity has increased 400% since January 2017.

Page 11: Growing the Business on the Mainframe. - TPFUG · 2019-04-10 · Growing the Business on the Mainframe. Misha Kravchenko - Marriott VP Mainframe Delivery ... •The MongoDB on z initiative

CAIRO?Cached Availability Inventory and Rate Offers

11

Page 12: Growing the Business on the Mainframe. - TPFUG · 2019-04-10 · Growing the Business on the Mainframe. Misha Kravchenko - Marriott VP Mainframe Delivery ... •The MongoDB on z initiative

60/90 Day-cycles

Focus on delivering in smaller chunks.

Summer of Performance (90 days)CAIRO Proof of Concept (60 days)Migrate Starwood onto MARSHA (90 days)CAIRO Deliver Production (90 days)

Keep the team engaged, informed and looking forward.

12

Page 13: Growing the Business on the Mainframe. - TPFUG · 2019-04-10 · Growing the Business on the Mainframe. Misha Kravchenko - Marriott VP Mainframe Delivery ... •The MongoDB on z initiative

Average z/TPF CPU + projections 2015-2020

0

10000

20000

30000

40000

50000

60000

Average MIPS Growth

Redline Actuals Poly. (Actuals)

Improved CPU Efficiency by 35% over 3 months.

Increased the amount of processing by 80% in the next 3 months.

z14-730

z14-744

zEC12-706

MIP

S

13

Page 14: Growing the Business on the Mainframe. - TPFUG · 2019-04-10 · Growing the Business on the Mainframe. Misha Kravchenko - Marriott VP Mainframe Delivery ... •The MongoDB on z initiative

Not Just CPU

System Scaling is more than CPU. Since January 2017:

I/O Rates from 2M per second to 5.5M per second.Memory Footprint from 20GB to 180 GB.Transaction Costs from 3ms to 5msTransaction Lifetime from 10ms to 100ms

The expansion is organic, from mergers and just because...

14

Page 15: Growing the Business on the Mainframe. - TPFUG · 2019-04-10 · Growing the Business on the Mainframe. Misha Kravchenko - Marriott VP Mainframe Delivery ... •The MongoDB on z initiative

Solving for 80/80/80 Use Case

In the universe of possible queries, there is an identifiable subset.

80/20 split are non-member vs member.80/20 split are for single room vs multi-room.80/20 split are short stay (<7 nights) vs long stay.

This subset is a candidate for offload without a “boil the ocean” solution.

15

Page 16: Growing the Business on the Mainframe. - TPFUG · 2019-04-10 · Growing the Business on the Mainframe. Misha Kravchenko - Marriott VP Mainframe Delivery ... •The MongoDB on z initiative

AGENDA

Marriott• Starwood Merger• z/Story at Marriott – High Level Architecture Overview

Why MongoDB?• Shopping and other demands on our system• Create a Team – Partners with products and services

Our POC• And a look into production and beyond

NOTE: Statements of possible direction do not equal any commitments

Q&A encouraged throughout the session.

16

Page 17: Growing the Business on the Mainframe. - TPFUG · 2019-04-10 · Growing the Business on the Mainframe. Misha Kravchenko - Marriott VP Mainframe Delivery ... •The MongoDB on z initiative

The Team Marriott

• Misha Kravchenko – Executive Sponsor

• Mainframe run z/Linux and z/TPF teams

IBM

• IBM helped simplify contracting, organize resources and driving the overall project plan

MongoDB

• The MongoDB on z initiative made it a natural choice for this workload.

• MongoDB Team brought invaluable skills.

Velocity Software

• This team went above and beyond getting MongoDB metrics integrated into zVIEW

• zPRO quickly turns z Systems into the cloud platform mainframe virtualization really created

Sine Nomine Associates

• Extra support for z/VM and Linux on z Systems

• Coding, including education using Node.js, integrating along with packaging (RPM), testing and 24x7 support for the environment. A bridge between all tech and vendors.

Page 18: Growing the Business on the Mainframe. - TPFUG · 2019-04-10 · Growing the Business on the Mainframe. Misha Kravchenko - Marriott VP Mainframe Delivery ... •The MongoDB on z initiative

AGENDA

Marriott• Starwood Merger• z/Story at Marriott – High Level Architecture Overview

Why MongoDB?• Shopping and other demands on our system• Create a Team – Partners with products and services

Our POC• And a look into production and beyond

NOTE: Statements of possible direction do not equal any commitments

Q&A encouraged throughout the session.

18

Page 19: Growing the Business on the Mainframe. - TPFUG · 2019-04-10 · Growing the Business on the Mainframe. Misha Kravchenko - Marriott VP Mainframe Delivery ... •The MongoDB on z initiative

A Universal Software Stack

Not everyone in the team is a mainframe developer.Nor do they have to be.

GITHub repository + other open source tooling.Linux OSMongoDB DatabaseNode.js programming language

Runs on anything from a toaster to a mainframe, #Serverless ready.

19

Page 20: Growing the Business on the Mainframe. - TPFUG · 2019-04-10 · Growing the Business on the Mainframe. Misha Kravchenko - Marriott VP Mainframe Delivery ... •The MongoDB on z initiative

How Shopping Transactions Are Processed Today

5 DatapowerX150 Appliances

MARSHA z/TPF

Internet

• Datapower Appliances validate and transform XML transactions into a standard XML input transaction for MARSHA to processes.

• All shopping, reservation and message validation happens on z/TPF’s General Purpose Processors.

Page 21: Growing the Business on the Mainframe. - TPFUG · 2019-04-10 · Growing the Business on the Mainframe. Misha Kravchenko - Marriott VP Mainframe Delivery ... •The MongoDB on z initiative

How Shopping Transactions Will Be Processed

5 DatapowerX150 Appliances

<HARVESTER>MARSHA z/TPF

Internet

MongoDB x 2

z/Linux

Bonvoy z/OS

• Datapower Appliances remains the ‘end point’ for the service as far as client is concerned.

• Load balance traffic across the 4 new Shopping Engine (SE) to:• Reject bad msgs• Send msg to MongoDB for processing• Send msg to MARSHA for processing

• The Maintenance Engine (ME) processes data from a HARVESTER function built from inside MARSHA that loads it into MongoDB in the format already expected by our consumers.

MongoDB x 1

z/Linux

Page 22: Growing the Business on the Mainframe. - TPFUG · 2019-04-10 · Growing the Business on the Mainframe. Misha Kravchenko - Marriott VP Mainframe Delivery ... •The MongoDB on z initiative

22

The Harvester

When a transaction is received it is added to a list of ‘high volume queries’

Original Transaction is responded to as usual.

List is processed asymmetrically to populate MongoDB.

Processing the list uses an adaptive time-initiated algorithm based on the rate of change.

Target 95% accuracy.

The application code is fully reused to ensure consistent results.

Shared results across multiple partners will produce 80% of the savings.

Efficiencies in the message handling will produce the remainder.

Page 23: Growing the Business on the Mainframe. - TPFUG · 2019-04-10 · Growing the Business on the Mainframe. Misha Kravchenko - Marriott VP Mainframe Delivery ... •The MongoDB on z initiative

4 Core PoC (not a performance comparison)A Cloud Service (ACS) x86 vs. Linux on z

0

2

4

6

8

10

12

0 1000 2000 3000 4000 5000 6000 7000 8000 9000

RES

PO

NSE

TIM

E (M

S)

MESSAGES PER SECOND

ACS Response z/Linux Response 1 MongoDB instance on z can handle our required load creating easy failover for HA

z/Linux was ~40% faster and speed is key

z/Linux provided ~66% more TPS, bound by 1Gb OSA card not CPU

z/Linux degraded gracefully (no errors)

ACS streamed errors at 3000 TPS.

Target was 6500 TPS

Page 24: Growing the Business on the Mainframe. - TPFUG · 2019-04-10 · Growing the Business on the Mainframe. Misha Kravchenko - Marriott VP Mainframe Delivery ... •The MongoDB on z initiative

Possible Future for Federated Shopping

z/Linux

Our local Linux on z MongoDB cluster can be replicated into clouds worldwide. The ‘nearest’ clusters can then automatically be made available to clients around the world.

Publicly available information can now be processed locally.• Reduced networking improves customer experience

Reservations and Rewards processing are still secured on IBM z Systems

MARSHAApplications

& Data

24

Page 25: Growing the Business on the Mainframe. - TPFUG · 2019-04-10 · Growing the Business on the Mainframe. Misha Kravchenko - Marriott VP Mainframe Delivery ... •The MongoDB on z initiative

2525

Conclusions…so far.

A platform agnostic solution that is very z/TPF like in design principles

NoSQL (document store) – application manages locking

Asynchronous I/O

Single Threaded Programming Model

JIT Compiled Language – only manage source code.

We developed initially in ACS but ran without modification on z/Linux.

System scaled easily and efficiently.

25