![Page 1: A NEW PLATFORM FOR A NEW ERA - QConSP© Copyright 2014 Pivotal. All rights reserved. User Mgmt Order Mgmt Shipping Inventory Payment Payment Order Mgmt Inventory User Mgmt Shipping](https://reader033.vdocuments.site/reader033/viewer/2022060210/5f04b0047e708231d40f3570/html5/thumbnails/1.jpg)
A NEW PLATFORM FOR A NEW ERA
![Page 2: A NEW PLATFORM FOR A NEW ERA - QConSP© Copyright 2014 Pivotal. All rights reserved. User Mgmt Order Mgmt Shipping Inventory Payment Payment Order Mgmt Inventory User Mgmt Shipping](https://reader033.vdocuments.site/reader033/viewer/2022060210/5f04b0047e708231d40f3570/html5/thumbnails/2.jpg)
© Copyright 2014 Pivotal. All rights reserved.© Copyright 2014 Pivotal. All rights reserved.
DevOps, CD e [Data] Microservices
2
Conceitos, desafios e o mundo real
Fred Melo @fredmelo_br
![Page 3: A NEW PLATFORM FOR A NEW ERA - QConSP© Copyright 2014 Pivotal. All rights reserved. User Mgmt Order Mgmt Shipping Inventory Payment Payment Order Mgmt Inventory User Mgmt Shipping](https://reader033.vdocuments.site/reader033/viewer/2022060210/5f04b0047e708231d40f3570/html5/thumbnails/3.jpg)
© Copyright 2014 Pivotal. All rights reserved.
$Busin
ess
Developm
ent
QA
Ope
rations
Custo
mer
WHY?
![Page 4: A NEW PLATFORM FOR A NEW ERA - QConSP© Copyright 2014 Pivotal. All rights reserved. User Mgmt Order Mgmt Shipping Inventory Payment Payment Order Mgmt Inventory User Mgmt Shipping](https://reader033.vdocuments.site/reader033/viewer/2022060210/5f04b0047e708231d40f3570/html5/thumbnails/4.jpg)
© Copyright 2014 Pivotal. All rights reserved.
$WHY?
Concept Cash
![Page 5: A NEW PLATFORM FOR A NEW ERA - QConSP© Copyright 2014 Pivotal. All rights reserved. User Mgmt Order Mgmt Shipping Inventory Payment Payment Order Mgmt Inventory User Mgmt Shipping](https://reader033.vdocuments.site/reader033/viewer/2022060210/5f04b0047e708231d40f3570/html5/thumbnails/5.jpg)
© Copyright 2014 Pivotal. All rights reserved.
How?
![Page 6: A NEW PLATFORM FOR A NEW ERA - QConSP© Copyright 2014 Pivotal. All rights reserved. User Mgmt Order Mgmt Shipping Inventory Payment Payment Order Mgmt Inventory User Mgmt Shipping](https://reader033.vdocuments.site/reader033/viewer/2022060210/5f04b0047e708231d40f3570/html5/thumbnails/6.jpg)
© Copyright 2014 Pivotal. All rights reserved.
![Page 7: A NEW PLATFORM FOR A NEW ERA - QConSP© Copyright 2014 Pivotal. All rights reserved. User Mgmt Order Mgmt Shipping Inventory Payment Payment Order Mgmt Inventory User Mgmt Shipping](https://reader033.vdocuments.site/reader033/viewer/2022060210/5f04b0047e708231d40f3570/html5/thumbnails/7.jpg)
© Copyright 2014 Pivotal. All rights reserved.
User Mgmt
Order Mgmt
Shipping
Inventory
Payment
Payment
Order Mgmt
Inventory
User Mgmt
Shipping
Contract
Contract
Contract
ContractContract
Conway’s Law and MicroservicesArchitecture x Development teams
![Page 8: A NEW PLATFORM FOR A NEW ERA - QConSP© Copyright 2014 Pivotal. All rights reserved. User Mgmt Order Mgmt Shipping Inventory Payment Payment Order Mgmt Inventory User Mgmt Shipping](https://reader033.vdocuments.site/reader033/viewer/2022060210/5f04b0047e708231d40f3570/html5/thumbnails/8.jpg)
© Copyright 2014 Pivotal. All rights reserved.
Deploy
> cf pushCloud
Controller
BBS (message bus)
RouterApp Deployed
Order Mgmt
Contract
![Page 9: A NEW PLATFORM FOR A NEW ERA - QConSP© Copyright 2014 Pivotal. All rights reserved. User Mgmt Order Mgmt Shipping Inventory Payment Payment Order Mgmt Inventory User Mgmt Shipping](https://reader033.vdocuments.site/reader033/viewer/2022060210/5f04b0047e708231d40f3570/html5/thumbnails/9.jpg)
© Copyright 2014 Pivotal. All rights reserved.
App App AppApp AppAppScale
AppAppApp
Auto-heal
Migrate Pivotal Cloud Foundry
![Page 10: A NEW PLATFORM FOR A NEW ERA - QConSP© Copyright 2014 Pivotal. All rights reserved. User Mgmt Order Mgmt Shipping Inventory Payment Payment Order Mgmt Inventory User Mgmt Shipping](https://reader033.vdocuments.site/reader033/viewer/2022060210/5f04b0047e708231d40f3570/html5/thumbnails/10.jpg)
© Copyright 2014 Pivotal. All rights reserved.
App App AppApp AppAppScale
AppAppApp
Auto-heal
Migrate
Logging
Metrics
Platform Services
Pivotal Cloud Foundry
![Page 11: A NEW PLATFORM FOR A NEW ERA - QConSP© Copyright 2014 Pivotal. All rights reserved. User Mgmt Order Mgmt Shipping Inventory Payment Payment Order Mgmt Inventory User Mgmt Shipping](https://reader033.vdocuments.site/reader033/viewer/2022060210/5f04b0047e708231d40f3570/html5/thumbnails/11.jpg)
© Copyright 2014 Pivotal. All rights reserved.
App
Stateless
Ephemeral disk
Short-lived context
“12 Factor"
App App AppApp AppAppAppAppApp
Pivotal Cloud Foundry
![Page 12: A NEW PLATFORM FOR A NEW ERA - QConSP© Copyright 2014 Pivotal. All rights reserved. User Mgmt Order Mgmt Shipping Inventory Payment Payment Order Mgmt Inventory User Mgmt Shipping](https://reader033.vdocuments.site/reader033/viewer/2022060210/5f04b0047e708231d40f3570/html5/thumbnails/12.jpg)
© Copyright 2014 Pivotal. All rights reserved.
Statefull
Disk-based storage
Long-lived context
Data Service
???????
App App AppApp AppAppAppAppApp
Pivotal Cloud Foundry
![Page 13: A NEW PLATFORM FOR A NEW ERA - QConSP© Copyright 2014 Pivotal. All rights reserved. User Mgmt Order Mgmt Shipping Inventory Payment Payment Order Mgmt Inventory User Mgmt Shipping](https://reader033.vdocuments.site/reader033/viewer/2022060210/5f04b0047e708231d40f3570/html5/thumbnails/13.jpg)
© Copyright 2014 Pivotal. All rights reserved.
Scale
Re-deploy
Migrate
Distribute
Upgrade Update
Pivotal Cloud Foundry
![Page 14: A NEW PLATFORM FOR A NEW ERA - QConSP© Copyright 2014 Pivotal. All rights reserved. User Mgmt Order Mgmt Shipping Inventory Payment Payment Order Mgmt Inventory User Mgmt Shipping](https://reader033.vdocuments.site/reader033/viewer/2022060210/5f04b0047e708231d40f3570/html5/thumbnails/14.jpg)
© Copyright 2014 Pivotal. All rights reserved.
User Mgmt
Order Mgmt
Shipping
Inventory
Payment
Payment
Order Mgmt
Inventory
User Mgmt
Shipping
Contract
Contract
Contract
ContractContract
Polyglot Persistence"RDBMs is the king" “The right tool for each job"
One Size Fits All
![Page 15: A NEW PLATFORM FOR A NEW ERA - QConSP© Copyright 2014 Pivotal. All rights reserved. User Mgmt Order Mgmt Shipping Inventory Payment Payment Order Mgmt Inventory User Mgmt Shipping](https://reader033.vdocuments.site/reader033/viewer/2022060210/5f04b0047e708231d40f3570/html5/thumbnails/15.jpg)
© Copyright 2014 Pivotal. All rights reserved.
Polyglot PersistenceRDBMs only IMDGs, K-V Stores, Object stores, …
One Size Fits All
Scale-up only
Grid-based HADisk-based HA
Scale-out
Specific hardware Containerized
![Page 16: A NEW PLATFORM FOR A NEW ERA - QConSP© Copyright 2014 Pivotal. All rights reserved. User Mgmt Order Mgmt Shipping Inventory Payment Payment Order Mgmt Inventory User Mgmt Shipping](https://reader033.vdocuments.site/reader033/viewer/2022060210/5f04b0047e708231d40f3570/html5/thumbnails/16.jpg)
© Copyright 2014 Pivotal. All rights reserved.
Scale
Re-deploy
Migrate
Distribute
Upgrade UpdateOrder Mgmt
Contract
User Mgmt
Contract
Pivotal Cloud Foundry
![Page 17: A NEW PLATFORM FOR A NEW ERA - QConSP© Copyright 2014 Pivotal. All rights reserved. User Mgmt Order Mgmt Shipping Inventory Payment Payment Order Mgmt Inventory User Mgmt Shipping](https://reader033.vdocuments.site/reader033/viewer/2022060210/5f04b0047e708231d40f3570/html5/thumbnails/17.jpg)
© Copyright 2014 Pivotal. All rights reserved.
Order Mgmt
Contract
User Mgmt
Contract
InventoryContract
PaymentsContract
ShippingContract
SQL?Analytics?
BI?
Reporting?
![Page 18: A NEW PLATFORM FOR A NEW ERA - QConSP© Copyright 2014 Pivotal. All rights reserved. User Mgmt Order Mgmt Shipping Inventory Payment Payment Order Mgmt Inventory User Mgmt Shipping](https://reader033.vdocuments.site/reader033/viewer/2022060210/5f04b0047e708231d40f3570/html5/thumbnails/18.jpg)
© Copyright 2014 Pivotal. All rights reserved.
Order Mgmt
Contract
User Mgmt
Contract
InventoryContract
PaymentsContract
ShippingContract
Analytical System
Delive
ry F
requ
ency
Degr
ee o
f au
tom
atio
n
Manual & Tooling
Transactions
Analytics
Data Scientist
MDMAnalytical Team
![Page 19: A NEW PLATFORM FOR A NEW ERA - QConSP© Copyright 2014 Pivotal. All rights reserved. User Mgmt Order Mgmt Shipping Inventory Payment Payment Order Mgmt Inventory User Mgmt Shipping](https://reader033.vdocuments.site/reader033/viewer/2022060210/5f04b0047e708231d40f3570/html5/thumbnails/19.jpg)
© Copyright 2014 Pivotal. All rights reserved.
How about Data Pipelines?
Anatomy of a Data Pipeline
Source Destination
Pro
cess
ing
Ste
p
Pro
cess
ing
Ste
p
Pro
cess
ing
Ste
p
Pro
cess
ing
Ste
p
Data Data
Monolith
![Page 20: A NEW PLATFORM FOR A NEW ERA - QConSP© Copyright 2014 Pivotal. All rights reserved. User Mgmt Order Mgmt Shipping Inventory Payment Payment Order Mgmt Inventory User Mgmt Shipping](https://reader033.vdocuments.site/reader033/viewer/2022060210/5f04b0047e708231d40f3570/html5/thumbnails/20.jpg)
© Copyright 2014 Pivotal. All rights reserved.
Data Pipeline
Scale
Re-deploy
Upgrade
Migrate
Distribute
Update
Source Destination
Pro
cess
ing
Ste
p
Pro
cess
ing
Ste
p
Pro
cess
ing
Ste
p
Pro
cess
ing
Ste
p
![Page 21: A NEW PLATFORM FOR A NEW ERA - QConSP© Copyright 2014 Pivotal. All rights reserved. User Mgmt Order Mgmt Shipping Inventory Payment Payment Order Mgmt Inventory User Mgmt Shipping](https://reader033.vdocuments.site/reader033/viewer/2022060210/5f04b0047e708231d40f3570/html5/thumbnails/21.jpg)
© Copyright 2014 Pivotal. All rights reserved.
SpringBoot app
Contract
SpringBoot app
Contract
SpringBoot app
Contract
SpringBoot app
Contract
SpringBoot app
Contract
SpringBoot app
Contract
SpringBoot app
Contract
SpringBoot app
Contract
Binding Abstraction Layer
Transport Options
Data Pipeline
Spring Cloud Stream
Breaking the Data Pipeline Monolith
![Page 22: A NEW PLATFORM FOR A NEW ERA - QConSP© Copyright 2014 Pivotal. All rights reserved. User Mgmt Order Mgmt Shipping Inventory Payment Payment Order Mgmt Inventory User Mgmt Shipping](https://reader033.vdocuments.site/reader033/viewer/2022060210/5f04b0047e708231d40f3570/html5/thumbnails/22.jpg)
© Copyright 2014 Pivotal. All rights reserved.
SpringBoot app
Contract
SpringBoot app
Contract
SpringBoot app
Contract
SpringBoot app
Contract
SpringBoot app
Contract
SpringBoot app
Contract
SpringBoot app
Contract
SpringBoot app
Contract
Transport Options
Spring Cloud Stream
Apache YARN
Breaking the Data Pipeline Monolith
![Page 23: A NEW PLATFORM FOR A NEW ERA - QConSP© Copyright 2014 Pivotal. All rights reserved. User Mgmt Order Mgmt Shipping Inventory Payment Payment Order Mgmt Inventory User Mgmt Shipping](https://reader033.vdocuments.site/reader033/viewer/2022060210/5f04b0047e708231d40f3570/html5/thumbnails/23.jpg)
© Copyright 2014 Pivotal. All rights reserved.
From Microservices to Data Microservices
SpringBoot app
Contract
SpringBoot app
Contract
SpringBoot app
Contract
SpringBoot app
Contract
SpringBoot app
Contract
SpringBoot app
Contract
SpringBoot app
Contract
SpringBoot app
Contract
Cloud Services
Transport Choices
Spring Cloud Stream
Pivotal Cloud Foundry
Scale
Auto-heal
Logging
Metrics
Registry and Discovery
Circuit Breaker
Distributed Config
![Page 24: A NEW PLATFORM FOR A NEW ERA - QConSP© Copyright 2014 Pivotal. All rights reserved. User Mgmt Order Mgmt Shipping Inventory Payment Payment Order Mgmt Inventory User Mgmt Shipping](https://reader033.vdocuments.site/reader033/viewer/2022060210/5f04b0047e708231d40f3570/html5/thumbnails/24.jpg)
© Copyright 2014 Pivotal. All rights reserved.
SpringBoot app
Contract
SpringBoot app
Contract
SpringBoot app
Contract
SpringBoot app
Contract
SpringBoot app
Contract
SpringBoot app
Contract
SpringBoot app
Contract
SpringBoot app
Contract
Pivotal Cloud Foundry Services
Data Microservices
Spring Cloud Data Flow
Data Microservices Orchestration
Pivotal Cloud Foundry
![Page 25: A NEW PLATFORM FOR A NEW ERA - QConSP© Copyright 2014 Pivotal. All rights reserved. User Mgmt Order Mgmt Shipping Inventory Payment Payment Order Mgmt Inventory User Mgmt Shipping](https://reader033.vdocuments.site/reader033/viewer/2022060210/5f04b0047e708231d40f3570/html5/thumbnails/25.jpg)
© Copyright 2014 Pivotal. All rights reserved.
SpringBoot app
Contract
SpringBoot app
Contract
Spring Cloud Data Flow
JSON Filter Transform Aggregate
CustomHTTP
Sample pipeline
Pivotal Cloud Foundry
SpringBoot app
Contract
SpringBoot app
Contract
SpringBoot app
Contract
SpringBoot app
Contract
SpringBoot app
ContractSpringBoot
appContract
SpringBoot app
Contract
SpringBoot app
Contract
Deploy
![Page 26: A NEW PLATFORM FOR A NEW ERA - QConSP© Copyright 2014 Pivotal. All rights reserved. User Mgmt Order Mgmt Shipping Inventory Payment Payment Order Mgmt Inventory User Mgmt Shipping](https://reader033.vdocuments.site/reader033/viewer/2022060210/5f04b0047e708231d40f3570/html5/thumbnails/26.jpg)
© Copyright 2014 Pivotal. All rights reserved.
![Page 27: A NEW PLATFORM FOR A NEW ERA - QConSP© Copyright 2014 Pivotal. All rights reserved. User Mgmt Order Mgmt Shipping Inventory Payment Payment Order Mgmt Inventory User Mgmt Shipping](https://reader033.vdocuments.site/reader033/viewer/2022060210/5f04b0047e708231d40f3570/html5/thumbnails/27.jpg)
© Copyright 2014 Pivotal. All rights reserved.
Your own infrastructure
Pivotal Cloud Foundry
Microservices
Spring Cloud Services
GemFire
Data Microservices
Spring Cloud Data Flow
RedisMySQL
Greenplum
Polyglot persistence
PostgreSQL
HTAP
![Page 28: A NEW PLATFORM FOR A NEW ERA - QConSP© Copyright 2014 Pivotal. All rights reserved. User Mgmt Order Mgmt Shipping Inventory Payment Payment Order Mgmt Inventory User Mgmt Shipping](https://reader033.vdocuments.site/reader033/viewer/2022060210/5f04b0047e708231d40f3570/html5/thumbnails/28.jpg)
A NEW PLATFORM FOR A NEW ERA