the dawn of composite clouds – why osgi is the most important ingredient in the next generation of...

COPYRIGHT © 2008-2011 OSGi Alliance. All Rights Reserved

The Dawn of Composite Cloud

Richard Nicholson

Paremus

20-September-2011

OSGi Alliance Marketing © 2008-2010 . All Rights Reserved

Copyright © 2011 Paremus Ltd.May not be reproduced by any means without express permission. All rights reserved.

The Dawn of Composite Cloud September 2011

Cloud 1.0 - The Dream...

• Only pay for the resources you use.• Ability to scale on demand.• Reduced operations staff.• A robust operational platform.

All without changing your Applications!

Organisation X (which shall not be named!) Internal charge back - $2,000,000 for a rack of 32 Blade Servers!And 3 months required to deliver this hardware to the project!!



Cloud 1.0 - The Reality: Pricing

As Product Prices Hit Ceiling, Is VMware Still Affordable?http://siliconangle.com/blog/2011/07/25/as-product-prices-hit-ceiling-is-vmware-still-affordable/

25 July 2011

http://www.informationweek.com/news/cloud-computing/platform/2316006721 Sept 2011

Google App Engine Price Hike Stuns Developers.... outcry as developers see their bills skyrocket.

• Complex Pricing Structures• Limited guarantee’s SLA’s

Financial Services Organisation X Internal charge back for compute resource equivalent to EC2 - once WAN bandwidth is considered - in-house resource is cheaper

http://siliconangle.com/blog/2011/07/25/as-product-prices-hit-ceiling-is-vmware-still-affordable/

http://siliconangle.com/blog/2011/07/25/as-product-prices-hit-ceiling-is-vmware-still-affordable/

http://www.informationweek.com/news/cloud-computing/platform/231600672

http://www.informationweek.com/news/cloud-computing/platform/231600672



Cloud 1.0 - The Reality: Availability and SLA’s

Amazon's lengthy cloud outage shows the danger of complexityBy Peter Bright | Published 4 months ago

http://arstechnica.com/business/news/2011/04/amazons-lengthy-cloud-outage-shows-the-danger-of-complexity.ars

09 September 2011

Office 365, Google Docs go down again, could give pause to the cloud-waryBy Jon Brodkin | Published about 4 hours ago

http://arstechnica.com/business/news/2011/09/office-365-google-docs-go-down-again-could-give-pause-to-the-cloud-wary.ars

Millions of Hotmail users cut off by Microsoft 'cloud' failure

http://www.telegraph.co.uk/technology/news/8752156/Millions-of-Hotmail-users-cut-off-by-Microsoft-cloud-failure.html 09 September 2011





http://arstechnica.com/author/peter-bright/

http://arstechnica.com/author/peter-bright/





http://arstechnica.com/author/jon-brodkin/

http://arstechnica.com/author/jon-brodkin/

http://www.telegraph.co.uk/technology/news/8752156/Millions-of-Hotmail-users-cut-off-by-Microsoft-cloud-failure.html






Regulator Casts Doubt on Banking Clouds

Too risky, says Monetary Authority of Singapore.

... unlikely to allow a bank to put customer data into the cloud without significant due diligence, pointing out that in Singapore such behaviour could be punished with a three year jail term and a hefty fine.

"[Cloud] vendors do not understand the regulatory system and laws applying to financial services,"

Outages that have affected Amazon Web Services, Google App Engine, and Microsoft Azure, suggesting that there would be a huge loss of confidence in a bank that could not continue to process transactions.

Concerned by 'nested cloud' - scenarios in which cloud providers use services from other providers to deliver a service.

US SEC 10-Q filings by various cloud providers as examples of further cause for concern - the majority of its customers do not pay the extra fees charged for disaster recovery services.

http://www.itnews.com.au/News/235977,singapore-regulator-casts-doubt-on-banking-clouds.aspx





A Different Question

To what extent does Cloud address fundamental IT issues we actual face?



Contributing factors to OPEX

Anne Thomas Manes (Gartner) – SOA Symposium: Berlin, October 2010



‘Cloud Computing’

?

Contributing factors to OPEX

Anne Thomas Manes (Gartner) – SOA Symposium: Berlin, October 2010

From an OPEX perspective - its the maintenance of applications that are the dominant PROBLEM!



Question

Question: How Much Does it cost to change a single line of code?

Context? A large software vendor with aspirations to be a SaaS player

Answer: > $1,000,000



Modular Systems are Maintainable Systems

This is true for Hardware and Software.

• Modularisation forces ‘accidental complexity’ out of the environment.

• Module boundaries enforce a clean contract between the runtime participants: & each layer of structural hierarchy!

• Runtime Dependencies are explicit!• Enforces low coupling & high cohesion.• Unit of Deployment is Unit of Maintenance.• Unit of Deployment is Unit of Re-use.



‘VM Image centric’ Compute Clouds

We’re pushing ‘static’ Gbyte sized software images to every node

To change / update / fix - we must push a new image out yet again!



VM Images - The Wrong Deployment Artifact

• Masks runtime dependencies

• Consumes unnecessary bandwidth

• Consumes unnecessary storage capacity



Cloud 1.0

With each SOA Business Service lies a rotting design.....

Beneath each Cloud lies a rotting infrastructure.....



The Dawn of ‘Composite Cloud’

In response to an injected service description: each node assembles the corresponding service:

• Locally resolving all dependencies• Pulling only software components required.

But there is something much better if your applications are JAVA centric ;)

Solutions like Puppet & CodeChef - deployment and configuration of Linux packages - are a step in the right direction.



Modular Clouds

Is OSGi ‘THE’ enabler for:

• OSGi applications in the Cloud?• Java applications in the Cloud?• Any type of Application?

ALL OF THE ABOVE!



RFP133 - OSGi and CloudsCloud

A Resource Pool

AC

B

A System

A Process Group A System Element instance!a process group member"Purpose:

• Provide a review of current industry standards bodies• Provide a conceptual model • Relate conceptual model to relevant OSGi specifications

- Requirements and Dependencies - OBR specification- Remote Services - RSA specification- Configuration - ConfigAdmin



IaaS

PaaS

An IaaS resource dependency

i.e. Amazon S3

IaaS

PaaS

A PaaS Servicesi.e. Amazon SMS

An indirect resource dependency on IaaS storage - i.e. Amazon S3

RFP133 - OSGi and Clouds

Business Benefit? Directly address environmental dependencies!

• Avoid Cloud middleware service lock-in- By inverting the middleware stack

• Addressing infrastructure fragility- By speed at which applications can be re-installed andchanged



Next Steps

Next Steps - the RFC’s:

• Framework Advertisements- How do we advertise? Leverage RSA?- What?

• Generating Environment metadata for OBR resolution • Deployment Description - for distributed ‘Composite’

applications



= 1

= 3

= 1

Target State Runtime State

Deploy

The Paremus Service Fabric - A model driven runtime

We Have a Guide



M!del

Target State

"Structure#SLA$

Runtime

Entity

Monitor

Provision Delta

Planned Deltase.g. Configuration

changes

Unplanned Deltase.g. Resource

failures

= 1

= 3

= 1

Target State Runtime State

The Service Fabric responds by creating the corresponding System - deploying all required components and ‘wiring’ these together

We Have a Guide



Service Fabric: Example



Data Will Always Be The Issue!

• Data is like Mass: the more there is - the more ‘effort’ it takes to move

• Latency will always be a barrier - speed of light

• Hence assemble processing close to where the Data is generated / collated

• No-longer centralised Compute Clouds but pervasive federated Data centric Clouds

Current public Cloud solutions are like the Internet pre ARPA-Net



Data Centric Clouds

Source of DataA processing Edge Unit

!

"#

!

"

#

local data generated .

Optional:Edge device advertises availability of data. .Edge device downloads appropriate functionality to locally process data..

Data Edge Behaviour : Processingmoved to location of data at edge

Processing moved to location of data.

OSGi Cloud Core

(OSGi Edge)



To Conclude

At runtime we must manage dependencies - ALL THE WAY DOWN

OSGi is THE enabler for Cloud 2.0

But lets not repeat Cloud 1.0 architectural mistakes!

the dawn of composite clouds – why osgi is the most important ingredient in the next generation of...

Technology