compatibleone fisl conference 2011 brazil

CompatibleOneThe Freedom

of Interoperability Above the Clouds

Cedric Thomas, OW2Rafael Monnerat, NexediFISL, Juin 2011

2© OW2 Consortium 2011 www.ow2.org


A Truly Global Membership

Exo PlatformBonitasoftFunambolJaspersoftIngresOrbeonTalendZagile

4LinuxCaixaKonsultexNeocicloSERPROUni. of FortalezaUni. of Sao Paulo

BeiHang U.CSTCCVIC-SEISCASKingdee MiddlewareNUDTPeking U.IntervisionO-Engine

C-DACDishana Solutions

ActiveEonBullFrance TelecomINRIABonitasoftCharles U.EADSEBMWebsoursingEdifixioEnovanceIceScrumLIG

NuxeoOpen WideObjisRequeaScalagentSerliSogetiSilverPeasTelecom InstitutUbikisUShareSoftXwiki

Berlin TU-DIMAFraunhofer FokusTarent

EterationCharles U.

Engineering

OSOR


Over 100 ProjectsMature Projects (34)AcceleoASMBonitaCARDAMOMCAROLChameleonCLIFEasyBeanseXo PlatformFractalGASPJavaServiceJOnASJOPEJORAMJOTMLemonLDAP::NGNovaForge

Open Mobile ISOrbeon PSOrchestraPetALS ESBProActiveRmiJdbcRUBiSSalome-TMFSat4JSOFASpagicSpagoSpago4QSpagoBITelosysXWiki

Projects in Archive (35)AzukiBarracudaMVCC-JDBCDotNetJDryverlDragonEclipseJDOEnhydraFederIDFractalGOTMHOWLIntrospectorInterLDAPLombozJalistoJASptE

JonathanJORMMassivMEDORMobiliToolsMonologOdette FTPOscarParGRESSharkSNAPSpeedoSURFsync4jTribeXAPoolXQuarexPlus

Projects in Incubation (47)AccordActiveXMLAlitheia CoreAspire RFIDBEENCMICloudSNAPCONTRAILDemoiselleDocDokuDreamDysowebEnuSMVEPAFEasyWSDLElastic-Grid

PerseusPetals MasterQ-ImPrESSScarboShelbieSilverPeasSiroccoSlapOSTESSTrustie TSRRTalend StudioThinkUbistarWebLabWinQEMU

EntropyFraSCAtiJ2WSJASMINeJWTGenJiBX2LeWYSMINDNuxeoODISOSA CCVOSLC V3OcelotOncePIOpenSSOpen SUITPanGu


+46%


Exo PlatformBonitasoftJaspersoftIngresTalend

KonsultexNeocicloUni. of FortalezaUni. of Sao Paulo

BeiHang UniversityCVIC-SEISCASNUDTPeking UniversityO-Engine

BullCohesive FTFrance TelecomINRIAPetalsinkEdifixioEMNOrange LabsTelacom InstitutXWiki

Free Cloud Alliance

Berlin TU-DIMAFraunhofer Fokus

Charles U.

Engineering

© OW2 Consortium 2011 www.ow2.org

Self-sizing & Green PaaS

InteroperableDistributed Services

BI 4 Cloud

Massively Distributed Clouds

•Improve overall platform efficiency

•Enable interoperability between heterogeneous service domains/clouds

•Provide BI capabilities for and over cloud

•Enable next generation cloud architecture

1

2

3

4

OSCi by Domains


•OW2 Members

•Non-Members

•Industry

•End-Users

•Academia

•Government

STAKEHOLDERSSTAKEHOLDERSVISION & GOALSVISION & GOALS

1- Self-Sizing and Green PaaS

2- Interoperable distributed services

3- BI 4 Cloud

4- Massively Distributed Clouds

33rdrd party projects party projects

OW2 projectsOW2 projects

Collaborative Collaborative projectsprojects

Initiative bedrock


CloudForce, Magellan


IndustryIndustry

ResearchResearch

ClustersClusters


The freedom to control how you use cloud computing

• Freedom to choose your cloud providers

• Freedom to use any type of hardware or software

• Freedom and control on your infrastructure and your applications

• Freedom to distribute your services between public and private clouds

• Freedom to move your applications where you want, when you want

• Freedom to adapt the code to your needs

• Control over the security and QoS


Open cloudware enabling users to create, deploy and manage private, public or hybrid cloud platforms

SaaSMake applications independent of providers and lower the barriers to adoption of innovative servicePaaSProvide a high-end cloudware to build applications independent of cloud infrastructuresIaaSManage heterogenous infrastructures through an overall abstraction of resources

IAAS

PAAS

SAAS

11/07/11 15© OW2 Consortium 2011 www.ow2.org


CompatibleOne leverages the whole open source ecosystem to provide a comprehensive open cloudware stack.


SP5:Dissemination / Diffusion

SP0:Project Management

SP2:Platform

SP1:Infrastructure

SP3: Security, QoS & Management

SP

4: U

se Ca ses

Dem

on stration s

Requirements& Validation

InfrastructureManagementServices

Platform relatedservices and tools

GeneralManagement


Functional Overview


QoS & Management Sub-Project

Objectives

• Broker to dispatch service query to specific subdomains• Provisioning, resource allocation, IaaS/PaaS services

allocation, monitoring, energy management.• Front end, templates for SLA definitions, requests from

IaaS and PaaS• Methods and tools

• Provisioning: optimization algorithms (splitting, optimal placement, migration…), Scheduling ProActive• Monitoring: JMX probes, Nagios, SNMP • Energy management: probes management (OmegaWatt,

Schleitenhumer), notification and energy consumption alert system (Entropy / Ganglia)• Resource description and query languages: OCCI, OVF (DMTF),

ProActive, …• Open Grid Forum (OGF): Open Cloud Computing Interface (OCCI) • Distributed Management Task Force (DMTF): Open Virtualisation

Format (OVF), • Cloud Management Working Group (CMWG)• Storage Networking Industry Association (SNIA): Cloud Data

Management Interface (CDMI) • OASIS

OpenSource & Open Standards


QoS & Management Deliverable

• Control and management of IaaS and PaaS services

• Control of service lifecycle

• Resource allocation optimization

• Monitoring of resources and of energy consumption

• QoS management, elasticity, self-sizing

• CMI: Control and Management Interfaces

– REST between users and the management and control framework

– OCCI, OVF (DMTF)• IaaS & PaaS Interfaces

– REST between the IaaS and PaaS platforms and the management and control framework

– OCCI


Platform Sub-Project

ObjectifsObjectifs• Provide PaaS services to developers • Services instanciated through REST protocol• REST-based REST, Java, Python, etc. libraries• Leverage CompatibleOne infrastructure• Provide those services to the demonstrators

OpenSource & OpenStandards

• Evaluation and extension of existing components: JOnAS, JORAM, JASMINe, Nuxeo, ProActive, SlapOS, Xwiki• Promote CompatibleOne PaaS to:

- Open Cloud Computing Interface (OCCI),

- OSGI Alliance,

- Distributed Management Task Force (DMTF)

Objectives


• Task management, distributed processing:– scheduling: jobs, tasks, workflows– Distributed computation: Master Worker, Monte-Carlo, Map-Reduce

• CompatibleOne API interfaces • Storage and caching :

– Definition of the service provisioning protocol – Selection of services to be implemented:

• RDBMS: MySQL and PostgreSQL (+other?)• Blobs storage: selection of an implementation of the S3 protocol

(Ceph, OpenStack Object Storage?)• NoSQL database: MongoDB, Cassandra, other (tbd)• Cache: memcached

– Upcoming implementation of these services over a service instantiation engine

Platform Deliverable


• JOnAS OSGi runtime integration and extension– Resource sharing

– Automation

– Elasticity

– Usage billing

• Accounting, billing and invoicing– Service implementation through Nexedi SlapOS

• CMIS document service– Definition of a CMIS-based document management service (+ extensions)

– Prototype implementation based on Nuxeo EP server with added multi-tenancy caapabilities with instantiation by the CopatibleOne provisioning engine, either in an OSGi container, or directly on the IaaS itself

– Usage of this prototype by the Xwiki demonstrator

Platform Deliverable


Infrastructure Sub-Project

Objectives

• IaaS resource description model• Intercloud IaaS resource management APIs: Instanciation, scheduling, monitoring• VM format interoperability• Energy efficiency and QoS strategies• Tests and benchmarks

• IaaS APIs reference implementations; integration with Mandriva Linux• Software engineering tools for cloud stack development• Contribution to existing cloud worksgroups: DMTF, OCCI, CSA, CDMI, IETF, OSGi• OCCI reference implementation • Mapping and evaluation of alternative initiatives

OpenSource &OpenStandards


• Description model and query language

– “ get a computer in Brazil, providing SQL database service, on a Nehalem processor, with 1866Mhz DDR3 or more, 32 GB RAM, connected to a 100Mbps Internet transit and to a 10Gbps local network”

Infrastructure Deliverable

• Compute– Unification Amazon WS,

OCCI, Deltacloud, GoGrid, Rackspace, …

– Multi-providers VM generation

– VM migrations format pivot OVF, virt-tools, …

– Image repository• Network

– switchs virtuels, IPv6, IPSec, OpenVSwitch, failover, load balancing

• Storage – Clef/Valeur:

Memcached, Bloc : Qemu block device API, POSIX FS

• Monitoring – Agents / Collecteurs /

Analyseurs ; JASMINe, BonjourGrid, SNMP


Security

Objectives • SLA enforcement using security properties• Methods and tools• Security management

OpenSource &OpenStandards

• Security: authentication, ORBAC access control, OpenVPN• Cloud Security Alliance


Enable application deployment over a federation of cloudsCloud architecture abstractionReference implementation

Use cases / Demonstrators• EUREVA: Distributed

remote 3D rendering• MANDRIVA: Physical

platform migration• NEXEDI: Accounting and

billing• NUXEO: Documentation

management• XWIKI: Collaborative

applications


Nuxeo

• Cloud-enabling the Nuxeo server based CompatibleOne IaaS and PaaS services• Third-party application deployment management• Document Storage as a Service

Services •Administration of machines and deployment environments•Scheduling services usage for intensive computation (data mining, conversions) •Multi-tenancy, security and resource con,sumption accounting

Objectives


XWiki

•SaaS offering and infrastructure management with CompatibleOne components •Xwiki-based applications deployment management (collaborative applications)

Services •Machines and deployment environment management (failover and machine migration management) •Use of CompatibleOne PaaS services for storage (SQL and NoSQL), schedul;ing, mailing and asynchronous communication•Resource consumption accounting and appstore

Objectives


Mandriva

•Use of CompatibleOne infrastructure services to deploy the Pulse2 asset management application (heterogenous systems and devices

Services •Agnostic support of virtual machine images •Distributed communication between Pulse2 components deployed on different hosts•Machine geolocalisation, routing and monitoring for application deployment.

Objectives


Eureva

•3D application execution in a centralized datacenter•3D rendering streaming to workstations or mobile devices

Services •Machine provisioning and GPU support•Network management enabling infrastructure access: public addesses, on-demend ports•Access security management•Load balancing and monitoring

Objectives


Nexedi

Objectives

•Enablement of a cloud services accounting and billing function

Services •Use of CompatibleOne PaaS services to deploy an accounting and billing environment•Implementation of different scenarios: proprietary appstore, automatinc payment, invoicing backend


How to know more about us

Internet Resources

• Website http://compatibleone.org– Project information (partners, description, links),

Documentation (presentation, slides), Event list, Press coverage

• LinkedIn group

• twitter @compatibleone

• StatusNet http://compatibleone.status.net/

• IRC channel #compatibleone hosted by freenode

Collateral• Free-standing poster (Totem), Factsheet, Presentations• Interviews (text and videos), White paper

http://compatibleone.org/

http://compatibleone.status.net/


Events

Events• In The Cloud

March 8-10, 2011, Paris

• OpenStack conference & design summitApril 26-29, 2011, Santa Clara

• FISLJune 29 – July 2, 2011, Porto Alegre, Brazil

ForthomingEvents

• OSCON, July 25-29, 2011, Portland, USA

• Open World Forum, Sept. 22-24, 2011, Paris

• China Open Source Week, Oct. 10-17, Beijing and Nanjing, China

• OW2con, Nov. 23-25, Issy (Paris), France

http://compatibleone.org/bin/view/Follow/Events


Where is the code?

Infrastructure

•Collaborative Project Sandbox (CPS)– Private space for the collaborative project for

internal project documents, sandbox, ...– A CPS has been open for CompatibleOne– http://forge.ow2.org/projects/compatibleone/

•Installation of a GITorious instance on the OW2 infrastructure

– upon initial request from SlapOS

– http://gitorious.ow2.org/

• Used by SlapOS, and now by 5 other OW2 projects

http://forge.ow2.org/projects/compatibleone/

http://gitorious.ow2.org/


Join Us Promoting freedom in the cloud

Follow us at http://compatibleone.org/

➢Contribute➢Share➢Spread the word

http://compatibleone.org/

compatibleone fisl conference 2011 brazil

Technology

qos ow2 consortium

magellan ow2 consortium

sao paulo ow2 consortium

cloud providers freedom

open migration

open virtualisati

applications freedom

open cloudware saas