building a university community paas using cloud foundry (cloud foundry summit 2014)

34
Building a University Community PaaS Using Cloud Foundry Yaohui Jin, Deputy Director, Network & Information Center, Shanghai Jiao Tong University, China Wei-Min Lu, CEO, Anchora/MoPaaS, China 2014-06-10

Upload: pivotal

Post on 27-Jan-2015

128 views

Category:

Technology


2 download

DESCRIPTION

Lightning Talk by Dr. Wei-Min Lu, Founder and CEO Anchora. The Shanghai Jiao Tong University PaaS is a community cloud PaaS based on Cloud Foundry jointly built and operated by the Network and Information Center at Shanghai Jiao Tong University and MoPaaS/Anchora. It serves more than 10,000 professors, instructors, and researchers, and more than 50,000 undergraduate and graduate students. In particular, it provides an agile cloud application platform for R&D and teaching. In this talk, I will share our experience building and operating such a community PaaS using Cloud Foundry.

TRANSCRIPT

Page 1: Building a University Community PaaS Using Cloud Foundry (Cloud Foundry Summit 2014)

1

Building a University Community PaaS

Using Cloud Foundry

Yaohui Jin, Deputy Director, Network & Information Center, Shanghai Jiao Tong University, China

Wei-Min Lu, CEO, Anchora/MoPaaS, China

2014-06-10

Page 2: Building a University Community PaaS Using Cloud Foundry (Cloud Foundry Summit 2014)

2

About SJTU and NIC

Shanghai Jiao Tong University (SJTU)• One of the top 5 universities in China

• Faculty & staff members: 7,000+

• Students: 36,000+

Center for Network & Information (NIC)• Providing IT services for education and research etc

• 40+ employees

• π, No. 204 of TOP500 supercomputer

• 250+ servers in datacenter

04/10/2023

Page 3: Building a University Community PaaS Using Cloud Foundry (Cloud Foundry Summit 2014)

3

About Anchora• Leading Cloud Platform & Service Provider

in China– Streamlines app lifecycle management

– The first open public PaaS (MoPaaS) in China

– MoPaaS national network consolidates public/ community PaaS’s

– Top ten most innovative cloud company in China

• Products and Services: MoPaaS– Public PaaS

– Virtual Private/Community PaaS

– MoPaaS Enterprise Edition: InPaaS

04/10/2023

Page 4: Building a University Community PaaS Using Cloud Foundry (Cloud Foundry Summit 2014)

4

The MoPaaS Network in China• MoPaaS Core System

– MoPaaS Cloud App Engine

– Virtual Private Cloud PaaS

• MoPaaS Extended System– Public Cloud Service Providers

– Community Cloud Service Providers

– MoPaaS Integration

• MoPaaS Cloud Services– Virtual Private PaaS

– Virtual Community PaaS

– Public PaaS

04/10/2023

Page 5: Building a University Community PaaS Using Cloud Foundry (Cloud Foundry Summit 2014)

5

SJTU PaaS Jointly Built and Operated by SJTU NIC and Anchora/MoPaaS

The First University Community PaaS in Chinahttp://www.cf.sjtu.edu.cn/

04/10/2023

Page 6: Building a University Community PaaS Using Cloud Foundry (Cloud Foundry Summit 2014)

6

Requirements for SJTU PaaS

Research: Providing research individuals & groups with a unified IT

environment for research projects

Teaching: A unified development/testing environment for class projects

• The students develop their code on their PCs, and then deploy and test their

apps on the PaaS.

• The teachers monitor the students’ progresses, and run and evaluate their

projects on the PaaS

Innovation and Entrepreneurship: The university encourages

entrepreneurship; an online incubator for students

04/10/2023

Page 7: Building a University Community PaaS Using Cloud Foundry (Cloud Foundry Summit 2014)

7

The SJTU PaaS Is Built on OpenStack

Controller 2×E5 2670, 64GB, 2×300GB, 10GE

Compute Node 2×E5 2670, 64GB, 2×300GB SAS + 4×3TB SATA, 10GE

Storage Node 2×E5 2670, 64GB, 12×2T SATA, 10GE

Networking 10GE

04/10/2023

Page 8: Building a University Community PaaS Using Cloud Foundry (Cloud Foundry Summit 2014)

8

 SJTU PaaS Is Based on Cloud Foundry

04/10/2023

The third party services

Services

Page 9: Building a University Community PaaS Using Cloud Foundry (Cloud Foundry Summit 2014)

9

SJTU PaaS Integration with MoPaaS• MoPaaS Core Systems

– MoPaaS Cloud App Engine

– Virtual Private Cloud PaaS

• SJTU PaaS System

– Community PaaS

– MoPaaS Integration

• Extended PaaS Services

– Limited resources with SJTU PaaS

– Easy Migration to MoPaaS

04/10/2023

Page 10: Building a University Community PaaS Using Cloud Foundry (Cloud Foundry Summit 2014)

10

Case Studies: Innovation

• The Mobile App Innovation Challenge at STJU• 67 teams• Apps on the CF-based PaaS

04/10/2023

Page 11: Building a University Community PaaS Using Cloud Foundry (Cloud Foundry Summit 2014)

11

Case Study : SJTU WIFI Monitoring Platform

04/10/2023

Page 12: Building a University Community PaaS Using Cloud Foundry (Cloud Foundry Summit 2014)

12

Case Study : Air Pollution Monitoring and Analyzing System

04/10/2023

Page 13: Building a University Community PaaS Using Cloud Foundry (Cloud Foundry Summit 2014)

13

Summary

SJTU PaaS Is Based on Cloud Foundry

• The first community PaaS in China

• Built on SJTU NIC OpenStack-based IaaS

• Based on MoPaaS

SJTU PaaS Is Used as a Platform for

• Research

• Teaching

• Innovation and Entrepreneurship

04/10/2023

Page 14: Building a University Community PaaS Using Cloud Foundry (Cloud Foundry Summit 2014)

14

Contact Us

Prof. Yaohui Jin:• Deputy Director, SJTU NIC

[email protected]

• +86-139-1848-5071

Dr. Wei-Min Lu:• CEO, Anchora/CEO

[email protected]

• +1-408-658-8166

• +86-186-2623-3286

04/10/2023

Page 15: Building a University Community PaaS Using Cloud Foundry (Cloud Foundry Summit 2014)

© 2014

Page 16: Building a University Community PaaS Using Cloud Foundry (Cloud Foundry Summit 2014)

FOUR LEVELS OF HA IN CLOUD FOUNDRYCornelia Davis @cdavisafc [email protected]

Page 17: Building a University Community PaaS Using Cloud Foundry (Cloud Foundry Summit 2014)

I work on a PaaS…

“For us, PaaS is a set of services aimed at developers that helps them develop and test apps without having to worry about the underlying infrastructure. Developers don't want to have to worry about provisioning the servers, storage and backup associated with developing and launching an app.”

[1] http://www.javaworld.com/article/2078801/java-app-dev/forrester--paas-makes-developers-happy.html[2] http://www.infoworld.com/d/cloud-computing/paas-primer-what-platform-service-and-why-does-it-matter-212696

And I believed ‘em…

Page 18: Building a University Community PaaS Using Cloud Foundry (Cloud Foundry Summit 2014)

I work on a PaaS…

“For us, PaaS is a set of services aimed at developers that helps them develop and test apps without having to worry about the underlying infrastructure. Developers don't want to have to worry about provisioning the servers, storage and backup associated with developing and launching an app.”

[1] http://www.javaworld.com/article/2078801/java-app-dev/forrester--paas-makes-developers-happy.html[2] http://www.infoworld.com/d/cloud-computing/paas-primer-what-platform-service-and-why-does-it-matter-212696

And I believed ‘em…

… but then I learned otherwise

Page 19: Building a University Community PaaS Using Cloud Foundry (Cloud Foundry Summit 2014)

Application Instances and Availability Zones

Rout

erDEA

DEA

DEA

Cloud Foundry Elastic Runtime

DEA

DEA

DEA

Zone 1 Zone 2

App Ops

Page 20: Building a University Community PaaS Using Cloud Foundry (Cloud Foundry Summit 2014)

Application Instances and Availability Zones

Rout

erDEA

DEA

DEA

Cloud Foundry Elastic Runtime

DEA

DEA

DEA

Zone 1 Zone 2 Application instances are evenly distributed over two availability zones.

App Ops

Page 21: Building a University Community PaaS Using Cloud Foundry (Cloud Foundry Summit 2014)

Application Instances and Availability Zones

Rout

erDEA

DEA

DEA

Cloud Foundry Elastic Runtime

DEA

DEA

DEA

Zone 1 Zone 2 Application instances are evenly distributed over two availability zones.

Loosing an AZ keeps instances running and available.

App Ops

Page 22: Building a University Community PaaS Using Cloud Foundry (Cloud Foundry Summit 2014)

Rout

er

Failed Application Instances Replaced

Blobstore Cloud Controller Health Manager

Messaging(NATS)

DEA DEA DEA

App Ops

Cloud Foundry Elastic Runtime

Page 23: Building a University Community PaaS Using Cloud Foundry (Cloud Foundry Summit 2014)

Rout

er

Failed Application Instances Replaced

Blobstore Cloud Controller Health Manager

Actual State

Messaging(NATS)

DEA DEA DEA

App Ops

Cloud Foundry Elastic Runtime

Page 24: Building a University Community PaaS Using Cloud Foundry (Cloud Foundry Summit 2014)

Rout

er

Failed Application Instances Replaced

Blobstore Cloud Controller Health Manager

Actual StateDesired State

Messaging(NATS)

DEA DEA DEA

App Ops

Cloud Foundry Elastic Runtime

Page 25: Building a University Community PaaS Using Cloud Foundry (Cloud Foundry Summit 2014)

Rout

er

Failed Application Instances Replaced

Blobstore Cloud Controller Health Manager

Actual StateDesired State

Messaging(NATS)

DEA DEA DEA

App Ops

Cloud Foundry Elastic Runtime

Page 26: Building a University Community PaaS Using Cloud Foundry (Cloud Foundry Summit 2014)

Rout

er

Failed Application Instances Replaced

Blobstore Cloud Controller Health Manager

Actual StateDesired State

Messaging(NATS)

DEA DEA DEA

App Ops

Cloud Foundry Elastic Runtime

Page 27: Building a University Community PaaS Using Cloud Foundry (Cloud Foundry Summit 2014)

Message Bus

ERS Processes are Monitored

IaaSCloud Foundry BOSH

Health Monitor Health Manager

DEA

Cloud Controller

A

A

A

Responders:

pager

email

monitoring

PaaS Ops

Page 28: Building a University Community PaaS Using Cloud Foundry (Cloud Foundry Summit 2014)

Message Bus

ERS Processes are Monitored

IaaSCloud Foundry BOSH

Health Monitor Health Manager

DEA

Cloud Controller

A

A

A

Responders:

pager

email

monitoring

PaaS Ops

Page 29: Building a University Community PaaS Using Cloud Foundry (Cloud Foundry Summit 2014)

Message Bus

ERS Processes are Monitored

IaaSCloud Foundry BOSH

Health Monitor Health Manager

DEA

Cloud Controller

A

A

A

Responders:

pager

email

monitoring

PaaS Ops

Page 30: Building a University Community PaaS Using Cloud Foundry (Cloud Foundry Summit 2014)

Message Bus

VMs are Monitored

IaaS

Health Monitor Health Manager

Cloud Controller

A

DEA

A

A

Responders:

pager

email

monitoring

resurrector

BOSH Director

Actual State

DEA

A

PaaS Ops

Cloud Foundry BOSH

Page 31: Building a University Community PaaS Using Cloud Foundry (Cloud Foundry Summit 2014)

Message Bus

VMs are Monitored

IaaS

Health Monitor Health Manager

Cloud Controller

A

DEA

A

A

Responders:

pager

email

monitoring

resurrector

BOSH Director

Actual State

DEA

A

PaaS Ops

Cloud Foundry BOSH

Desired State

Page 32: Building a University Community PaaS Using Cloud Foundry (Cloud Foundry Summit 2014)

Message Bus

VMs are Monitored

IaaS

Health Monitor Health Manager

Cloud Controller

A

DEA

A

A

Responders:

pager

email

monitoring

resurrector

BOSH Director

Actual StateDesired State

PaaS Ops

Cloud Foundry BOSH

Page 33: Building a University Community PaaS Using Cloud Foundry (Cloud Foundry Summit 2014)

Message Bus

VMs are Monitored

IaaS

Health Monitor Health Manager

Cloud Controller

A

A

Responders:

pager

email

monitoring

resurrector

BOSH Director (CP

I)Actual StateDesired State

DEA

A

PaaS Ops

Cloud Foundry BOSH

Page 34: Building a University Community PaaS Using Cloud Foundry (Cloud Foundry Summit 2014)

Four levels of HA in PCF

Elastic Runtime (ERS):

Distribution across availability zones

Application health management and recovery

BOSH (cluster management):

Process monitoring, recovery and alerting

Virtual machine health monitoring, recovery and alerting