ceilometer presentation ods grizzly.pdf

29
Ceilometer The OpenStack Metering Project 15 Oct 2012 @ ODS Grizzly Doug Hellmann aka doughellmann/dhellmann (twitter/irc) [email protected] Nick Barcet aka nijaba (twitter/irc) [email protected]

Upload: openstack-foundation

Post on 25-Jun-2015

1.214 views

Category:

Documents


0 download

DESCRIPTION

true

TRANSCRIPT

Page 1: Ceilometer presentation ODS Grizzly.pdf

CeilometerThe OpenStack Metering Project

15 Oct 2012 @ ODS Grizzly

Doug Hellmannaka doughellmann/dhellmann (twitter/irc)

[email protected]

Nick Barcetaka nijaba (twitter/irc)

[email protected]

Page 2: Ceilometer presentation ODS Grizzly.pdf

What About Billing?● Billing has been left out of OpenStack core so far as it

was not the primary problem and is not a trivial one...

● Yet almost every OpenStack deployment needs a way to track usage information

Page 3: Ceilometer presentation ODS Grizzly.pdf

Billing: 3 Step Process

Metering Collect usage data

Rating Transform usage data into billable items and calculate costs

Billing Create invoice, collect payment

Page 4: Ceilometer presentation ODS Grizzly.pdf

Ceilometer is Metering

Usage data collection is the ONLY thing common to all clouds

Page 5: Ceilometer presentation ODS Grizzly.pdf

Uses for Metering● Billing

● Auditing

● Capacity Planning

Page 6: Ceilometer presentation ODS Grizzly.pdf

Problems to Solve● Collecting per user/tenant usage data

○ For every resource○ From every OpenStack component○ In a single place

● Retrieving usage data○ From a single place

● Doing this with an open source project○ Everyone did this in their own corner in the past :-(

Page 7: Ceilometer presentation ODS Grizzly.pdf

Ceilometer Begins● Started in May 2012

Page 8: Ceilometer presentation ODS Grizzly.pdf

Ceilometer Rises● Developed in StackForge

○ Same process as OpenStack

● Minimal set of meters defined

● Targeting OpenStack core ○ incubation pending

Page 9: Ceilometer presentation ODS Grizzly.pdf

Design Requirements● Scalable

○ …if your database is too

Page 10: Ceilometer presentation ODS Grizzly.pdf

Design Requirements● Scalable

○ …if your database is too● Message signature

○ Non-repudiation built in

Page 11: Ceilometer presentation ODS Grizzly.pdf

Design Requirements● Scalable

○ …if your database is too● Message signature

○ Non-repudiation built in● Only one entry point to get data

Page 12: Ceilometer presentation ODS Grizzly.pdf

Design Requirements● Scalable

○ …if your database is too● Message signature

○ Non-repudiation built in● Only one entry point to get data● Extensible, add your own:

○ Agent○ Agent plugin○ Storage engine○ Meters

Page 13: Ceilometer presentation ODS Grizzly.pdf

Design Requirements● Scalable

○ …if your database is too● Message signature

○ Non-repudiation built in● Only one entry point to get data● Extensible, add your own:

○ Agent○ Agent plugin○ Storage engine○ Meters

● Use openstack-common components

Page 14: Ceilometer presentation ODS Grizzly.pdf

Design Requirements● Scalable

○ …if your database is too● Message signature

○ Non-repudiation built in● Only one entry point to get data● Extensible, add your own:

○ Agent○ Agent plugin○ Storage engine○ Meters

● Use openstack-common components● Accept data from many sources

Page 15: Ceilometer presentation ODS Grizzly.pdf

Data TriggersCeilometer inputs are generated three ways

User Action Creating, modifying, or deleting a resource

Audit Regular audit events stating usage generated by the service

Polling The ceilometer agent asks the service for data periodically

Page 16: Ceilometer presentation ODS Grizzly.pdf

Meter CategoriesCeilometer handles 3 types of meters

Cumulative Increasing over time (instance hours)

Gauge Discrete items (floating IPs, image uploads) and fluctuating values (disk I/O)

Delta Changing over time (bandwidth)

Page 17: Ceilometer presentation ODS Grizzly.pdf
Page 18: Ceilometer presentation ODS Grizzly.pdf
Page 19: Ceilometer presentation ODS Grizzly.pdf
Page 20: Ceilometer presentation ODS Grizzly.pdf
Page 21: Ceilometer presentation ODS Grizzly.pdf
Page 22: Ceilometer presentation ODS Grizzly.pdf
Page 23: Ceilometer presentation ODS Grizzly.pdf

Simple REST API

Sum GET /v1/resources/(resource)/meters/(meter)/volume/sum

Maximum GET /v1/resources/(resource)/meters/(meter)/volume/max

Duration GET /v1/resources/(resource)/meters/(meter)/duration

Raw Events GET /v1/resources/(resource)/meters/(meter)

http://ceilometer.readthedocs.org/en/latest/api.html

Page 24: Ceilometer presentation ODS Grizzly.pdf

Roadmap

Grizzly HFolsom

● Delivered last week● Collects base metering

○ nova○ glance○ cinder○ quantum

● Basic API access

● Incubated Project● User accessible API?● Integration example with

Horizon● New agents for other

openstack components○ Swift○ Heat?

● New uses of collector?● SQLAlchemy storage

driver

● Core Project● TBD

Page 25: Ceilometer presentation ODS Grizzly.pdf

DreamHost Use Case● New Public Cloud Service

● Existing Billing System

● Existing Users and Accounts

Page 26: Ceilometer presentation ODS Grizzly.pdf

Configuring Ceilometer● Measure exactly what we want to bill for

○ instance hours

○ block storage

○ image uploads

○ bandwidth

Page 27: Ceilometer presentation ODS Grizzly.pdf

Customizing Ceilometer● Custom Bandwidth Meter

○ No charge for traffic "inside" DreamHost

○ Don't expose infrastructure details to customers

○ Measure at the router, not the VIF

Page 28: Ceilometer presentation ODS Grizzly.pdf

Consuming Meter Data

Page 29: Ceilometer presentation ODS Grizzly.pdf

Questions?

Nick Barcetaka nijaba (twitter/irc)

[email protected]

http://launchpad.net/ceilometerhttp://ceilometer.readthedocs.org

freenode: #openstack-meteringemail: openstack-dev [ceilometer]

Doug Hellmannaka doughellmann/dhellmann (twitter/irc)[email protected]