overview and comparison of software tools for power management in data centers msc. enida sheme...

26
Overview and Comparison of Software Tools for Power Management in Data Centers Msc. Enida Sheme Acad. Neki Frasheri Polytechnic University of Tirana Albania

Upload: valentine-carter

Post on 19-Jan-2016

221 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Overview and Comparison of Software Tools for Power Management in Data Centers Msc. Enida Sheme Acad. Neki Frasheri Polytechnic University of Tirana Albania

Overview and Comparison of Software Tools for Power Management in Data Centers

Msc. Enida ShemeAcad. Neki FrasheriPolytechnic University of TiranaAlbania

Page 2: Overview and Comparison of Software Tools for Power Management in Data Centers Msc. Enida Sheme Acad. Neki Frasheri Polytechnic University of Tirana Albania

Outline

• Motivation and Goal• Measuring Tools• Simulating Tools• Analysis and Comparison• Conclusions• References

Page 3: Overview and Comparison of Software Tools for Power Management in Data Centers Msc. Enida Sheme Acad. Neki Frasheri Polytechnic University of Tirana Albania

Motivation

• Over the last decade, a new challenge has been raised to researchers and industry

• Energy efficient data centers• Go Green – is becoming a chorus when building new

technologies or improving existing one• There are to be found new ways of power

consumption reduction while keeping the required Quality of Service.

• To achieve this, we need first to monitor, manage, model and/or simulate energy by new software or hardware tools.

Page 4: Overview and Comparison of Software Tools for Power Management in Data Centers Msc. Enida Sheme Acad. Neki Frasheri Polytechnic University of Tirana Albania

Goal

• There are many available tools which evaluate or model power tradeoffs in data centers, in order to finally improve overall system energy efficiency.

• We overview, analyse and compare features of the existing data center tools for measuring, modeling and simulating purpose.

• We have selected 10 software tools to study, based on one of my papers refereed in SEERC Conference, Academia.edu publications and ResearchGate forum discussions as well.

Page 5: Overview and Comparison of Software Tools for Power Management in Data Centers Msc. Enida Sheme Acad. Neki Frasheri Polytechnic University of Tirana Albania

Categorize

• You cannot manage what you don’t measure.• MEASURING TOOLS (2/10)

• Better resource management leads to overall system energy efficiency.

• SIMULATING TOOLS (8/10)

Page 6: Overview and Comparison of Software Tools for Power Management in Data Centers Msc. Enida Sheme Acad. Neki Frasheri Polytechnic University of Tirana Albania

Measure / Monitor ToolsJoulemeter• Developed by Microsoft, a free tool that estimates

and graphically shows the power consumption of a computer, SW or VM (kWh), and carbon emission in cubic feet as well.

GUI support only Windows, cannot measure GPUPAPI (Performance Application Programming Interface)• It can monitor system information like CPU, network

interface cards, power. Save data to disk, can measure GPU, cross platform

Page 7: Overview and Comparison of Software Tools for Power Management in Data Centers Msc. Enida Sheme Acad. Neki Frasheri Polytechnic University of Tirana Albania

Simulation / power saving tools• CloudSIM – CLOUDS Lab, University of Melbourne• CLUES – Polytechnic University of Valencia, Spain• GreenCloud Scheduler – Technical University of Cluj-

Napoca, Romania• GreenCloud Simulator – University of Luxemburg• Green Data Center Simulator – Arizona state University• OpenStack-neat – CLOUDS Lab, University of

Melbourne• Philarmonic – Technical University of Vienna

(collaboration with University of Turku, Finland)• PowerPack – Marquette University, Wisconsin

Page 8: Overview and Comparison of Software Tools for Power Management in Data Centers Msc. Enida Sheme Acad. Neki Frasheri Polytechnic University of Tirana Albania

CloudSimExtensible simulation framework that enables modeling, simulation, and experimentation of Cloud computing infrastructures and applications

Extensions of CloudSim:• CloudAnalyst – 2009, Large Scale cloud analysis ,

graphical output (sourceforge.net)• WorkflowSim – 2012, workflow level support

(github.com)• CloudReports – 2012, GUI support (github.com)• DynamicCloudSim – 2013, Simulating heterogeneity in

computational clouds (code.google.com)• RealCloudSim – 2014 (sourceforge.net)

Page 9: Overview and Comparison of Software Tools for Power Management in Data Centers Msc. Enida Sheme Acad. Neki Frasheri Polytechnic University of Tirana Albania

CLUES

• Cluster Energy Saving system• energy management system for High

Performance Computing (HPC) Clusters and Cloud infrastructures that supports integration with OpenNebula

• power off internal cluster nodes when they are not being used

• power them on when they are needed• Wake on LAN support

Page 10: Overview and Comparison of Software Tools for Power Management in Data Centers Msc. Enida Sheme Acad. Neki Frasheri Polytechnic University of Tirana Albania

GreenCloud Scheduler

• Augments OpenNebula clouds with energy-awareness for energy saving purposes

• Server consolidation and turning off the unused servers

• Wake on LAN support• Loop of 4 phases

– Monitoring, – Analysis, – Planning, – Execution phases

Page 11: Overview and Comparison of Software Tools for Power Management in Data Centers Msc. Enida Sheme Acad. Neki Frasheri Polytechnic University of Tirana Albania

GreenCloud Simulator

• A packet-level simulator for energy-aware cloud computing data centres with a focus on cloud communications

• It offers a detailed modelling of the energy consumed by: computing servers, network switches, and communication links.

Page 12: Overview and Comparison of Software Tools for Power Management in Data Centers Msc. Enida Sheme Acad. Neki Frasheri Polytechnic University of Tirana Albania

Green Data Center Simulator

• Simulator that models online resource management

• Accurately predicts performance as well as energy consumption of a data center

• Web published January 2015

Page 13: Overview and Comparison of Software Tools for Power Management in Data Centers Msc. Enida Sheme Acad. Neki Frasheri Polytechnic University of Tirana Albania

OpenStack-neat

- Implements dynamic consolidation of VMs by live migration- Implements algorithms for these questions:• Host underloaded => sleep mode• Host overloaded => VM migration• Which VMs to migrate• Execute migration

Page 14: Overview and Comparison of Software Tools for Power Management in Data Centers Msc. Enida Sheme Acad. Neki Frasheri Polytechnic University of Tirana Albania

Philarmonic

• Simulator framework to model energy savings• Will be extended by University of Turku

Finland• A module to integrate weather data forecast

and act accordingly in order to use solar energy for power supply.

Page 15: Overview and Comparison of Software Tools for Power Management in Data Centers Msc. Enida Sheme Acad. Neki Frasheri Polytechnic University of Tirana Albania

PowerPack

• Power/performance profiling infrastructure to evaluate energy efficiency and power-aware techniques for parallel applications

Combination of:• Hardware (sensors and digital meters)• Software (drivers, instrumentation APIs,

benchmarks, analysis tools)

Page 16: Overview and Comparison of Software Tools for Power Management in Data Centers Msc. Enida Sheme Acad. Neki Frasheri Polytechnic University of Tirana Albania

COMPARISON

Page 17: Overview and Comparison of Software Tools for Power Management in Data Centers Msc. Enida Sheme Acad. Neki Frasheri Polytechnic University of Tirana Albania

Software Benefit / Advantage Drawback

CloudSIM Simulation tools and reports for cloud.Windows and Linux compatible

Lack of a GUI

CLUES Up to 47% energy savings in clusters.Windows and Linux compatible

Wake on LAN Hardware support

GreenCloud Simulator

Ns2 extension. Simulation of CPU, memory, storage, network resources

No support for distributed data centre models.

PowerPack 12% energy savings HW support

GreenCloud Scheduler

10-30% energy savings Not specified

OpenStack-neat

re-allocate VMs according to their real-time resource utilization

Not specified

GDC Simulator

Models online resource management.Accurately predicts performance as well as energy consumption of a data center

Not specified

Philarmonic A module for integrating weather forecast in the system is being prepared

Still isolated in a small group of developers

Page 18: Overview and Comparison of Software Tools for Power Management in Data Centers Msc. Enida Sheme Acad. Neki Frasheri Polytechnic University of Tirana Albania

Programming LanguageSoftware Programming Language

CloudSIM Java

CLUES Python

GreenCloud Simulator C++/OTCL

PowerPack F#

GreenCloud Scheduler Java

OpenStack-neat Python

Green Data Center Simulator Not published

Philarmonic Python

Page 19: Overview and Comparison of Software Tools for Power Management in Data Centers Msc. Enida Sheme Acad. Neki Frasheri Polytechnic University of Tirana Albania

Operating System Software Operating System

CloudSIM WINDOWS + LINUX

CLUES WINDOWS + LINUX

GreenCloud Simulator LINUX

PowerPack LINUX

GreenCloud Scheduler LINUX

OpenStack-neat LINUX

Green Data Center Simulator LINUX

Philarmonic LINUX

Page 20: Overview and Comparison of Software Tools for Power Management in Data Centers Msc. Enida Sheme Acad. Neki Frasheri Polytechnic University of Tirana Albania

Graphical User InterfaceSoftware GUI support

CloudSIM ( CloudReports) NO (YES)CLUES NO

GreenCloud Simulator YES

PowerPack NO

GreenCloud Scheduler NO

OpenStack-neat NO

Green Data Center Simulator NO

Philarmonic NO

Page 21: Overview and Comparison of Software Tools for Power Management in Data Centers Msc. Enida Sheme Acad. Neki Frasheri Polytechnic University of Tirana Albania

Accessible through:Software Code Available

CloudSIM https://github.com/Cloudslab/cloudsim/releases, latest release CloudSim 3.0.3 May 2013

CLUES https://github.com/grycap/clues/

GreenCloud Simulator http://greencloud.gforge.uni.lu/

PowerPack https://github.com/fsprojects/powerpack-archive

GreenCloud Scheduler http://coned.utcluj.ro/GreenCloudScheduler/resources/GreenCloudScheduler_Source.tar.gz OpenStack-neat https://github.com/beloglazov/openstack-neat

Green Data Center Simulator Not Available

Philarmonic https://github.com/philharmonic

Page 22: Overview and Comparison of Software Tools for Power Management in Data Centers Msc. Enida Sheme Acad. Neki Frasheri Polytechnic University of Tirana Albania

Release yearCloudSIM 2009

Clues 2010

GreenCloud Sim 2010

PowerPack 2010

Green Cloud Scheduler 2012

OpenStack Neat 2012

GDCSim 2015

Philarmonic 2015

2009 2015

Page 23: Overview and Comparison of Software Tools for Power Management in Data Centers Msc. Enida Sheme Acad. Neki Frasheri Polytechnic University of Tirana Albania

Most popular

• CloudSim and GreenCloud Simulator, most popular simulators among researchers, based on:

• Number of cited papers• Number of tool downloads

Page 24: Overview and Comparison of Software Tools for Power Management in Data Centers Msc. Enida Sheme Acad. Neki Frasheri Polytechnic University of Tirana Albania

Conclusions• General overview on the current development

status of software tools for data center energy monitoring and simulating.

• Introduced 2 monitoring tools and 8 simulation tools.

• We suggest CloudSIM and GreenCloud Simulator for beginner researchers. Large community of developers and available forums.

• Next presentation regarding Philarmonic new module: integrating weather data forecast into the system.

Page 25: Overview and Comparison of Software Tools for Power Management in Data Centers Msc. Enida Sheme Acad. Neki Frasheri Polytechnic University of Tirana Albania

References• Calheiros et al. CloudSim: a toolkit for modeling and simulation of

cloud computing environments and evaluation of resource provisioning algorithms, 2010

• CLUES. CLUES energy management system http://www.grycap.upv.es/clues/eng, Last updated 2013

• Dzimitry Kliazovich et al. GreenCloud: A Packet-Level Simulator For Enery-Aware Cloud Computing Data Centers, 2010

• Green Cloud Scheduler http://community.opennebula.org/ecosystem: green_cloud_scheduler, Last modified January 2014

• Anton Beloglazov: OpenStack neat: a framework for dynamic and energy-efficient consolidation of virtual machines in OpenStack clouds, 2014

• Rong Ge et al. PowerPack: Energy Profiling and Analysis of High-Performance Systems and Applications, 2010

• Sandeep K.S. Gupta et al. GDCSim: A Tool for Analyzing Green Data Center Design and Resource Management Techniques, 2015

Page 26: Overview and Comparison of Software Tools for Power Management in Data Centers Msc. Enida Sheme Acad. Neki Frasheri Polytechnic University of Tirana Albania

Thank you !