how to measure and expose energy usage: open questions and
TRANSCRIPT
1
How to Measure and Expose Energy Usage: Open Questions and Some
Choices of the GREEN-NET Initiative
OGF26, Chapell Hill, 4/3/2009
Presented by Augustin Ragon
Laurent Lefèvre, Anne-Cécile Orgerie
INRIA RESO – University of Lyon, France
2
Talk Roadmap
• GREEN-NET approach
• Designing the good sensors!
• What to measure?
• How much to measure?
• How to report energy measurements?
3
Running Project
• Power-aware software frameworks for high-performance data transport and computing in large-scale distributed systems
• ARC GREEN-NET : (Action de Recherche Coopérative supported by INRIA)
• Partners teams :• IRIT (Toulouse)• INRIA MESCAL (Grenoble)• INRIA RESO (Lyon)• Virginia Tech (USA)
http://www.ens-lyon.fr/LIP/RESO/Projects/green-net/
4
Towards Energy-Aware Large-Scale Systems: Open Questions
• How to reduce energy usage without compromising QoE: Quality of Experiment?
• How to understand and analyze the usage of large-scale platforms?
• How to apply energy-usage models to this experimental usage?
• How to monitor such usages in real-time (multiple views: Grids, datacenters, clusters, nodes, services, processes, threads)?
• How to design energy-aware software frameworks?
5
GREEN-NET: General Approach
6How an Experimental Platform is Used:the Grid’5000 Case
• Experimental testbed for research
• 9 sites geographically distributed in France
• 5000 processors
• Usage: node reservation, image deployment, node reboot, exclusive usage of reserved nodes
7Links Between Usage and Energy
Global usage is not enough => need more precise viewsUnderstanding energy usage from global views (site/Grid/Cluster) to node view
8
GREEN-NET: Trying to Understand the Electrical Life of Computing Nodes
Impact of hardware, usage, location…
- IBM eServer 325 (2.0GHz, 2 CPU)- Sun Fire v20z (2.4GHz, 2 CPU)- HP Proliant 385 G2 (2.2GHz, 2 CPU bicore)
9
Designing the Good Sensors!
• Infrastructure: externally monitored nodes
• « Easy » to do / install at small scale
10
Example: GREEN-Net Infrastructure• More difficulties to install/deploy at a large scale: the example of a
site with 150 nodes
• Wattmeter: big boxes (25 kg) on top of the clusters
• Lots of wires! One electrical cable per measured node
11
What to Measure?• It depends on who you are!
• Datacenter / Site admins
• Platform users
• Benchmark / Application designers
• It depends on what equipment is monitored:• Computing node
• Networking equipment
• Storage equipment
• GREEN-NET: watts per second per node, in real-time
• Is watt/sec a good metric? Can average values be interesting?
12
How Much to Measure?
• It depends on what you want to observe!
• Frequency of measurements when observing…• …global trends: a few measures per hour or per day
• …the impact of usage and applications on energy: frequency adapted to applications (seconds or minutes)
• …pico-phenomena: multiple measures per second
• Need to provide some consolidated views/reports
• GREEN-NET: we keep/store/expose all logs (70 Gigabytes of logs for one year of usage)
13
How to Report Energy Usage?
• Different levels of reporting
• Reporting to understand how energy is used in our systems
• Reporting to inject logs into decision systems
• Reporting must be multi-viewable / multi-dimension
• How to report for large-scale infrastructures?
• GREEN-NET: we provide different kinds of reports
14
Live Energy Monitoring
• Instant Feedback for users
15
Demo of Live Monitoring
• Green1.swf
16
Consolidated Energy Monitoring
• Feedback for users (days, weeks, month) for the reserved nodes
17
Demo of Consolidated Monitoring
• Sensors.swf
18
Conclusions and Requirements
• It is mandatory to have external measurements
• Is real-time watts/sec/node a good metric?
• How to make a link between measured watts and CO2?
• How to display large-scale monitoring results?
• Need of a standardized/common API for energy reporting!
• Need of common practice to access energy logs
Questions ?
http://perso.ens-lyon.fr/laurent.lefevre
http://www.ens-lyon.fr/LIP/RESO/Projects/GREEN-NET/
19
Workshop E2GC2 : Energy-Efficient Grids, Clouds and Clusters
http://www.ens-lyon.fr/LIP/RESO/e2gc2
Organized during the IEEE Grid 2009 conference October 13-15, 2009, Banff
Co-located with OGF27!
Submit your papers! (deadline July 15, 2009)