Artificial intelligence methods in the CO2

permission market simulation

Jarosław Stańczak*, Piotr Pałka**, Zbigniew Nahorski*

*Systems Research Institute, Polish Academy of Sciences

**Institute of Control and Computation Engineering, Warsaw University of Technology

Introduction

• Observations of climate change indicate that global climate warming is becoming a real threat for human civilization. • Many researchers claim that emission of CO2 and other

greenhouse gases is responsible for this.• Thus, great efforts are being made to reduce these emissions. An accepted method to make this burden lighter is to implement a system of emission limits and tradable emission permits.

The Kyoto Protocol and the market of CO2 emission permits

• This approach to emission reduction has been accepted by many countries of the world under the Kyoto Protocol.• Countries participating in an emission permits system have limitations imposed on their emissions. • If the limitations are too low for some countries, they can buy permits from other countries, or reduce their emissions by applying new technologies to produce „clean” energy. • An accepted solution should depend on their decisions, based on thorough economic optimization. • This economic optimization is in general quite difficult problem, thus artificial intelligence methods like evolutionary algorithms or multi-agent systems are applied to solve it.• To make an efficient optimization it is necessary to build a proper model of the emission permits market.

A standard static model of the permission trade - central planner

n

iii

xxCF

i 1

)(min

iii yKx

Ci(xi) – the costs of decreasing emission from an initial value x0i down to xi;

yi – the number of acquired permits;Ki – Kyoto target for participant i; xi – emission of participant i ;n – the number of participants.

n

iiy

1

0

Limitations of the central planner model

• Standard model does not allow free transactions between participants;• Calculated quantities of permits and money should be compulsory trade • Standard model does not calculate prices and quantities of conducted transactions; • Price negotiations are not considered in standard model;• Preferences of participants are not considered in standard model.•The central planner may not know all parameters of cost functions with high accuracy.

New dynamic model

• Introduces transactions between participants;• Introduces negotiations of transaction prices and amounts of traded permits;

• Participants independently make decisions to make contracts on the basis of negotiated prices;

•Participants do not know their optimal price level, but probably better know their cost functions than a central planner;

• The number of transactions is not known in advance;• Profitable transactions move market toward equilibrium;• It is possible to apply agent-based methods to simulate such a market model.

Dynamic model for multi-agent system

Gi – maximum reduction in the total costs of decreasing emissions resulting from trading;T – number of transactions conducted;Cji(xji) – the costs of decreasing emissions in region i from initial value x0i to value xji after j

transactions;Ki – Kyoto target for country i; n – number of participants;

xji – emissions of participant i after j transactions;

sji – the number of units of emissions acquired by participant i in transaction j;

smax – the maximum number of units allowed to be traded in one transaction;

pji – price of permits bought/sold by participant i in transaction j.

T

jjiiTi sKx

1

n

i

T

jjis

1 1

0

T

jjijijiiiji

si sxCxCG

jiji1,1 )()(max

j

j

jiji tion in transac tradingpartiesfor

tion in transactradingnotpartiesfor0

js

jsj

s

ji

jiji

tion in transac buyingparty thefor

tion in transac sellingparty for thetion in transactradingnot partiesfor0

max0 ss ji

Applied AI methods of permission market analysis and simulation

- specialized evolutionary algorithm

- multi-agent system

AI methods of permission market simulation - specialized evolutionary algorithm

1. Random initialization of the population of solutions.2. Reproduction and modification of solutions using genetic

operators.3. Evaluation of the solutions obtained.4. Selection of individuals for the next generation.5. If a stop condition is not satisfied, go to 2. Algorithm 1. Standard evolutionary algorithm.

1. Initialization of individuals (agents).2. Modification of individuals’ states using specialized operators.3. Evaluation of new individuals’ states.4. If a stop condition is not satisfied, go to 2.

Algorithm 2. Specialized evolutionary method for market simulation.

AI methods of permission market simulation - multi-agent system

• System composed of two or more autonomous software agents;• Agents communicate with each other and striving for their own purposes;• Multi-agent system should achieve some overarching objectives;• The multi-agent system does not implement these objectives directly, but through individual objectives of each of the agents and their interactions;• Each agent represents single party, guided by its own interests;• Agent comes to interact with others;• Agent’s motivation is the desire to achieve certain gains from the exchange

of permits;

Problem encoding – information required by agents/individuals

• The marginal cost associated with a given number of permits possessed by the country (shadow price);• The real current price of a permit for sale/purchase;• The real current value of a permit for sale/purchase;• Current number of units for sale/purchase;• The net number of units sold/purchased;• Current emissions level;• Previous emissions level (before the present transaction);• Present and previous value of the objective function.

Genetic operators – models of trade methods

• Bilateral trade - two randomly chosen countries conduct negotiations and if they agree, the transaction is done;

• Tender - the country considered offers a number of permits for sale, other countries offer to buy, the best option is chosen and the contract is done.

Multi-agent platform – roles and behaviors of agents applied

• Roles of negotiating agent and the Morris Column agent;

• Bilateral trades and tender behaviors implemented;

• The bilateral trade and tender were performed using specialized roles and behaviors.

The data applied in computer simulations

Cost functions

Country (region)

Initial emissions

(x0i) MtC/y

Cost function parameter

(ai) MUSD/(MtC/y)2

Kyoto Limit (Ki)

MtC/y USA 1 820.3 0.2755 1 251 EU 1 038.0 0.9065 860 Japan 350.0 2.4665 258 CANZ 312.7 1.1080 215 EEFSU 898.6 0.7845 1 314

CANZ – Canada, Australia, New Zealand;EEFSU – East Europe and Former Soviet Union.

ii

iiiiii

xx

xxxxaxC

0

02

0

for0

for)()(

ii

iiiiii xxpmin

xxmin_pxxaxc

0

00

for_

for,)(**2max)(Shadow price functions

The central planner results

Country (region)

Final emissions

Final price Number of permit units

acquired

Expenditure on permits

Costs of reducing emissions

[MtC/y] [USD/t]C [Mt/y] [MUSD/y] [MUSD/y] USA 1561.6 142.5 310.8 44289.0 18433.0 EU 959.4 142.5 99.1 14121.75 5602.0 Japan 321.1 142.5 63.5 9048.75 2059.0 CANZ 248.4 142.5 32.9 4688.25 4583.0 EEFSU 807.8 142.5 -506.3 -72147.75 6473.0 Total 3988.3 - 0

Bilateral trade results

Country (region)

Final emission

Last transaction price

Corresponding marginal price (shadow price)

No. of traded permissions

Permission cost

Reduction cost

[MtC/y] [USD/tC] [USD/tC] [MtC/y] [MUSD/y] [MUSD/y] USA 1 556.7 143.58 145.24 305.7 48 472.42 19 147.46 EU 960.2 129.52 141.05 100.2 14 025.68 5 487.95 Japan 321.2 123.81 142.07 63.2 10 539.84 2 049.17 CANZ 249.0 142.30 141.16 34.0 2 001.36 4 497.47 EEFSU 811.9 141.68 137.60 -503.1 -75 039.30 6 040.79 Total 3 899.0 - - 0 0 37 222.84

Country (region)

Final emission

Last transaction price

Corresponding marginal price (shadow price)

No. of traded permissions

Permission cost

Reduction cost

[MtC/y] [USD/tC] [USD/tC] [MtC/y] [MUSD/y] [MUSD/y] USA 1 559.83 142.09 143.52 308.83 59 794.97 18 692.00 EU 959.45 142.47 142.41 99.45 20 837.18 5 593.85 Japan 321.62 138.89 140.00 63.62 13 736.11 1 987.87 CANZ 248.44 141.91 142.40 33.44 3 768.45 4 575.90 EEFSU 808.66 141.72 141.12 -505.34 -98 136.71 6 346.66 Total 3 898.00 - - 0 0 37 466.28

Results of simulation using multi-agent system.

Results of simulation using evolutionary method.

Tender trade results

Country (region)

Final emission

Last transaction price

Corresponding marginal price (shadow price)

No. of traded permissions

Permission cost

Reduction cost

[MtC/y] [USD/tC] [USD/tC] [MtC/y] [MUSD/y] [MUSD/y] USA 1 561.3 124.70 142.71 310.3 34 901.88 18 480.87 EU 959.1 125.34 143.05 99.1 11 074.08 5643.23 Japan 321.1 137.41 142.56 63.1 7 169.72 2060.27 CANZ 248.1 139.74 143.15 33.1 3 588.02 4623.96 EEFSU 808.4 138.61 141.52 -505.6 -56 733.70 6382.91 Total 3 898.0 - - 0 0 37191.24

Country (region)

Final emission

Last transaction price

Corresponding marginal price (shadow price)

No. of traded permissions

Permission cost

Reduction cost

[MtC/y] [USD/tC] [USD/tC] [MtC/y] [MUSD/y] [MUSD/y] USA 1 559.99 143.05 143.43 308.99 51 955.74 18 669.49 EU 959.95 141.27 141.50 99.95 6 742.33 5 522.73 Japan 321.32 141.89 141.48 63.32 4 966.81 2 029.09 CANZ 248.78 141.94 141.65 33.78 -6 078.57 4 527.84 EEFSU 807.96 142.72 141.21 -506.04 -57 586.31 6 446.11 Total 3 898.00 - - 0 0 37195.26

Results of simulation using multi-agent system.

Results of simulation using evolutionary method.

Transaction prices in bilateral contracts

Results of simulation using multi-agent

system.

Results of simulation using evolutionary

method.

Conclusions

• Results of emission market simulation obtained using considered AI methods are very similar;

•AI methods are able to deal with complicated economic systems with many interactions between their elements and participants;

•Economic systems can be quite easily modeled, simulated and controlled using AI systems;

•Future work will concentrate on introducing different kinds of transactions between participants and uncertainty of reported emissions.