ldb convergenze parallele_de barros_02

34
Decision Making for Inconsistent Expert Judgments Using Signed Probabilities J. Acacio de Barros Liberal Studies Program San Francisco State University Ubiquitous Quanta, Università del Salento Lecce, Italy, 2013 J. Acacio de Barros (SFSU) Decision Making with Signed Probabilities Ubiquitous Quanta 1 / 32

Upload: laboratoridalbasso

Post on 11-May-2015

48 views

Category:

Small Business & Entrepreneurship


2 download

TRANSCRIPT

Page 1: Ldb Convergenze Parallele_De barros_02

Decision Making for Inconsistent Expert Judgments UsingSigned Probabilities

J. Acacio de Barros

Liberal Studies ProgramSan Francisco State University

Ubiquitous Quanta, Università del SalentoLecce, Italy, 2013

J. Acacio de Barros (SFSU) Decision Making with Signed Probabilities Ubiquitous Quanta 1 / 32

Page 2: Ldb Convergenze Parallele_De barros_02

Why probabilities?

Most ways to think rationally lead to probability measures a laKolmogorov:

Pascal (motivated by Antoine Gombaud, Chevalier de Méré).Cox, Jaynes, Ramsey, de Finneti.Venn, von Mises.

Originally, probabilities were meant to be normative, and notdescriptive.

J. Acacio de Barros (SFSU) Decision Making with Signed Probabilities Ubiquitous Quanta 2 / 32

Page 3: Ldb Convergenze Parallele_De barros_02

Contextuality and the logic of QM

QM observable operators do not fit into a standard boolean algebra(quantum lattice).Such lattice leads to nonmonotonic upper probability measures or tosigned probabilities.1

Upper probabilities are consequence of strong contextual(inconsistent) correlations.

How to think “rationally” about inconsistencies?

Quantum descriptions?Nonstandard (negative) probabilities?

1Holik, F., Plastino, A., and Sáenz, M. November 2012 arXiv:1211.4952.

J. Acacio de Barros (SFSU) Decision Making with Signed Probabilities Ubiquitous Quanta 3 / 32

Page 4: Ldb Convergenze Parallele_De barros_02

Contextuality and the logic of QM

QM observable operators do not fit into a standard boolean algebra(quantum lattice).Such lattice leads to nonmonotonic upper probability measures or tosigned probabilities.1

Upper probabilities are consequence of strong contextual(inconsistent) correlations.

How to think “rationally” about inconsistencies?

Quantum descriptions?Nonstandard (negative) probabilities?

1Holik, F., Plastino, A., and Sáenz, M. November 2012 arXiv:1211.4952.

J. Acacio de Barros (SFSU) Decision Making with Signed Probabilities Ubiquitous Quanta 3 / 32

Page 5: Ldb Convergenze Parallele_De barros_02

Outline

1 Inconsistent Beliefs

2 Modeling Inconsistent BeliefsBayesian ModelQuantum ModelSigned Probability Model

3 Final remarks

J. Acacio de Barros (SFSU) Decision Making with Signed Probabilities Ubiquitous Quanta 4 / 32

Page 6: Ldb Convergenze Parallele_De barros_02

Inconsistent Beliefs

Outline

1 Inconsistent Beliefs

2 Modeling Inconsistent BeliefsBayesian ModelQuantum ModelSigned Probability Model

3 Final remarks

J. Acacio de Barros (SFSU) Decision Making with Signed Probabilities Ubiquitous Quanta 5 / 32

Page 7: Ldb Convergenze Parallele_De barros_02

Inconsistent Beliefs

Inconsistencies

In logic, any two or more sentences are inconsistent if it is possible toderive from them a contradiction, i.e., if there exists an A such that(A ∧ ¬A) is a theorem.2

If a set of sentences is inconsistent, then it is trivial.To see this, let’s start with A ∧ ¬A as true. Then A is also true. Butsince A is true, then so is A ∨ B for any B . But since ¬A is true, itfollows from conjunction elimination that B is necessarily true.Paraconsistent logics may be used to deal with inconsistent sentenceswithout exploding.3

2Suppes, P. (1999) Introduction to Logic, Dover Publications, Mineola, New York.3daCosta, N. C. A. October 1974 Notre Dame Journal of Formal Logic 15(4), 497–510.

J. Acacio de Barros (SFSU) Decision Making with Signed Probabilities Ubiquitous Quanta 6 / 32

Page 8: Ldb Convergenze Parallele_De barros_02

Inconsistent Beliefs

With probabilities

Take X, Y, and Z as ±1-valued random variables.The above example is equivalent to the deterministic case where

E (XY) = E (XZ) = E (YZ) = −1.

Clearly the correlations are too strong to allow for a joint probabilitydistribution.

J. Acacio de Barros (SFSU) Decision Making with Signed Probabilities Ubiquitous Quanta 7 / 32

Page 9: Ldb Convergenze Parallele_De barros_02

Inconsistent Beliefs

A subtler case

Let X, Y, and Z be ±1 random variables with zero expectationrepresenting future trends on stocks of companies X , Y , and Z goingup or down.Three experts, Alice, Bob, and Carlos, have beliefs about the relativebehavior of pairs of stocks.There is no joint4 for EA (XY) = −1, EB (XZ) = −1/2, EC (YZ) = 0,as

−1 ≤ E (XY) + E (XZ) + E (YZ) ≤1 + 2min E (XY) ,E (XZ) ,E (YZ) .

4Suppes, P. and Zanotti, M. (1981) Synthese 48(2), 191–199

J. Acacio de Barros (SFSU) Decision Making with Signed Probabilities Ubiquitous Quanta 8 / 32

Page 10: Ldb Convergenze Parallele_De barros_02

Inconsistent Beliefs

How to deal with inconsistencies?

Question: what is the triple moment E (XYZ)?There are several approaches in the literature.

Paraconsistent logics.Consensus reaching.Bayesian.

Here we will examine two possible alternatives:

Quantum.Signed probabilities.

J. Acacio de Barros (SFSU) Decision Making with Signed Probabilities Ubiquitous Quanta 9 / 32

Page 11: Ldb Convergenze Parallele_De barros_02

Modeling Inconsistent Beliefs

Outline

1 Inconsistent Beliefs

2 Modeling Inconsistent BeliefsBayesian ModelQuantum ModelSigned Probability Model

3 Final remarks

J. Acacio de Barros (SFSU) Decision Making with Signed Probabilities Ubiquitous Quanta 10 / 32

Page 12: Ldb Convergenze Parallele_De barros_02

Modeling Inconsistent Beliefs Bayesian Model

Outline

1 Inconsistent Beliefs

2 Modeling Inconsistent BeliefsBayesian ModelQuantum ModelSigned Probability Model

3 Final remarks

J. Acacio de Barros (SFSU) Decision Making with Signed Probabilities Ubiquitous Quanta 11 / 32

Page 13: Ldb Convergenze Parallele_De barros_02

Modeling Inconsistent Beliefs Bayesian Model

Bayesian Model: Priors

We start with Alice, Bob, and Carlos as experts, and Deanna Troy as adecision maker.In the Bayesian approach, Deanna starts with a prior probabilitydistribution.If we assume she knows nothing about X , Y , and Z , it is reasonablethat she sets

pDxyz = pD

xyz = · · · = pDxyz =

116.

J. Acacio de Barros (SFSU) Decision Making with Signed Probabilities Ubiquitous Quanta 12 / 32

Page 14: Ldb Convergenze Parallele_De barros_02

Modeling Inconsistent Beliefs Bayesian Model

Model of experts

In order to apply Bayes’s theorem, Deanna needs to have a model ofthe experts (likelihood function).Imagine that an oracle tells Deanna that tomorrow the actualcorrelation E (XY) = −1.If Deanna thinks her expert is good, knowing that E (XY) = −1means that she should think that pxy · and pxy · should be highlyimprobable for Alice, whereas pxy · and pxy · highly probable.For instance, Deanna might propose that the likelihood function isgiven by

pxy · = pxy · = 1− 14

(1− εA)2 ,

pxy · = pxy · = −14

(1− εA)2 ,

where EA (XY) = εA.Similarly for Bob and Carlos.

J. Acacio de Barros (SFSU) Decision Making with Signed Probabilities Ubiquitous Quanta 13 / 32

Page 15: Ldb Convergenze Parallele_De barros_02

Modeling Inconsistent Beliefs Bayesian Model

Applying Bayes’s Theorem

Deanna can use Bayes’s theorem to revise her prior belief’s about X ,Y , and Z .For example,

pD|Axyz = k

[1− 1

4(1− εA)2

]18,

where

k−1 =

[1− 1

4(1− εA)2

]18

+

[14

(1− εA)2]18

+

[14

(1− εA)2]18

+

[1− 1

4(1− εA)2

]18

+

[14

(1− εA)2]18

+

[14

(1− εA)2]18

+

[1− 1

4(1− εA)2

]18

+

[1− 1

4(1− εA)2

]18,

=12.

J. Acacio de Barros (SFSU) Decision Making with Signed Probabilities Ubiquitous Quanta 14 / 32

Page 16: Ldb Convergenze Parallele_De barros_02

Modeling Inconsistent Beliefs Bayesian Model

Incorporating Bob and Carlos’s opinion

Deanna can now revise her posterior pD|Axyz using once again Bayes’s

theorem.She gets

pD|ABxyz =

132[(ε2A−2εA−3

)ε2B +

(−2ε2A + 4εA + 6

)εB−3ε2A + 6εA + 9

].

A third application of the theorem gives us pD|ABCxyz .

Similar computations can be carried out for the other atoms.

J. Acacio de Barros (SFSU) Decision Making with Signed Probabilities Ubiquitous Quanta 15 / 32

Page 17: Ldb Convergenze Parallele_De barros_02

Modeling Inconsistent Beliefs Bayesian Model

Example

If εA = 0, εB = −12 , εC = −1, we have

pD|ABCxyz = pD|ABC

xyz = pD|ABCxyz = pD|ABC

xyz = 0,

pD|ABCxyz = pD|ABC

xyz =768,

andpD|ABCxyz = pD|ABC

xyz =2768.

From the joint, we obtain, e.g.,

E (XYZ) = 0.

J. Acacio de Barros (SFSU) Decision Making with Signed Probabilities Ubiquitous Quanta 16 / 32

Page 18: Ldb Convergenze Parallele_De barros_02

Modeling Inconsistent Beliefs Bayesian Model

Summary: Bayesian

The Bayesian approach is the standard probabilistic approach fordecision making.It is extremely sensitive on the prior distribution.Depends on the model of experts (likelihood function).Allows to compute a proper joint probability distribution.

J. Acacio de Barros (SFSU) Decision Making with Signed Probabilities Ubiquitous Quanta 17 / 32

Page 19: Ldb Convergenze Parallele_De barros_02

Modeling Inconsistent Beliefs Quantum Model

Outline

1 Inconsistent Beliefs

2 Modeling Inconsistent BeliefsBayesian ModelQuantum ModelSigned Probability Model

3 Final remarks

J. Acacio de Barros (SFSU) Decision Making with Signed Probabilities Ubiquitous Quanta 18 / 32

Page 20: Ldb Convergenze Parallele_De barros_02

Modeling Inconsistent Beliefs Quantum Model

Quantum model

Theorem

Let X , Y , and Z be three observables in a Hilbert space H with eigenvalues±1, and let them pairwise commute, and let the ±1-valued random variableX, Y, and Z represent the outcomes of possible experiments performed ona quantum system |ψ〉 ∈ H. Then, there exists a joint probabilitydistribution consistent with all the possible outcomes of X, Y, and Z.

Bell: “The only thing proved by impossibility proofs is the author’slack of imagination.”

J. Acacio de Barros (SFSU) Decision Making with Signed Probabilities Ubiquitous Quanta 19 / 32

Page 21: Ldb Convergenze Parallele_De barros_02

Modeling Inconsistent Beliefs Quantum Model

Quantum model

Theorem

Let X , Y , and Z be three observables in a Hilbert space H with eigenvalues±1, and let them pairwise commute, and let the ±1-valued random variableX, Y, and Z represent the outcomes of possible experiments performed ona quantum system |ψ〉 ∈ H. Then, there exists a joint probabilitydistribution consistent with all the possible outcomes of X, Y, and Z.

Bell: “The only thing proved by impossibility proofs is the author’slack of imagination.”

J. Acacio de Barros (SFSU) Decision Making with Signed Probabilities Ubiquitous Quanta 19 / 32

Page 22: Ldb Convergenze Parallele_De barros_02

Modeling Inconsistent Beliefs Quantum Model

Inserting different contexts: measurement

If we want to model the above correlations, we need to explicitlyinclude the context.E.g.

EA (XY) = 〈ψxy |X Y |ψxy 〉,

where |ψ〉xy 6= |ψ〉yz 6= |ψ〉xz .For instance, consider the three orthonormal states|A〉, |B〉, and |C 〉,and let

|ψ〉 = cxy |ψxy 〉 ⊗ |A〉+ cxz |ψxz〉 ⊗ |B〉+ cyz |ψyz〉 ⊗ |C 〉.

We can compute a joint, and therefore E (XYZ), from |ψ〉.There are infinite number of |ψ〉 satisfying the correlations, and−1 ≤ E (XYZ) ≤ 1.

J. Acacio de Barros (SFSU) Decision Making with Signed Probabilities Ubiquitous Quanta 20 / 32

Page 23: Ldb Convergenze Parallele_De barros_02

Modeling Inconsistent Beliefs Quantum Model

Summary: quantum

Provides a way to compute the triple moment from acontext-dependent vector.Imposes no constraint on the relative weights or triple moment.Doesn’t tell us what is our best bet.

J. Acacio de Barros (SFSU) Decision Making with Signed Probabilities Ubiquitous Quanta 21 / 32

Page 24: Ldb Convergenze Parallele_De barros_02

Modeling Inconsistent Beliefs Signed Probability Model

Outline

1 Inconsistent Beliefs

2 Modeling Inconsistent BeliefsBayesian ModelQuantum ModelSigned Probability Model

3 Final remarks

J. Acacio de Barros (SFSU) Decision Making with Signed Probabilities Ubiquitous Quanta 22 / 32

Page 25: Ldb Convergenze Parallele_De barros_02

Modeling Inconsistent Beliefs Signed Probability Model

Kolmogorov model

Kolmogorov axiomatized probability in a set-theoretic way, with thefollowing simple axioms.

A1. 1 ≥ P (A) ≥ 0

A2. P (Ω) = 1

A3. P (A ∪ B) = P (A) + P (B)

J. Acacio de Barros (SFSU) Decision Making with Signed Probabilities Ubiquitous Quanta 23 / 32

Page 26: Ldb Convergenze Parallele_De barros_02

Modeling Inconsistent Beliefs Signed Probability Model

Upper and lower probabilities

How do we deal with inconsistencies?de Finetti: relax Kolmogorov’s axiom A2:

P∗ (A ∪ B) ≥ P∗ (A) + P∗ (B)

orP∗ (A ∪ B) ≤ P∗ (A) + P∗ (B) .

Subjective meaning: bounds of best measures for inconsistent beliefs(imprecise probabilities).

J. Acacio de Barros (SFSU) Decision Making with Signed Probabilities Ubiquitous Quanta 24 / 32

Page 27: Ldb Convergenze Parallele_De barros_02

Modeling Inconsistent Beliefs Signed Probability Model

Upper and lower probabilities

Consequence:M∗ =

∑i

P∗i > 1,

M∗ =∑

i

P∗i < 1.

M∗ and M∗ should be as close to one as possible.Inequalities and nonmonotonicity make it hard to compute upper andlowers for practical problems.

J. Acacio de Barros (SFSU) Decision Making with Signed Probabilities Ubiquitous Quanta 25 / 32

Page 28: Ldb Convergenze Parallele_De barros_02

Modeling Inconsistent Beliefs Signed Probability Model

Workaround?

Define MT =∑

i |p (Ai )|.Instead of violating A2, relax A1:

A’1. pi are such that MT is minimum.

A’2. p (Ai ∪ Aj) = p (Ai ) + p (Aj) , i 6= j ,

A’3.∑

i

p (Ai ) = 1.

Ai (probability of atom i)5 can now be negative.p defines an optimal upper probability distribution by simply setting allnegative probability atoms to zero.Atoms with negative probability are thought subjectively as impossibleevents.

5The definition of atoms might be difficult once we relax A1, but for finite probabilityspaces this is not a problem.

J. Acacio de Barros (SFSU) Decision Making with Signed Probabilities Ubiquitous Quanta 26 / 32

Page 29: Ldb Convergenze Parallele_De barros_02

Modeling Inconsistent Beliefs Signed Probability Model

Why negative probabilities?

We can compute them easily (compared to uppers/lowers).May be helpful to think about certain contextual problems (e.g.non-signaling conditions, counterfactual reasoning).They have a meaning in terms of subjective probability.

J. Acacio de Barros (SFSU) Decision Making with Signed Probabilities Ubiquitous Quanta 27 / 32

Page 30: Ldb Convergenze Parallele_De barros_02

Modeling Inconsistent Beliefs Signed Probability Model

Marginals from Alice, Bob, and Carlos

pxyz + pxyz + pxyz + pxyz + pxyz + pxyz + pxyz + pxyz = 1, (1)

pxyz + pxyz + pxyz + pxyz − pxyz − pxyz − pxyz − pxyz = 0, (2)

pxyz + pxyz − pxyz + pxyz − pxyz + pxyz − pxyz − pxyz = 0, (3)

pxyz + pxyz + pxyz − pxyz − pxyz − pxyz + pxyz − pxyz = 0, (4)

pxyz − pxyz − pxyz + pxyz − pxyz − pxyz + pxyz + pxyz = 0, (5)

pxyz − pxyz + pxyz − pxyz − pxyz + pxyz − pxyz + pxyz = −12, (6)

pxyz + pxyz − pxyz − pxyz + pxyz − pxyz − pxyz + pxyz = −1, (7)

J. Acacio de Barros (SFSU) Decision Making with Signed Probabilities Ubiquitous Quanta 28 / 32

Page 31: Ldb Convergenze Parallele_De barros_02

Modeling Inconsistent Beliefs Signed Probability Model

Signed Probabilities

pxyz = −pxyz = −18− δ,

pxyz = pxyz =316,

pxyz = pxyz =516,

pxyz = −pxyz = −δ,

E (XYZ) = −14− 4δ.

From A’1, we have as constraint

−18≤ δ ≤ 0, which implies −1

4 ≤ E (XYZ) ≤ 12 .

J. Acacio de Barros (SFSU) Decision Making with Signed Probabilities Ubiquitous Quanta 29 / 32

Page 32: Ldb Convergenze Parallele_De barros_02

Modeling Inconsistent Beliefs Signed Probability Model

Summary: signed probabilities

Signed probabilities have a natural interpretation in terms of(subjective) upper probabilities.Minimization of M− requires the improper distributions to approach asbest as possible the rational proper jpd.This has a normative constraint on the choices of triple moment.

J. Acacio de Barros (SFSU) Decision Making with Signed Probabilities Ubiquitous Quanta 30 / 32

Page 33: Ldb Convergenze Parallele_De barros_02

Final remarks

Outline

1 Inconsistent Beliefs

2 Modeling Inconsistent BeliefsBayesian ModelQuantum ModelSigned Probability Model

3 Final remarks

J. Acacio de Barros (SFSU) Decision Making with Signed Probabilities Ubiquitous Quanta 31 / 32

Page 34: Ldb Convergenze Parallele_De barros_02

Final remarks

Summary

Standard Bayesian approach is sensitive to choices of prior andlikelihood function (well-known problem).

“It ain’t what you don’t know that gets you into trouble. It’s what youknow for sure that just ain’t so.” -Mark TwainE.g. say that Deanna starts with E (XYZ) = ε as her prior. Theposterior will give E (XYZ) = ε regardless of Alice, Bob, and Carlos’sopinions.

The quantum-like approach, using vectors on a Hilbert space, seemsto be too permissive, and to not have normative power. (Is it the onlyquantum model for it?)

Can we find some additional principle in QM to help with this?

Negative probabilities, with the minimization of the negative mass,offers a lower and upper bound for values of triple moment.

J. Acacio de Barros (SFSU) Decision Making with Signed Probabilities Ubiquitous Quanta 32 / 32