new developments of the lee- carter model for mortality

46
NEW DEVELOPMENTS OF THE LEE- CARTER MODEL FOR MORTALITY DYNAMICS Professor Steven Haberman and Dr Arthur Renshaw Cass Business School, City University Mortality and Longevity – Making Financial Sense of the Highly Uncertain 8 April, Edinburgh 15 April, London 1

Upload: others

Post on 08-May-2022

2 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: NEW DEVELOPMENTS OF THE LEE- CARTER MODEL FOR MORTALITY

NEW DEVELOPMENTS OF THE LEE-CARTER MODEL FOR MORTALITY

DYNAMICS

Professor Steven Haberman and Dr Arthur Renshaw Cass Business School, City University

Mortality and Longevity – Making Financial Sense of the Highly Uncertain 8 April, Edinburgh 15 April, London

1

Page 2: NEW DEVELOPMENTS OF THE LEE- CARTER MODEL FOR MORTALITY

2

AGENDA • Data and Notation • Basic Lee-Carter Model • Age-Period-Cohort Model • Risk Measurement • Concluding Comments

Page 3: NEW DEVELOPMENTS OF THE LEE- CARTER MODEL FOR MORTALITY

ILLUSTRATION OF DATA CONFIGURATION

Typical rectangular data array and targeted projected array.

3

Page 4: NEW DEVELOPMENTS OF THE LEE- CARTER MODEL FOR MORTALITY

NOTATION

Data: ( xtd , xte )

xtd = number of deaths at age x and time t xte = matching exposure to risk of death with empirical central mortality rate

ˆ /xt xt xte . m d=

Random variables:

xtD = number of deaths at age x and time t xtY = response (generic)

4

Page 5: NEW DEVELOPMENTS OF THE LEE- CARTER MODEL FOR MORTALITY

LEE CARTER MODELS: BASE VERSION

STRUCTURE One of the benchmark demographic models used for mortality modelling and projections in many countries. Lee and Carter (1992) proposed:

ln ,xt xt xt xt x x tm = η + ε η = α +β κ , where the xtε are IID 2(0, )σΝ variables.

This is a regression framework with no observable quantities on the RHS. 5

Page 6: NEW DEVELOPMENTS OF THE LEE- CARTER MODEL FOR MORTALITY

STRUCTURE (cont) Structure is invariant under the transformations

{ , , } { , / , }x x t x x tc cα β κ α β κ

{ , , } { , , }x x t x x x tc cα β κ α − β β κ +

and is made identifiable using the following constraints (which are not unique):

1

0nt

tt t=

κ =∑ , 1,xx

β =∑ and which imply the least squares estimator

11

1ˆ ln1

nt

x xtt tn

mt t

=

α =− + ∑

6

Page 7: NEW DEVELOPMENTS OF THE LEE- CARTER MODEL FOR MORTALITY

INTERPRETATION OF PARAMETERS

xα : ‘average’ of log xtm over time t so that exp xα represents the general shape of the age-specific mortality profile.

tκ : underlying time trend.

xβ : sensitivity of the logarithm of the hazard rate at age x to the time trend represented by . tκ

xtε : effects not captured by the model. 7

Page 8: NEW DEVELOPMENTS OF THE LEE- CARTER MODEL FOR MORTALITY

FITTING BY SVD

(Lee and Carter (1992))

A two-stage estimation process: estimate xα as above. Estimate tκ and x β as the 1st right and 1st left singular vectors in the SVD of the matrix

ˆˆ[log ]xt xm −α . Thus 1 1 1

1

ˆˆlog( ) ( ) ( ) ( ) ( )xt x i i ii

m s u x v t s u x v t>

= α + +∑

where i, ,i is u v = (ordered) singular values and vectors and )1 1 1

ˆ ˆ ( ) (x t s u x v tβ κ = subject to the constraints on tκ and xβ .

ˆFinally, tκ are adjusted so that

tˆxt xt

all, x all, xd d = ∀∑ ∑ . where ˆ ˆˆ ˆexp( )xt xt x xd e t= α +β κ .

8

Page 9: NEW DEVELOPMENTS OF THE LEE- CARTER MODEL FOR MORTALITY

FITTING BY WEIGHTED LEAST SQUARES (GAUSSIAN)

Perform the iterative process

Set starters ˆˆˆ , ,x xα β κt ; compute ˆxty ↓

update ˆ xα ; compute ˆxty

update , adjust s.t. ˆ tκ1

0nt

tt t=

κ =∑ ; compute ˆxty

update ˆxβ ; compute ˆxty

ˆ( ,compute )xt x y t D y↓

repeat; stop when )ˆ( ,xt x y t converges D y

Where ˆˆ ˆlog ,xt xt xt xty m y= = η , 2ˆ ˆ( , ) ( )xt xt xt xt xtx,t

D y y w y y= −∑

with weights xt = xt (or = 1). w dFor a typical parameter, we use the updating algorithm:

2

2( ) D Dupdated ∂ ∂θ = θ −

∂θ ∂θ.

9

Page 10: NEW DEVELOPMENTS OF THE LEE- CARTER MODEL FOR MORTALITY

POISSON BILINEAR MODEL

, ( ) exp( ),xt xt xt xt x xY D Y e= Ε = α +β κt Var( ) ( )xt xtY Y= φΕ

with log-link and non-linear predictor log xt xt x teη = +α +β κx .

Perform iterative process with ˆ ˆˆ ˆˆ, exp( )xt xt xt xt xt x x ty d y d e= = = α +β κ

( )ˆ ˆ( , ) 2 log ˆxt

xt xt xt xt xt xtx,t xt

dD d d w d d dd

⎧ ⎫⎛ ⎞⎪ ⎪= − −⎜ ⎟⎨ ⎬⎜ ⎟⎪ ⎪⎝ ⎠⎩ ⎭∑

with weights

1, 00 0

xtxt

xt

ew

, e>

==

10

Page 11: NEW DEVELOPMENTS OF THE LEE- CARTER MODEL FOR MORTALITY

LEE CARTER: BINOMIAL

xt x x t= +η α β κ 1, 0nx t

x= =∑β κ

and link functions ( )xt xtg q=η

Possible choices of are: g

I. complementary log-log link ( ){ }log log 1xt xtq= − −η

II. log-odds link log1

xtxt

xt

qq

⎛ ⎞= ⎜ ⎟−⎝ ⎠

η

III. probit link ( )1

xt xtq−= Φη

11

Page 12: NEW DEVELOPMENTS OF THE LEE- CARTER MODEL FOR MORTALITY

DIAGNOSTICS

1) Proportion of the total temporal variance explained by the 1st SVD

component:

21

2 100%i

all, i

ss×

∑.

(Not a good indicator of goodness of fit.) 2) Standardised deviance residuals

ˆ ˆsign( )xt xt xty yε = − ( )dev x,t / φ (we could also use standardised SVD residuals) 3) Plot differences between actual total and expected total deaths for

each time period, t. 12

Page 13: NEW DEVELOPMENTS OF THE LEE- CARTER MODEL FOR MORTALITY

PROJECTIONS

Time series (ARIMA)

1ˆ{ : t [ , ]}t nt tκ ∈ 0{ : }nt s s+κ > .

Construct mortality rate projections

ˆ ˆˆ exp{ ( )}, 0n n n nx,t s xt x t s tm m s+ += β κ − κ >

by alignment with the latest available mortality rates.

Note ˆ ˆ( , ) exp{ ( )}, 0

n nn x t s tF x t s s++ = β κ − κ >

is a mortality reduction factor, as widely used in the UK and elsewhere.

For ARIMA(0,1,0) with drift parameter λ

ˆ ˆ( , ) exp( ), 0n xF x t s s s+ = β λ > ,

13

Page 14: NEW DEVELOPMENTS OF THE LEE- CARTER MODEL FOR MORTALITY

E+W 1961 – 2003 male mortality experience. Log crude mortality rates against period, for grouped age (0-,1-,5-,10-, …, 90-, 95-).

14

Page 15: NEW DEVELOPMENTS OF THE LEE- CARTER MODEL FOR MORTALITY

E+W female mortality experience (LC)

15

Page 16: NEW DEVELOPMENTS OF THE LEE- CARTER MODEL FOR MORTALITY

E+W male mortality experience (LC)

LC model: E+W mortality experience

16

Page 17: NEW DEVELOPMENTS OF THE LEE- CARTER MODEL FOR MORTALITY

17

Page 18: NEW DEVELOPMENTS OF THE LEE- CARTER MODEL FOR MORTALITY

INTERIM CONCLUSIONS

• Basic LC model fits England and Wales females mortality

experience fairly well; but poor fit for male experience • Enhancements

- optimize choice of fitting period - add a second factor: 2 )1 1 2( ) ( ) ( ) (

x x t x tα β κ β κ+ +

- allow for a cohort effect

18

Page 19: NEW DEVELOPMENTS OF THE LEE- CARTER MODEL FOR MORTALITY

AGE-PERIOD-COHORT MODELS IN LC FRAMEWORK

UK: Strong cohort effect for those born in period 1925 – 1945 (also US, Japan, Germany Sweden) The Lee-Carter structure may be expanded to incorporate a cohort effect: (0) (1)

xt xt x x t-x x tAPC: logeη = + α +β ι + β κ under the Poisson setting.

The age-cohort substructure

(1) 0AC: xβ = is also of interest, while we recall that for the standard model

(0) 0LC: xβ = .

19

Page 20: NEW DEVELOPMENTS OF THE LEE- CARTER MODEL FOR MORTALITY

FITTING AGE-PERIOD-COHORT MODELS

Fitting is problematic because of the relationship

cohort = (period – age) or z = t – x between the three main effects.

We resort to a two-stage fitting strategy, in which xα is estimated first, according to the original Lee-Carter SVD approach, thus

11

1ˆ ln1

nt

x xtt tn

mt t

=

α =− + ∑

The remaining parameters can then be estimated subject to the

parameter constraints

t( ) ( ),

kx x t xx x

and or 1 1

0 11 1 0 0β β ι κ−= = = =∑ ∑ .

Effective starting values are obtained by setting ( ) ( )x x0 1 1β β= =

z

and fitting a restricted version of the model to generate starting values for ι and tκ .

20

Page 21: NEW DEVELOPMENTS OF THE LEE- CARTER MODEL FOR MORTALITY

PROJECTIONS

Use separate ARIMA time series

ˆ{ : [ , ]}t nt t t1κ ∈ { : }nt s s 0κ + > ,

ˆ{ : [ , ]}z k nz t x t x1 1ι ∈ − − { : }

nt x s s1

0ι − + > ,

then

( ) ( )ˆ ˆˆ ˆ( , ) exp{ ( ) ( )},n n n nn x t x s t x x t s tF x t s s− + − ++ = − + − >β ι ι β κ κ0 1 0

where

ˆ ,

,n

n

n

t x st x s

t x s

s x-x

s x-x1

1

ιι

ι− +

− +− +

≤=

>.

21

Page 22: NEW DEVELOPMENTS OF THE LEE- CARTER MODEL FOR MORTALITY

UK female mortality experience (LC) – residual plots

22

Page 23: NEW DEVELOPMENTS OF THE LEE- CARTER MODEL FOR MORTALITY

UK female mortality experience (AC) – residual plots

23

Page 24: NEW DEVELOPMENTS OF THE LEE- CARTER MODEL FOR MORTALITY

UK female mortality experience (APC) – residual plots

24

Page 25: NEW DEVELOPMENTS OF THE LEE- CARTER MODEL FOR MORTALITY

APPLICATIONS

Time Series Forecasts

• For :p

t t i ti

y a a t y −=

κ = + + φ∑0 11

1 with p=2

t t 1κ κ −= − ( for males; for females) a1 0≠ a1 0= • For zι ARIMA (1,1,0)

25

Page 26: NEW DEVELOPMENTS OF THE LEE- CARTER MODEL FOR MORTALITY

England and Wales population, parameter estimates, APC model: (a) females; (b) males

26

Page 27: NEW DEVELOPMENTS OF THE LEE- CARTER MODEL FOR MORTALITY

England and Wales population, parameter estimates, APC model:

(b) females; (b) males

27

Page 28: NEW DEVELOPMENTS OF THE LEE- CARTER MODEL FOR MORTALITY

Latest and projected xtlogμ age profiles:

28 (a) LC and AC modelling; (b) LC and APC modelling

Page 29: NEW DEVELOPMENTS OF THE LEE- CARTER MODEL FOR MORTALITY

Life expectations at age 65 for a range of periods, computed by period and by

29 cohort under age-period (LC) and age-period-cohort (APC) modelling

Page 30: NEW DEVELOPMENTS OF THE LEE- CARTER MODEL FOR MORTALITY

RISK MEASUREMENT AND PREDICTION INTERVALS • uncertainty in projections needs to be quantified i.e. by prediction

intervals • but analytical derivations are impossible • 2 different sources of uncertainty need to be combined

- errors in estimation of parameters of

Lee Carter model

- forecast errors in projected ARIMA model

• indices of interest (e.g. hazard rates, annuity values, life

expectancies) are complex non linear functions of , ,x tχα β κ and ARIMA parameters.

30

Page 31: NEW DEVELOPMENTS OF THE LEE- CARTER MODEL FOR MORTALITY

DIFFERENT SIMULATION STRATEGIES

A) Semi-parametric (Poisson) Bootstrap: generates new data sets

Let xd∧

be fitted number of deaths.

Simulate response ( )jxd from Poisson ( xd

)

Compute ( )jxμ

Fit model: obtain estimates of ( j ) ( j ) ( j )x x t, ,α β κ

Compute for ARIMA (0,1,0)n n

( j ) ( j )t k t

ˆˆ kκ κ θ+⎡ ⎤= +⎣ ⎦

Repeat for 1,...,j = Ν

31

Page 32: NEW DEVELOPMENTS OF THE LEE- CARTER MODEL FOR MORTALITY

DIFFERENT SIMULATION STRATEGIES (Continued)

C) Residuals Bootstrap: generates new data sets

Let xr be the deviance residuals

Sample with replacement to get ( )j

xr Map from ( )j

xr to ( )jxd for each x

Compute ( )j

xμ Fit Model: obtain estimates of ( j ) ( j ) ( j )

x x t, ,α β κ Compute for ARIMA (0,1,0)

n n

( j ) ( j )t k t

ˆˆ kκ κ θ+⎡ ⎤= +⎣ ⎦

Repeat for 1,...,j = Ν

32

Page 33: NEW DEVELOPMENTS OF THE LEE- CARTER MODEL FOR MORTALITY

DIFFERENT SIMULATION STRATEGIES (Continued)

B) Parametric Monte Carlo Simulation: generates new parameter

estimates from fitted parameter estimates Simulate ) vector of e ( j (0,1)Ν errors

CLet be the Cholesky factorisation matrix of the variance- covariance matrix (needs to be invertible) Compute simulated model parameters

θ θ ϕ= +( j ) ( j )ˆ C e

where ϕ is optional scale parameter Compute

n

( j )t kκ +

Repeat for 1,...,j = Ν 33

Page 34: NEW DEVELOPMENTS OF THE LEE- CARTER MODEL FOR MORTALITY

JOINT MODELLING Attempt to model variable dispersion parameter (rather than fixed ϕ) 2 stage process (LG model)

1. Model xtD as independent Poisson response

Define { }

)(E)(E 2

xt

xtxtxtxt D

DDR

−ω= the resulting squared Pearson residuals

2. Define xtR as independent gamma responses { } ( ) 2V;

)(EV)(Var,)(E uu

RR R

xt

xtxtxtxt =

ωτ=φ=

and log link and linear parametric structure in age.

34

Page 35: NEW DEVELOPMENTS OF THE LEE- CARTER MODEL FOR MORTALITY

NEGATIVE BINOMIAL MODELLING

Extend Poisson model (with no scale parameter 1ϕ = )

35

Variance function in GLM becomes:

2( ) xV u u u= +λ

Page 36: NEW DEVELOPMENTS OF THE LEE- CARTER MODEL FOR MORTALITY

36

Page 37: NEW DEVELOPMENTS OF THE LEE- CARTER MODEL FOR MORTALITY

37

Page 38: NEW DEVELOPMENTS OF THE LEE- CARTER MODEL FOR MORTALITY

38

Page 39: NEW DEVELOPMENTS OF THE LEE- CARTER MODEL FOR MORTALITY

39

Page 40: NEW DEVELOPMENTS OF THE LEE- CARTER MODEL FOR MORTALITY

40

Page 41: NEW DEVELOPMENTS OF THE LEE- CARTER MODEL FOR MORTALITY

41

Page 42: NEW DEVELOPMENTS OF THE LEE- CARTER MODEL FOR MORTALITY

42

FINAL COMMENT

• Other approaches to prediction intervals for Lee-Carter models – Bayesian methods

• Adding simulation techniques to APC model

• Extreme ages – extrapolation methods needed where data are

scarce

• Problems with forecasting structural changes

• Time series methods and their application to long forecasting periods

Page 43: NEW DEVELOPMENTS OF THE LEE- CARTER MODEL FOR MORTALITY

FINAL COMMENT (continued)

• Effect of xβ on smoothness of projected age profiles: need for smoothing of estimates

• Assessing performance of forecasting methods.

• Quality of data sources and appropriateness for particular

applications: “basis risk”.

• Model error – essential to investigate more than one modelling framework.

• Sources of uncertainty – process, parameter, model, judgement. Not

all sources of uncertainty can be quantified.

43

Page 44: NEW DEVELOPMENTS OF THE LEE- CARTER MODEL FOR MORTALITY

44

REFERENCES

Booth, H, (2006) Demographic Forecasting: 1980 to 2005 in review. International Journal of Forecasting, 22, 547-581. Booth, H, Maindonald, J. and Smith, S. (2002) Applying Lee-Carter under conditions of Variable mortality decline. Population Studies, 56, 325-336. Brouhns, N., Denuit, M. and Vermunt, J.K. (2002a) A Poisson log-bilinear regression approach to the construction of projected life-tables. Insurance: Mathematics and Economics 31, 373-393. Brouhns, N., Denuit, M. and Vermunt, J.K. (2002b) Measuring the longevity risk in mortality projections. Bulletin of the Swiss Association of Actuaries, 105-130. Brouhns, N., Denuit, M. and van Keilegom, I. (2005). Bootstrapping the Poisson log-bilinear model for mortality forecasting. Scandinavian Actuarial Journal, 3, 212 – 224. Davison, A. and Hinkley, D. (2006). Bootstrap methods and their applications. Cambridge University Press. Delwarde, A., Denuit, M. and Partrat, C. (2007). Negative binomial version of the Lee-Carter model for mortality forecasting. Applied Stochastic Models in Business and Industry 23, 385 – 401. Denuit, M. (2007). Distribution of the random future life expectancies in log-bileniear mortality projection models. Lifetime Data Analysis 13, 381-397. Denuit, M., Haberman, S. and Renshaw, A. (2008). A note on the distribution of random future life expectancies in Poisson log-bilinear mortality projections. In preparation.

Page 45: NEW DEVELOPMENTS OF THE LEE- CARTER MODEL FOR MORTALITY

45

REFERENCES (continued)

Haberman, S. and Renshaw, A. (2008). On simulation-based approaches to risk measurement in mortality with specific reference to binomial Lee-Carter modelling. Presented to Society of Actuaries’ Living to 100 Symposium. Orlando, Florida, USA. Koissi, M-C., Shapiro, A.F. and Hognas, G. (2006). Evaluating and extending the Lee-Carter model for mortality forecasting: Bootstrap confidence intervals. Insurance Mathematics and Economics, 38, 1 – 20. Lee, R.D. (2000) The Lee-Carter method of forecasting mortality, with various extensions and applications (with discussion). North American Actuarial Journal 4, 80-93. Lee, R.D. and Carter, L.R. (1992) Modelling and forecasting the time series of U.S. mortality (with discussion). Journal American Statistics Association, 87, 659-671. Li, S-H, Hardy, M and Tan, K. (2006). Uncertainty in mortality forecasting: an extension to the classical Lee-Carter approach. University of Waterloo working paper. Pitacco, E. Denuit, M., Haberman, S and Olivieri A-M (2008). Modelling longevity dynamics for pensions and annuity business. Oxford University Press. In preparation. Renshaw, A.E. (1992). Joint modeling for actuarial graduation and duplicate policies. Journal of Institute of Actuaries 119, 69 – 85. Renshaw, A.E. and Haberman, S. (2003a) Lee-Carter mortality forecasting: a parallel generalised linear modelling approach for England and Wales mortality projections. Applied Statistics, 52, 119-137. Renshaw, A.E. and Haberman, S. (2003b) On the forecasting of mortality reduction factors. Insurance: Mathematics and Economics 32, 379-401.

Page 46: NEW DEVELOPMENTS OF THE LEE- CARTER MODEL FOR MORTALITY

46

REFERENCES (continued)

Renshaw, A.E. and Haberman, S. (2003c) Lee-Carter mortality forecasting with age specific enhancement. Insurance: Mathematics and Economics 33, 255-272. Renshaw, A.E. and Haberman, S. (2006). A cohort-based extension to the Lee-Carter model for mortality reduction factors. Insurance: Mathematics and Economics 38, 556-570. lllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllll Renshaw, A.E. and Haberman, S. (2008). Simulation-based approaches to risk measurement in mortality with specific reference to Poisson Lee-Carter modelling. Insurance: Mathematics and Economics. To appear. Tuljapurkar, S., Li, N. and Boe, C. (2000) A universal pattern of mortality decline in the G7 countries. Nature, 405, 789-792. Wilmoth, J.R. (1993) Computational methods for fitting and extrapolating the Lee-Carter model of mortality change. Technical Report. Dept. of Demography, University of California, Berkeley.