better measurements - harvard university
TRANSCRIPT
BETTER MEASUREMENTS:RISK REPORTING FOR PUBLIC PENSION PLANS
September 21, 2018 Taubman Building, 5th Floor Harvard Kennedy School Cambridge, MA
INTRODUCTION
Last October, the Mossavar-Rahmani Center for Business & Government
at the Harvard Kennedy School held a conference on the “Gathering
Storm: The Risks of State Pension Underfunding.”
One of the important conclusions from this conference was the difficulty
of measuring risk at public pension plans in a way understandable to
multiple audiences. Equally difficult is comparing various plans each
using different yardsticks.
Today’s conference is designed to plumb these questions further.
In particular:
• What are the objectives of measurement?
• What is the current state of play?
• Can we agree on a uniform set of best practices?
The Mossavar-Rahmani Center for Business & Government is pleased
to bring increased focus to the problem.
We are grateful to our colleagues who have formal roles in the program,
to those joining us as guests, to Bob Stein and Greg Mennis who helped
design the program and to The Pew Charitable Trusts whose support
has helped make this conference possible.
Roger B. Porter
Co-chair, Better Measurements Conference
IBM Professor of Business and Government, Harvard Kennedy School
Thomas J. Healey
Co-chair, Better Measurements Conference
Senior Fellow, Mossavar-Rahmani Center for Business & Government, Harvard Kennedy School
AGENDA
9:00 am Breakfast
9:30 am Goal of Conference and Statement of Problem
Thomas J. Healey Senior Fellow, Mossavar-Rahmani Center for Business and Government, Harvard Kennedy School
9:45 am Session I: Objectives of Measurement What do users of information need to improve decision making?
1
Moderator: Robert SteinErnst & Young Partner (retired) and Chair of the SOA Blue Ribbon Panel on Public Pensions
Budget Expert: Benjamin BarnesSecretary of the State of Connecticut, Office of Policy and Management
Academic: Donald J. BoydFellow, Lincoln Institute of Land Policy and Senior Research Fellow at the Center for Policy Research, Rockefeller College, University at Albany
Professional Organization: John HicksExecutive Director, National Association of State Budget Officers
Public Policy Expert: Keith BrainardResearch Director, National Association of State Retirement Administrators
Actuarial Practitioner: Gene KalwarskiCEO and Co-Founding Partner, Cheiron, Inc.
Rating Agency: Todd TauzerDirector, Municipal Pensions, S&P Global Ratings
Poll #2: What information do we need?
Poll #1: What are the major risks?
11:30 am Break
11:45 am Session II: Current State of Play
12:45 pm Lunch
2
AGENDA (continued)
Moderator: Robert R. GlauberLecturer, Harvard’s Kennedy School of Government and Visiting Professor, Harvard Law School
Governmental Accounting Standards Board (GASB): Dean Michael MeadSenior Research Manager and Coordinator, Governmental Accounting Standards Advisory Council (GASAC)
Actuarial Standards Board (ASB): Kathleen A. RileySenior Vice President and Actuary, Segal Consulting
Blue Ribbon Panel: Robert SteinErnst & Young Partner (retired), Chair of the SOA Blue Ribbon Panel on Public Pensions
Plan Sponsor: Robert A. WylieExecutive Director, South Dakota Retirement System
1:45 pm Session III: Can We Agree on a Uniform Set of Best Practices?
3:15 pm Conclusion and Going Forward
3
Grid of Approaches to Measuring Risk: Greg MennisDirector, Public Sector Retirement Systems, The Pew Charitable Trusts
Roger B. PorterIBM Professor of Business and Government at Harvard University
Strawman on Risk Reporting: David DraineSenior Officer, Public Sector Retirement Systems, The Pew Charitable Trusts
Moderator: Robert SteinErnst & Young Partner (retired), Chair of the SOA Blue Ribbon Panel on Public Pensions
Poll #3: Methods and Applications of Risk Reporting
Poll #4: Measurements of Risk Reporting
Poll #5: Group Discussion: Do we want standardization and accountability?
PARTICIPANTS
Jean-Pierre Aubry Boston College
Susan Banta The Pew Charitable Trusts
Benjamin Barnes State of Connecticut, Office of Policy and Management
Andrew Biggs American Enterprise Institute for Public Policy Research
Donald Boyd Lincoln Institute of Land Policy and the Center for Policy Research, Rockefeller College, University at Albany
Keith Brainard National Association of State Retirement Administrators
Alex Brown University of Illinois
Allan S. Bufferd Massachusetts Institute of Technology
Michael Clowes Pensions & Investments
Matthew Cook Laura and John Arnold Foundation
David Crane Stanford University
David Draine The Pew Charitable Trusts
Brenna Erford Laura and John Arnold Foundation
Teresa Ghilarducci New School in New York
Leonard Gilroy Pension Integrity Project, Reason Foundation
Robert Glauber Harvard Kennedy School
Josh Gotbaum The Brookings Institution
Thomas J. Healey Harvard Kennedy School
John Hicks National Association of State Budget Officers
Sarah Jones The Pew Charitable Trusts
Gene Kalwarski Cheiron, Inc.
Emily Kessler Society of Actuaries
David Knapp Rand Corporation
Scott Leland Harvard Kennedy School
Dean Michael Mead Governmental Accounting Standards Advisory Council (GASAC)
4
Greg Mennis The Pew Charitable Trusts
Charles E. F. Millard Kiski Group, Inc.
Douglas Offerman Fitch Ratings
Roger Porter Harvard Kennedy School
Robert Pozen Massachusetts Institute of Technology
Laura Quinby Boston College
Kathy Riley Segal Consulting
Jay Rosengard Harvard Kennedy School
Devjani Roy Texas Tech University Health Sciences Center
Brian Septon The Terry Group
Scott Shepard Yankee Institute
Alec Stais State of Rhode Island
Bob Stein SOA Blue Ribbon Panel on Public Pensions
Eugene Steuerle Urban Institute
Todd N. Tauzer S&P Global Ratings
Marcia Van Wagner Moody’s Investors Service
Rob Wylie South Dakota Retirement System
Yimeng Yin Rockefeller Institute of Government
Support for this conference was provided in part by The Pew Charitable Trusts
BATTEN WAY
RADCLIFFEQUADRANGLE
QuincyHouse
HOLY
OKE
ST
TRAY
MO
RE S
T
Gate 8
Washburn
Johnston Gate
Riverside Press Park
ALLSTON LANDING NORTH
BEACON STREET
OXF
OR
D ST
MAS
SACH
USE
TTS
AVEN
UE
CAMBRIDGE STREET
KIRKLAND STREET
MOUNT AUBURN STREET
PUTN
AM
AVE
MEMORIAL DRIVE
RIVER STREET
WESTERN AVENUE
WESTERN AVENUE
SOLDIERS FIELD RD
MOUNT AUBURN STREET
GARDEN ST
BRATTLE STREET
CONCORD AVE
LINNAEAN STREET
GARDEN ST
SOLD
IERS
FIEL
D RO
AD
SOLD
IERS FIELD RO
AD
MASSACHUSETTS AVENUE
JOHN
F. K
ENNE
DY S
TREE
T
HARVARD STREET
OXFO
RD ST
MAS
SACH
USE
TTS
AVEN
UE
l
e
s
R i v e r
a
C
h
r
GR. SCHOOLOF
EDUCATION
MOUNT AUBURN STREET
ELIOT BRIDGE
NORT
H
ANDREW ST
FAIR
MONT AVE
O'Donnell Field
Ohiri Field
Hoyt Field
Bunting Quadrangle
Baldwin School
Sacramento Field
IRVI
NG
STR
EET
TRO
WB
RID
GE
STRE
ET
SPA
RKS
STR
EET
HUBBARD
HEMLOCK ROAD
WYMAN ROAD
BEACON STREET
KEN
T ST
REET
SACR
AMEN
TOST
REET
CONCORD AVENUE
GARDEN STREET
REVE
RE
PLGERR
Y ST
REET
ASH STREET PL
MORGAN WAY
SOLD
IER
S FI
ELD
ROAD
RIVE
RDAL
EST
REET TRAVIS STREET
HO
LMES
STR
EET
KINGSLEY STREET
WESTERN AVENUE
SPUR STREETBERTRAMHA
RVAR
DST
REET
STREET
NORT
H HARV
ARD S
TREE
T
GORDON ROAD
ASH
STR
EET
CAM
DEN
PL
SHA
LER
LANE
MEMORIAL DRIVE
ROAD
MEMORIAL DRIVE
SOLDIERS
FIELD
BREW
ER S
TREE
T
ASH
STRE
ET
ROSS ST
CHAPMAN PL
BRATTLE STREET
BRO
WN
STRE
ET
DINSMORE CT
PARKER STREET
PARK ROAD
FOSTER STREET
MAY
NAR
D PL
KENWAY STREETSIBLEY CT
SPA
RKS
STR
EET
FOST
ER P
L
BRADBURY STREET
FOSTER STREET
MERCER
CIRC
LE
BREWSTER STREET
RIEDESEL AVENUE
SPARKS STREET
BUCKINGHAM PLBUCK
INGHA
M STREET
HASTINGS AVENUE
WIL
LARD
STR
EET
ACACIA STREET
HAW
THO
RN S
TREE
T
ST. JOHN'S ROAD
BERKELEY PLACE
CRAIGIE STREET
CRAIGIE CIR.
BERKELEY STREET
WEST
MADISON S
TREET
STREET
HOLLY AVENUE
MANASSAS AVENUE
HEALEY STREET
STREET
BUCK
ING
HAM
TIERNEY
KELLEY STREET
STREET
GRAY GARDENS
GARDEN
STREET
BOND
GARDEN TER
FERNALD DRIVE
ROBINSON STREET
EAST
GRAYGARDENS
HURON AVENUE
CENTRE STREET
GRANT STREET
FRANKLIN STREET
PLEA
SANT STR
EETWESTERN AVENUE BRIDGE
COWPERTHWAITE STREET
STREET
ROTTERDAM
HAG
UE STREET
WESTERN AVENUE
HARVARD WAY
SOLDIERS FIELD ROAD
GILM
ORE ST
BANC
RO
FT ST
MEM
OR
IAL
DRIV
E
HOW
AR
D STREET
RIVE
RSID
E PL
PUTN
AM
AVENUE
BLAC
KSTON
E STREET
MO
NTAG
UE STREET
BALLORD ST
KELLEY ROAD
LAUREL STREET
JAY STREET
HEW
S ST
REET
BANK
S ST
REET
HINGHAM STREET
AKRON STREET
ELM
ER S
TREE
T
PUTN
AM
AVE
NUE
FLAGG STREET
MEM
OR
IAL DRIVE
WA
LKER
CT
FALLON PL
GREEN ST
SURREY STREET
BANK
S ST
REET
PUTN
AM
AVE
NUE
HOW
AR
D STREET
CALLENDER
STRE
ETDO
DGE
STREET
STREET
HAYES STREET
JAY STREET
MAGEE
BAY
STRE
ET
KINNAIRD STREET
FRANKLIN STREET
GREEN STREET
HANCOCK STR
EET
ADAMS TERRACE
KIRKLAND STREET
HOLDEN STREET
SCOTT STREET
ELLE
RYST
REET
HARVARD STREET
WALKER STREET
PLYM
PTO
N ST
REET
FARWELL PLACE
PEA
BO
DY
STRE
ET
WINTHROP STREET
UNIVERSITY
ROAD
MEMORIALDRIVE
ELIOT STREET
BENNETT STREET
STORY STREET
NUTT
ING
ROAD
HILLIARD STREET
PL
HILLIARD
FULLER PL.
MIFFLIN PLACE
BRATTLE STREET
LIN
DEN
STR
EET
MILL STREET
WINTHROP STREET
SOUTH STREET Holyoke Plac
e
PALM
ER STREET
STREETCHURCH
DUNS
TER
STR
EET
PLYM
PTO
N ST
REET
BERKELEY STREET
JAM
ES STREET
PLACE
PHILLIPS
MASON STREET
APPIAN W
AY
GARDEN STREET
CONCORD AVENUE
CHAUNCY STREET
WATERHOUSE STREET
FOLLEN STREET
MASSA
CHU
SETTS AVENUE
CAMBRIDGE
MASSA
CHU
SETTS AVENUE
STREET
EVERETT STREET
PRES
CO
TT S
T.
ARROW STREET
MOUNT AUBURN STREET
DE W
OLF
E ST
REET
BOW STREET
BOW
STREET
REMINGTON
STRE
ET
ATH
ENS
STRE
ET
ATHENS TER
QU
INC
Y ST
REET
PRES
CO
TT S
TREE
T
BROADWAY
ELLE
RY S
TREE
T
TRO
WBR
IDGE
STR
EET
DANA
STR
EET
CLEVELAND STREETELLE
RY S
TREE
T
WA
RE
STRE
ET
TROWBRIDGE PL
STRE
ET
FELT
ON
BROADWAY
KIRKLA
ND PLACE
DIVINITY AVENUE
SUM
NER
RO
AD
IRVING TERRACE
ASHTON PL
KIR
KLAN
DRD
IRVIN
G STREET
FRAN
CIS AVENUE
BRYANT STREET
FARRAR STREET
SCOT
T ST
REET
QU
INC
Y ST
REET
SHEPARD STREET
HURLBUT ST
HUDSON
AVON STREET
SHEPARD STREET
WALKER STREET
STRE
ET
LANGDON
RUTL
AND
WRIG
HT STREET
BOW
DOIN STREET
MARTIN STREET
GRAY STREET
MELLEN STREET
STREET
STREET
WENDELL STREET
MARTIN ST
GARFIELD STREET
SAC
RAM
ENTO
PL
CARVER STREET
MUSEUM STREET
GO
RHAM
STREET
OXF
OR
D S
TREE
T
HAMMOND STREET
SACRAMENTO STREET
HOW
LAND
HAMMOND STREET
WENDELL STREET
STREET
EUSTIS STREET
CRESCENT STREET
ARCA
DIA
ST HARRIS STREET
IRVING ST
FRANCIS AVENUE
KENT COURT
GA
RDEN
CO
URT
GIB
SON
STRE
ET
ROYA
L AV
ENUE
DONN
ELL
STRE
ET
RIVER STREET
CHALK STREET
Currier House
Pforzheimer House
Cabot House
St. John'sChapel
William F. SmithPlayground
Beren Tennis Center
Charles RiverReservation
SOLDIERS FIELDATHLETIC AREA
McCurdy Track
Holy Trinity ArmenianApostolic Church
Longfellow HouseWashington's Headquarters
Long
fellow
Par
k
FriendsMeeting House
Buckingham Browne &Nichols School
St. Peter'sSchool
LeverettHouse
Corporal BurnsPlayground
CSX EasementSanofi Genzyme
Peabody Terrace
MatherHouse
DunsterHouse
HARVARDDIVINITY SCHOOL
Adams House
HARVARD YARD
HarvardLampoon
Coop Annex
Brattle Square
U.S. Post Office
Unive
rsity
Gree
n One
Brattle S
quare
Brattle H
ouse
Brattle T
heatreHarvardSquare
The Garage
Coop
First Church
Unitarian
Presidents' Graves
WinthropHouse
Cambridge Common
Church ofChrist,
Scientist
Christ ChurchEpiscopal
First Church
Congregational
Sheraton-CommanderHotel
Radcliffe Yard
Longy Schoolof Music
Dawes Island
Harvard-Epworth UnitedMethodist Church
HARVARDLAW SCHOOL
Sullivan Square
St. P
aul
Chur
ch
Crimson
Old C
ambr
idge
Bapti
st Ch
urch
CambridgePublic Library
CambridgeRindge & Latin School
CambridgeFire HQ
Church ofNew Jerusalem
GR. SCHOOLOF DESIGN
Maria L.
Lesley University-Doble Campus
Graham &
Parks
School
American Academy ofArts & Sciences
KirklandHouse
Galeria
J.F.K. Park
Charles Square
EliotHouse
Unive
rsity
Plac
e
Charles Hotel
Har
vard
Squ
are
Hote
l
University LutheranChurch
LowellHouse
TercentenaryTheatre
Church of Jesus Christof Latter-Day Saints
Charles River ReservationCanoe/Kayak
Gate 20
Gate 14
Sherrill
ANDE
RSON
MEM
ORIA
L BR
IDGE
RADCLIFFE INSTITUTE
RiversideCityPark
Cumnock Field
HARVARDJOHN A. PAULSON
SCHOOL OF ENGINEERINGAND APPLIED SCIENCES
HARVARD BUSINESSSCHOOL
Lesley University-Brattle Campus/Episcopal Divinity School
Joan Lorentz Park
Old Yard
MEA
DST
REET
2
4
Farkas
SoldiersFieldPark
Garage
BRI
Biological Labs
New Quincy
Ston
e H
all
OEBGreen House
38 Oxford
Hilles
Andover-Harvard
Theological Library
LISE
CGISSouth
CGISKnafel
59
11
52 Oxford StreetGarage
16
153-155
Warren
18
Teele
25
113
3436
38
40
Entry
Jordan South
Pavilion
One
Wes
tern
Ave
.
124
Bauer
Lab
60 O
xfo
rd
Haw
es
23-25
Comstock
Moors
Cron
khite
Barnard
Briggs Hall
Shad
Blodget
tPo
olCo
tting
NewellBoat House
175
Bright-Landry
Hockey Center
Murr Center
Dillon FieldHouse
LavietesPavilion
Harva
rd St
adiu
m
Shal
er L
ane
Bingham
Gilbert
21
DanielsQuadrangle
Athletic Center
Tuchman
Faculty Row
Kittredge
Holmes
D
Observatory
E
B
Perk
in L
ab
A
C
17
McCulloch
Dean's House
Greenhill
Chase
Class of1959 Chapel
CentralReceiving
Cum
nock
Burden
Dillon
Ludc
ke
Morris
Loeb
Hamilton
Gallatin
Mellon
Wild
er Glass
Weld
Boat House
McArthur
Soldiers Field Park
McC
ollu
m
Morgan
Aldrich
381-383
Garage
41-43
8
12-1
2.5
6.5Leverett Towers
ApthorpHouse
Thay
erPe
rkin
s
Music
Building
Russ
ell
Wigglesworth
HarvardLoeb Drama
Center
Smith
Hicks Advo
cate
Littauer
79
Taubman
Belfer
126
53A53
UniversityHealthServices
Standish
60
17-19Bryan
69
78
Info
Ctr
32-42
26-28
5-7
1306
51
4-12
14
90-92
53
71-77
41
65-67
52-54
101
65
65R
74Randolph
LehmanDudley House
Stra
us
Wadsworth
Grays
Wel
d
Man
ter
ApleyCourtArt Studios
Mat
thew
s
Buckingham
Putnam
83
Alumnae
Nichols
Read
20
Sto
ry
Westengard
Knafel
Center
Schlesinger
Gree
nlea
f
Agassiz
Fay
University Police1033
29
Hastings Lyman
Austin
Gannett
Hemenw
ay
Gym
Mow
er
Lion
el
Holden
PhillipsBrooks
Stou
ghto
n
Holli
s
Holworthy
Jefferson
Littauer Center
Paine
Baker Hall
Hauser
Hall
Cruft
Holmes
Shaw
Maxwell
Dworkin
Rich
ards
Dane
Am
es
Child
Griswold
Pierce
Hurlbut
33-351-2
4-6
3
9
8A
PuseyLibrary
Barker Ctr8
17 Quincy
7
16
18
15
17
19
Penny-packer
Broa
dway
Gara
ge
22
188-10
Westmorly
4-6
Loeb House
Dana-Palmer
Emerson
MortonPrince
8
9-13
A
Faculty Club
Carpenter Ctr
85-9
5
20-20A
472-474
22-24
Robinson
Houg
hton
Libr
ary
LamontLibrary
Seve
r
Gree
noug
h
Doebele House
27-29
Adolphus
Busch
9
AndoverHall
57
Vanserg
Shannon
1727
3
Converse
Sparks
Canaday
Lowell
Mallinckrodt
Conant
Lab
1746
34
Memorial HallAnnenberg HallSanders TheatreLoker Commons
McKay
Fairchild
Link
Naito
Cona
nt
2
Harvard
Semitic
Museum
EngineeringScience
Lab
Farlow
Lippmann
Haskins
13
7
11
Kirkland
Court
17
38
61
103
107
10 12
14-1
6
20
18-1
8A
23 27
5A
1705
53
Bertram
Eliot
Jordan North
Wolbach
Whitm
an
CabotHall
Terry Terrace
Rockefeller
Center for the Study
of World Religions
Palfrey56
Jewett
Beckwith Circ
le
WidenerLibrary
Univ
ersit
y
Science Center
Gutman
MalkinAthleticCenter
Clav
erly
HSA
Massachusetts
Richard A. and Susan F.Smith Campus Center
Gore
Blyth
McKinlock
Byerly
Longfellow
Larse
n
Areeda
Lewis
Pound
Langdell
Memorial Church
Divinity H
all
University
Herbaria
Hoffman Lab
Gund
Peabody Museum
Museum ofComparative
Zoology
MCZLab
Boylston
William
James
Nor
th H
all
Connell
Wys
s
Nor
thw
est
Build
ing
119 5
3
695
7
37
47
HarvardMuseum
of NaturalHistory
1637
10
28
30
387
3
Harvard
Dance Center
30
2
15
Bike Shelter
Harvard
Yenching
Library
46 Blackstone
Street
North
WestSouth
Spangler
Rock
BakerBloomberg
80
Clinical Wing
CaspersenStudent Center
WassersteinHall
DeW
olfe
St.
Hous
ing
Rube
nste
inFogg
Busch-ReisingerArthur M. Sackler
Arthur M.Sackler
Building
9
Wigglesworth
Botanic Gardens
20
4042
6
HarvardExtension School
135
210
28
1607
-161
5
9
1120
168
114-124
Batten
140-142
132
1201
182
134
204
1
1414
OneStory St
25
104
125
1430
8
Roso
vsky
Hall
10
Tata
50
The Plaza
Palmer Dixon
Strength &
Conditioning Center
Gordon Indoor Track
Zero
Arro
w
Wallach
Gard
en
Harvard Art Museums
KRE
SG
E W
AY
Burnham
26
BRATTLE STREET
HotelVeritas
ChabadHouse
at Harvard
Tozzer
102
Chao
10 Everett StreetGarage
Harvard
InnovationLab
CHSI
IVY LANE
SOUT
H C
AMPU
S DR
IVE
SOUTH CAMPUS DRIVE
Esteves Hall
Science and EngineeringComplex224
Harv
ard
Cera
mic
sHa
rvar
dEd
Por
tal
1100
Jordan Field
114
1280
20
Pagliuca
Harvard
Life Lab
JOHN W
. WEEKS B
RIDGE
44R
Roberto A.
Mignone Field
Klarman
Beren
Ofer
Wexner
September 2017
0 200 400 600 800100Feet
Harvard Non-InstitutionalHarvard Institutional
Non-Harvard
Buildings
Harvard UndergroundNon-Harvard (Leased Space)
Green
Public/OtherHarvard
HARVARDKENNEDY SCHOOL
Conference Location: Harvard Kennedy School Taubman Building, 5th Floor Cambridge, MA
Enter the Kennedy School’s Taubman building
and take the elevator to the 5th floor.
Parking: Charles Hotel Garage 1 Bennett Street
Harvard Square Parking Garage 20 Eliot Street
**
Administrative contacts: Victoria Groves, cell: 978-726-3621 Scott Leland, cell: 617-413-0249
*