democracy is a design problem
DESCRIPTION
Want to see a wicked problem? Just look at designing ballots. This is from a talk I gave in 2012 at UPA and ACM meetings around the country.TRANSCRIPT
Democracy is a design problemHow changes in design change the outcome of elections
Dana Chisnell
1
Democracy is a design problem
Design affects world peace.
Why voting is harder than it seems
8
Legislation9
Voting
10
Systems
Costs
In Maryland, cost per voter increased by 179% going from paper-based systems to touchscreens
11
Costs
Paper has costs, too
printing
postage
storage
12
History13
Skills14
There are 3,247 counties (or equivalent) in the US
Secretaries of state issue ballot templates
Counties design, print, and distribute ballots
There are many more elections every year than you realize
15
Voting is still hard
16
17
Poor ballot design
frustrates voters
undermines confidence
contributes to Election Day problems
18
All voters are affected
thousands of votes are lost or miscast
all voting technologies are affected
greater risk for some groups of voters
19
Instructions
Contests
Questions
splitting contests into different columns
placing different contests on the same screen
placing response options on both sides of names
using arrows rather than bubbles on paper ballots
leaving in disqualified candidates
20
Classic problems
Better Ballots: Re-designed Ballot, Kewaunee County
Keep contests in same column
Better Ballots: Sarasota County, FL (2006)
Better Ballots: Sarasota County, FL (2006)
Better Ballots: Sarasota County, FL (2006)
inconsistency in format and style
not using shading, bold text
not writing short, simple instructions
placing instructions too far away
not telling voters how to correct paper ballots
25
Classic problems
Better Ballots: Los Angeles County
Format consistently
Top 10 design principles
27
Use lowercase letters
Avoid centered text
Pick one sans-serif font
Use big enough type
Support process and navigation
Use clear, simple language
Use accurate instructional illustrations
Use informational icons (only)
Use contrast and color functionally
Decide what’s most important
Before and after
28
Cedar County: May 2006 for ES&S optical scanners
Cedar County: November 2006 for ES&S optical scanners
TEST BALLOTGENERAL ELECTIONNOVEMBER 4, 2008
MARIN COUNTY, CALIFORNIAINSTRUCTIONS TO VOTERS:• Use only the marking pen provided, or a ball-point pen with black ink.• To vote for a candidate, completely blacken the oval next to your choice, like this . Do not vote for more than the
number of candidates to be elected.• When there are two (2) or more candidates to be elected for the same office, blacken the ovals next to each of your choices.• To vote on a measure, blacken the oval next to the word YES or next to the word NO.• Write-in candidates: To vote for a qualified write-in candidate, blacken the oval next to the blank line for the office and write
the name of the person on the line. Do not vote for both a write-in candidate and a candidate whose name is on the ballot for the same office.
• All distingushing marks on the ballot are forbidden and void the ballot.• If you make a mistake, tear your ballot, or want to change your vote, return it to the election official and obtain another.
VOTE ON BOTH SIDES OF BALLOT
FEDERAL
BOB BARR WAYNE A. ROOT
Libertarian
JOHN MCCAIN SARAH PALIN
Republican
CYNTHIA MCKINNEY ROSA CLEMENTE
Green
ALAN KEYES WILEY S. DRAKE, SR.
American Independent
RALPH NADER MATT GONZALEZ
Peace And Freedom
BARACK OBAMA JOE BIDEN
Democratic
PRESIDENT AND VICE PRESIDENTVote for One Party (1)
JOEL R. SMOLEN Registered Investment Advisor
Libertarian
MIKE HALLIWELL College Professor
Republican
LYNN WOOLSEY U.S. Representative
Democratic
UNITED STATES REPRESENTATIVE, 6TH DISTRICT
Vote for One (1)
STATE
MARK LENO California State Legislator
Democratic
SASHI MCENTEE Small Business Consultant
Republican
STATE SENATOR, 3RD DISTRICTVote for One (1)
PAUL LAVERY Businessman/Father
Republican
JARED HUFFMAN Incumbent
Democratic
TIMOTHY J. HANNAN Attorney/Mediator/Arbitrator
Libertarian
MEMBER OF THE STATE ASSEMBLY,6TH DISTRICT
Vote for One (1)
DISTRICT
ARCHIMEDES RAMIREZ NeurosurgeonPETER CHRISTIAN ROMANOWSKY Minister/Entertainer/ArtistHARRIS (HANK) SIMMONDS Retired PhysicianSHARON J. JACKSON IncumbentFRANK PARNELL Physician/Businessman
MARIN HEALTHCARE DISTRICT, DIRECTOR
Vote for no more than Two (2)
MEASURES SUBMITTEDTO THE VOTERS
STATE
YES NO
PROPOSITION 2: STANDARDS FOR CONFINING FARM ANIMALS. INITIATIVE STATUTE. Requires that certain farm animals be allowed, for the majority of every day, to fully extend their limbs or wings, lie down, stand up and turn around. Limited exceptions apply. Fiscal Impact: Potential unknown decrease in state and local tax revenues from farm businesses, possibly in the range of several million dollars annually. Potential minor local and state enforcement and prosecution costs, partly offset by increased fine revenue.
YES NO
PROPOSITION 1A: SAFE, RELIABLE HIGH-SPEED PASSENGER TRAIN. To provide Californians a safe, convenient, affordable, and reliable alternative to driving and high gas prices; to provide good-paying jobs and improve California’s economy while reducing air pollution, global warming greenhouse gases, and our dependence on foreign oil, shall $9.95 billion in bonds be issued to establish a clean, efficient high-speed train service linking southern California, the Sacramento/San Joaquin Valley, and the San Francisco Bay Area, with at least 90 percent of bond funds subject to independent audits? Fiscal Impact: State costs of $19.4 billion, assuming 30 years to pay both principal and interest costs of the bonds. Payments would average about $647 million per year. When constructed, unknown operation and maintenance costs, probably over $1 billion annually; at least partially, and potentially fully, offset by passenger fares.
YES NO
PROPOSITION 3: CHILDREN’S HOSPITAL BOND ACT. GRANT PROGRAM. INITIATIVE STATUTE.Authorizes $980,000,000 in general obligation bonds for construction, expansion, remodeling, renovation, furnishing and equipping of eligible children’s hospitals. Fiscal Impact: State cost of about $2 billion over 30 years to pay off both the principal ($980 million) and interest ($933 million) costs of the bonds. Payments of about $64 million per year.
YES NO
PROPOSITION 4: WAITING PERIOD AND PARENTAL NOTIFICATION BEFORE TERMINATION OF MINOR’S PREGNANCY. INITIATIVE CONSTITUTIONAL AMENDMENT. Changes California Constitution, prohibiting abortion for unemancipated minor until 48 hours after physician notifies minor’s parent, legal guardian, or, in limited cases, substitute adult relative. Provides an exception for medical emergency or parental waiver. Fiscal Impact: Potential unknown net state costs of several million dollars annually for health and social services programs, court administration, and state health agency administration combined.
YES NO
PROPOSITION 5: NONVIOLENT DRUG OFFENSES. SENTENCING, PAROLE AND REHABILITATION. INITIATIVE STATUTE. Allocates $460,000,000 annually to improve and expand treatment programs. Limits court authority to incarcerate offenders who commit certain drug crimes, break drug treatment rules or violate parole. Fiscal Impact: Increased state costs potentially exceeding $1 billion annually primarily for expansion of offender treatment programs. State savings potentially exceeding $1 billion annually on corrections operations. Net one-time state prison capital outlay savings potentially exceeding $2.5 billion.
FRONT Card 1 RptPct 1001-1100 "0001100" FOR PROOF ONLY 08/29/08 12:41:52
NOVEMBER 4, 2008MARIN COUNTY, CALIFORNIA
INSTRUCTIONS TO VOTERS:• Use only the marking pen provided or a ball point pen with black ink.
• To vote for a candidate, completely blacken the oval to the left of the name, like this . Where two or more candidates for the same office are to be elected, blacken the oval to the left of each of your choices.
• To vote on a measure, completely blacken the oval next to YES or NO.
• To vote for a qualified write-in candidate, completely blacken the oval next to the blank line for that office and write the name of the person on the line.
• If you make a mistake, damage your ballot, or you want to change a vote, take your ballot to an election worker and get another. All distinguishing marks are forbidden and void the ballot.
FEDERAL
BOB BARR WAYNE A. ROOT
Libertarian
JOHN MCCAIN SARAH PALIN
Republican
CYNTHIA MCKINNEY ROSA CLEMENTE
Green
ALAN KEYES WILEY S. DRAKE, SR.
American Independent
RALPH NADER MATT GONZALEZ
Peace And Freedom
BARACK OBAMA JOE BIDEN
Democratic
PRESIDENT AND VICE PRESIDENTVote for One Party (1)
JOEL R. SMOLEN Registered Investment Advisor
Libertarian
MIKE HALLIWELL College Professor
Republican
UNITED STATES REPRESENTATIVE, 6TH DISTRICT
Vote for One (1)
DISTRICT
ARCHIMEDES RAMIREZ NeurosurgeonPETER CHRISTIAN ROMANOWSKY Minister/Entertainer/ArtistHARRIS (HANK) SIMMONDS Retired PhysicianSHARON J. JACKSON IncumbentFRANK PARNELL Physician/Businessman
MARIN HEALTHCARE DISTRICT, DIRECTOR
Vote for no more than Two (2)
MEASURES SUBMITTEDTO THE VOTERS
STATEPROPOSITION 1A: SAFE, RELIABLE HIGH-SPEED PASSENGER TRAIN BOND ACT.
PROPOSITION 3: CHILDREN’S HOSPITAL BOND ACT. GRANT PROGRAM. INITIATIVE STATUTE.Authorizes $980,000,000 in general obligation bonds for construction, expansion, remodeling, renovation, furnishing and equipping of eligible children’s hospitals.Fiscal Impact: State cost of about $2
YES NO
PROPOSITION 2: STANDARDS FOR CONFINING FARM ANIMALS. INITIATIVE STATUTE. Requires that certain farm animals be allowed, for the majority of every day, to fully extend their limbs or wings, lie down, stand up and turn around. Limited exceptions apply.Fiscal Impact: Potential unknown decrease in state and local tax revenues from farm businesses, possibly in the range of several million dollars annually. Potential minor local and state enforcement and prosecution costs, partly offset by increased fine revenue.
ProgressLessons from crises
Sarasota
34
No testing = lost votesKing Co. 2009 undervotes were disproportionate to other counties
resulted in legislation about ballot design
35
Ensuring franchiseMinnesota SoS tests vote-by-mail after 2008 senate recounts
Before
Ensuring franchiseMinnesota SoS tests vote-by-mail after 2008 senate recounts
After
DEMONSTRATION BALLOTSAMPLE BALLOT FOR THE GENERAL ELECTION - City of New York - County of Kings - November 2, 2010
1. BEFORE VOTING THIS BALLOT, PLEASE READ THE INSTRUCTIONS ON THE OTHER SIDE OF THIS BALLOT.
1. ANTES DE EMITIR SU VOTO CON ESTA PAPELETA, SÍRVASE LEER LAS INSTRUCCIONES EN EL DORSO DE ESTA PAPELETA.
2. BALLOT PROPOSALS ARE LOCATED ON THE OTHE SIDE OF THIS BALLOT.
2. LAS PROPUESTAS DE PAPELETA APARECEN EN EL DORO DE ESTA PAPELETA.
MARKINGINSTRUCTIONS:INSTRUCCIONESDE MARCADO:
Correct Mark:Marca Correcta:
[Insert Chinese Translation][Insert Korean Translation]
Electors forGovernor and
LieutenantGovernor
[Spanish]
[Chinese]
[Korean]
Vote OnceVote una vez
[Chinese][Korean]
Comptroller[Spanish][Chinese][Korean]Vote Once
Vote una vez[Chinese][Korean]
Attorney General[Spanish][Chinese][Korean]Vote Once
Vote una vez[Chinese][Korean]
United StatesSenator
[Spanish][Chinese][Korean]Vote Once
Vote una vez[Chinese][Korean]
United StatesSenator
[Spanish][Chinese][Korean]Vote Once
Vote una vez[Chinese][Korean]
Supreme CourtJustice
[Spanish][Chinese][Korean]
Vote for any FIVE[Spanish][Chinese][Korean]
Representative inCongress[Spanish][Chinese][Korean]Vote Once
Vote una vez[Chinese][Korean]
StateSenator
[Spanish][Chinese][Korean]Vote Once
Vote una vez[Chinese][Korean]
Member ofAssembly[Spanish][Chinese][Korean]Vote Once
Vote una vez[Chinese][Korean]
1
2
3
4
5
6
7
8
9
10
11
12
13
1A 1B 1C 1D 1E 1F 1G 1H
1K 1J 1I
2A 2B 2C 2D 2E 2F 2G
3G3F3E3D3C3B3A
4I4K 4J
4G4F4E4D4C4B4A
5A 5B 5C 5D 5E 5F 5G
6E6D6C6B6A
7A 7B 7C 7D 7E
8E8D8C8B8A
9E9D9C9B9A
10D10C10B10A
13D13C13B13A
12C12B12A
11C11B11A
4H
WRITE-INCANDIDATO POR
ESCRITO
WRITE-IN
WRITE-IN
WRITE-IN
WRITE-IN
WRITE-IN
WRITE-IN
WRITE-IN
WRITE-IN
WRITE-IN
WRITE-IN
WRITE-IN
WRITE-IN
WRITE-IN
A B C D E F G H
K J I
A B C D E F G
A B C D E F G
A B C D E F G H
K J I
A B C D E F G
EDCBA
A B C
CBA
DCBA
Democratic[Chinese][Korean]
Democratic[Chinese][Korean]
Democratic[Chinese][Korean]
Democratic[Chinese][Korean]
Democratic[Chinese][Korean]
Democratic[Chinese][Korean]
Democratic[Chinese][Korean]
Democratic[Chinese][Korean]
Democratic[Chinese][Korean]
Republican[Chinese][Korean]
Independence[Chinese][Korean]
Conservative[Chinese][Korean]
Working Families[Chinese][Korean]
Green[Chinese][Korean]
Rent is 2 DamnHigh
[Chinese][Korean]
Libertarian[Chinese][Korean]
Taxpayers[Chinese][Korean]
Freedom[Chinese][Korean]
Anti-Prohibition[Chinese][Korean]
Republican[Chinese][Korean]
Independence[Chinese][Korean]
Conservative[Chinese][Korean]
Working Families[Chinese][Korean]
Green[Chinese][Korean]
Libertarian[Chinese][Korean]
Republican[Chinese][Korean]
Independence[Chinese][Korean]
Conservative[Chinese][Korean]
Working Families[Chinese][Korean]
Libertarian[Chinese][Korean]
Freedom[Chinese][Korean]
Republican[Chinese][Korean]
Independence[Chinese][Korean]
Conservative[Chinese][Korean]
Working Families[Chinese][Korean]
Green[Chinese][Korean]
Rent is 2 DamnHigh
[Chinese][Korean]
Libertarian[Chinese][Korean]
Tax Revolt[Chinese][Korean]
Taxpayers[Chinese][Korean]
Anti-Prohibition[Chinese][Korean]
Republican[Chinese][Korean]
Independence[Chinese][Korean]
Conservative[Chinese][Korean]
Working Families[Chinese][Korean]
Green[Chinese][Korean]
Libertarian[Chinese][Korean]
Republican[Chinese][Korean]
Independence[Chinese][Korean]
Conservative[Chinese][Korean]
Working Families[Chinese][Korean]
Conservative[Chinese][Korean]
Working Families[Chinese][Korean]
Republican[Chinese][Korean]
Working Families[Chinese][Korean]
Republican[Chinese][Korean]
Conservative[Chinese][Korean]
Working Families[Chinese][Korean]
HAnti-Prohibition
[Chinese][Korean]
5H
HarryWilson[Chinese][Chinese][Korean][Korean]
Andrew M.Cuomo[Chinese][Chinese][Korean][Korean]
Carl P.Paladino
[Chinese][Chinese][Korean][Korean]
Andrew M.Cuomo[Chinese][Chinese][Korean][Korean]
Carl P.Paladino
[Chinese][Chinese][Korean][Korean]
Andrew M.Cuomo[Chinese][Chinese][Korean][Korean]
HowieHawkins
[Chinese][Chinese][Korean][Korean]
JimmyMcMillan
[Chinese][Chinese][Korean][Korean]
WarrenRedlich[Chinese][Chinese][Korean][Korean]
Carl P.Paladino
[Chinese][Chinese][Korean][Korean]
CharlesBarron[Chinese][Chinese][Korean][Korean]
Kristin M.Davis
[Chinese][Chinese][Korean][Korean]
Thomas P.DiNapoli
[Chinese][Chinese][Korean][Korean]
HarryWilson[Chinese][Chinese][Korean][Korean]
HarryWilson[Chinese][Chinese][Korean][Korean]
Thomas P.DiNapoli
[Chinese][Chinese][Korean][Korean]
Julia A.Willebrand
[Chinese][Chinese][Korean][Korean]
JohnGaetani[Chinese][Chinese][Korean][Korean]
Eric T.Schneiderman
[Chinese][Chinese][Korean][Korean]
BruceBlakeman
[Chinese][Chinese][Korean][Korean]
Eric T.Schneiderman
[Chinese][Chinese][Korean][Korean]
DanDonovan
[Chinese][Chinese][Korean][Korean]
Eric T.Schneiderman
[Chinese][Chinese][Korean][Korean]
Carl E.Person[Chinese][Chinese][Korean][Korean]
Ramon J.Jimenez
[Chinese][Chinese][Korean][Korean]
Kristen E.Gillibrand
[Chinese][Chinese][Korean][Korean]
Joseph J.DioGuardi
[Chinese][Chinese][Korean][Korean]
Kristen E.Gillibrand
[Chinese][Chinese][Korean][Korean]
Joseph J.DioGuardi
[Chinese][Chinese][Korean][Korean]
Kristen E.Gillibrand
[Chinese][Chinese][Korean][Korean]
Cecile A.Lawrence
[Chinese][Chinese][Korean][Korean]
JosephHuff
[Chinese][Chinese][Korean][Korean]
JohnClifton[Chinese][Chinese][Korean][Korean]
DanDonovan
[Chinese][Chinese][Korean][Korean]
Joseph J.DioGuardi
[Chinese][Chinese][Korean][Korean]
VivaMorgan[Chinese][Chinese][Korean][Korean]
Charles E.Schumer
[Chinese][Chinese][Korean][Korean]
Eugene M.Fahey
[Chinese][Chinese][Korean][Korean]
Charles E.Schumer
[Chinese][Chinese][Korean][Korean]
JayTownsend
[Chinese][Chinese][Korean][Korean]
Charles E.Schumer
[Chinese][Chinese][Korean][Korean]
ColiaClark
[Chinese][Chinese][Korean][Korean]
Randy A.Credico[Chinese][Chinese][Korean][Korean]
Randy A.Credico[Chinese][Chinese][Korean][Korean]
Kevin M.Dillon
[Chinese][Chinese][Korean][Korean]
Cheryl A.Green
[Chinese][Chinese][Korean][Korean]
Kevin M.Dillon
[Chinese][Chinese][Korean][Korean]
Kevin M.Dillon
[Chinese][Chinese][Korean][Korean]
Kevin M.Dillon
[Chinese][Chinese][Korean][Korean]
Eugene M.Fahey
[Chinese][Chinese][Korean][Korean]
Mark C.Rodgers
[Chinese][Chinese][Korean][Korean]
Eugene M.Fahey
[Chinese][Chinese][Korean][Korean]
JayTownsend
[Chinese][Chinese][Korean][Korean]
Eugene M.Fahey
[Chinese][Chinese][Korean][Korean]
Mark A.Montour
[Chinese][Chinese][Korean][Korean]
Deborah A.Chimes[Chinese][Chinese][Korean][Korean]
Mark A.Montour
[Chinese][Chinese][Korean][Korean]
Deborah A.Chimes[Chinese][Chinese][Korean][Korean]
Cathrine NugentPanepinto
[Chinese][Chinese][Korean][Korean]
Nydia M.Velazquez
[Chinese][Chinese][Korean][Korean]
Nydia M.Velazquez
[Chinese][Chinese][Korean][Korean]
Henry J.Nowak[Chinese][Chinese][Korean][Korean]
AliceGaffney[Chinese][Chinese][Korean][Korean]
Paul B.Wojtaszek
[Chinese][Chinese][Korean][Korean]
Henry J.Nowak[Chinese][Chinese][Korean][Korean]
Paul B.Wojtaszek
[Chinese][Chinese][Korean][Korean]
Cathrine NugentPanepinto
[Chinese][Chinese][Korean][Korean]
Jeffrey F.Voelkl
[Chinese][Chinese][Korean][Korean]
Cathrine NugentPanepinto
[Chinese][Chinese][Korean][Korean]
Cathrine NugentPanepinto
[Chinese][Chinese][Korean][Korean]
Henry J.Nowak[Chinese][Chinese][Korean][Korean]
Daniel L.Squadron
[Chinese][Chinese][Korean][Korean]
Joseph A.Nardiello
[Chinese][Chinese][Korean][Korean]
Daniel L.Squadron
[Chinese][Chinese][Korean][Korean]
John L.Millman[Chinese][Chinese][Korean][Korean]
John A.Jasilli, Jr.
[Chinese][Chinese][Korean][Korean]
John A.Jasilli, Jr.
[Chinese][Chinese][Korean][Korean]
John L.Millman[Chinese][Chinese][Korean][Korean]
Robert J.Duffy
[Chinese][Chinese][Korean][Korean]
Gregory J.Edwards
[Chinese][Chinese][Korean][Korean]
Robert J.Duffy
[Chinese][Chinese][Korean][Korean]
Gregory J.Edwards
[Chinese][Chinese][Korean][Korean]
Robert J.Duffy
[Chinese][Chinese][Korean][Korean]
GloriaMattera[Chinese][Chinese][Korean][Korean]
AldenLink
[Chinese][Chinese][Korean][Korean]
Gregory J.Edwards
[Chinese][Chinese][Korean][Korean]
Eva M.Doyle
[Chinese][Chinese][Korean][Korean]
TanyaGendelman
[Chinese][Chinese][Korean][Korean]
RDH
RDH
�
�
✺
✺
a
a
a
:;
New York sued for usability problemsTestingTraining
38
39
Return'your'ballot'Get$your$ballot$back$to$correct$it.$Ask$a$poll$worker$for$a$new$one.$
Ignore'message.'Cast'ballot'Ignore$this$message$and$cast$your$ballot$with$votes$that$will$not$count.$
You'filled'in'too'many'ovals'in'3'contests.'These'votes'will'not'count:'
03/08/2011$03:47:00pm$
Return'Ballot' Cast'
40
Recommended
Unsettled
Election Assistance Commission and National Institute of Standards and Technology Voluntary Voting System Guidelines - VVSG 2.5
Research and standards
42
Brennan Center
Design for Democracy
Research commissioned by NIST, bookfunded by Kickstarter
SOP and Usability and Civic Life Project, bookfunded by Kickstarter
Research commissioned by NIST, bookfunded by Kickstarter
Research commissioned by EAC, bookfunded by Kickstarter
Field Guides series
Research sponsored by John D. & Catherine T. MacArthur Foundation
Research sponsored by John D. & Catherine T. MacArthur Foundation
Coming soon
Effective election department web sites
Delivering useful voter education
Effective design for vote-by-mail
Funding yet to be secured
Designing multi-language ballots
Funding yet to be secured
Field Guides To Ensuring Voter Intent
civicdesigning.org/fieldguides
Be an election worker
Observe elections
47
HUGE PROJECT on poll worker security!
We need participants everywhere
Volunteer to proofread
Use the accessible
system
49http://trace.wisc.edu/voting/
Join our projects
AIGA Design for Democracy
UPA Usability in Civic Life
Epilogue
51
Why can’t I vote on the internet?Secrecy
Error tolerance
Security
Disagreement about the level of risk
52
53
Why aren’t all voters using the same voting system?
The 10th AmendmentIt’s a states rights issue.
54