how to stop and apocalypse with second hand laptops and open source software

25
How to stop an apocalypse with second hand laptops and Open Source Software 32C3 Hamburg By: Emerson Tan (NetHope Emergency Response), Salton Massally (iDT Labs, Sierra Leone) December 30, 2015

Upload: emerson-tan

Post on 08-Jan-2017

621 views

Category:

Government & Nonprofit


0 download

TRANSCRIPT

TRUSTED Family Business Advisors

How to stop an apocalypse with second hand laptops and Open Source Software

32C3 HamburgBy: Emerson Tan (NetHope Emergency Response), Salton Massally (iDT Labs, Sierra Leone)December 30, 2015

ContentIntroduction and outlineBackground: Ebola and Sierra LeoneThe principles of successful interventionDevelopment and implementation of MIS and Payment systems Questions?

Private and Confidential

ContentIntroduction and outlineBackground: Ebola and Sierra LeoneThe principles of successful interventionDevelopment and implementation of MIS and Payment systems Questions?

Private and Confidential

IntroductionSierra Leone:Roughly the size of Ireland; population ~6 Million6th Poorest country on earthCivil war 1991-2002Rich in resources (diamonds, gold, minerals)

Licensed under Creative Commons

Sierra Leone: Key factsFamous for all the wrong reasons, civil war, blood diamonds, leonardo di caprio moviesRoughly size of Ireland for European referenceVery poorLife expectancy is only 48 yrsCivil war wrecked the education system: literacy rate is less than 25%Lots of minerals, place should be rich

Fighting Ebola in Sierra Leone

Licensed under Creative Commons

I could spend hours banging on about how Ebola nearly brought the countries it affected to their knees. The disease is terrifying, and the images that played across your TVs are nothing on actually watching it in front of you (from a safe distance of 2 meters).

However, these documentary makers showed up and this trailer for their documentary does a pretty good job of summing up some of the impacts to society and individuals that the epidemic had.

How to win the war against Ebola

70%70%

Licensed under Creative Commons

The strategy to get the outbreak under control was at first glance pretty simple.

70% of dead ebola patients buried safely, as recently dead people are the most infectious70% of live cases in treatment in isolation units so they be cared for safely

This gets the curve to flatten out and the situation stabilises, as the system improves to 100% in all categories the epidemic should be ended.

But this is a race against the clock, how to build the systems needed and get them to national scale in a very hard environment starting from a very low base.

Health System Scale Up:18 Ebola Treatment Centers50 Community Care CentersContact TracersSafe Burial TeamsAmbulance DriversDisinfection teamsLabs Were going to need an army

Coordination System:13 Command Centers2 Rapid response teams117 Ebola Emergency Line*Labs result reporting systemVSAT based internet to all key facilitiesMobile Phones, Sat Phones, BGAN

Licensed under Creative Commons

Of course the previous slide is a gross oversimplification, because achieving those simple goals means building a huge amount of infrastructure and employing a huge number of people, in new organizations, who all then have to be coordinated together.

In a country with 30% phone coverage, only 2 paved highways outside the capital, no power grid, economy shutdown, movement restrictions

Ok, this is now sounding much more complicated. I had to do a bunch of infrastructure work to get all this to work, but this was simple compared to the ultimate nightmare

Paying people.

ContentIntroduction and outlineBackground: Ebola and Sierra LeoneThe principles of successful interventionDevelopment and implementation of MIS and Payment systems Questions?

Private and Confidential

Principles of effective technology intervention in developing world contexts

Licensed under Creative Commons

ContentIntroduction and outlineBackground: Ebola and Sierra LeoneThe principles of successful interventionDevelopment and implementation of MIS and Payment systems Questions?

Private and Confidential

The Nightmare- Challenges- Solutions- How to work a miracle

Licensed under Creative Commons

Challenge: PressureThere was some pressureProblems with pay led to strikes and civil disorderStrikes and civil disorder lead to bodies and patients in the streetsYou guys have six weeks to come up with a working solution this problem set or the country is fucked. Senior UN official in private conversation, October 2014.

Licensed under Creative Commons

By October, strikes and other disruptions due to failure to pay healthcare workers were becoming a critical danger to the effort to contain the epidemic

Hazard pay introduced to bypass the mess at the ministry of health, some workers hadnt been paid for months as the Ministry of health manual systems collapsed

The policy was great in theory, only the system needed to run it all simply didnt exist at the time the policy was announced

I got dragged into a session where finally how the system was to be built, almost casually. Id been working on getting Satellite internet service to all the treatment centers and disctict command and coordination centers. In the course of the meeting I remember saying what you guys need is an ERP system. I got some very blank looks, finally, someone said whats one of those. After about 10 minutes this turned into you seem to know something, you advise us who to hire and how to do this

Oh shit.

Challenge: Welcome to the nightmare of trying to pay for everythingThe sinews of war are endless money

Paying people is harder than it looks:8 ATMs in the entire countryBanks shut down due to epidemicOne of worlds most corrupt countriesBanking system circulation shutdownATMCredit Cards

Online Payments

Accurate Staff Lists

Patronage!Corruption!

Licensed under Creative Commons

Paying people should in principle be really simple. In the developed world more or less everyone has a bank account and paying people is as simple as

Only it isnt.

No ATMs outside the capital, No Accurate staff lists, There are only 12 surnames in the entire country, Most people cant read and write and many dont even know their own birthdays.

This makes for an administrative and organizational NIGHTMARE.

The Nightmare- Challenges- Solutions- How to work a miracle

Licensed under Creative Commons

Hey I know these local guys

Licensed under Creative Commons

Lorissa had known about iDT labs for some time

Sierra Leones only real software development startup since 2013

Everyone was very young, but they has already had some OpenERP experience having built the HR system for Africell, a local cell phone company with about a thousand employees.

So, take the existing HR system, tweak it a bit and scale it to ~30K people.

Thats easy isnt it?

Mobile Money and automated payments to the rescue.

Licensed under Creative Commons

ApproachUbiquity of mobile phones among the Ebola Response Workers, Extension of mobile money wallet schemesA local ICT social enterprise with technical capability in open source ERP, Internet infrastructure implemented as part of the responseA comparatively advanced mobile phone based digital payment ecosystem

Licensed under Creative Commons

The Nightmare- Challenges- Solutions- How to work a miracle

Licensed under Creative Commons

Open Source had solutions for most of our key technical problemsComplicationsOpen Source SolutionProblemCant use finger print based biometrics (cross contamination risk)

ODK makes developing enrollment applications very fastOpen source facial recognition framework

No Worker ID schemeMust store profiles, payment histories, generate pay lists, manage issues OpenERP/OdooData RepositoryVery limited variation in names nationwideLots of missing and inconsistent dataDedupe, a python library that uses machine learning to quickly perform de-duplication and entity resolution on structured data1000s of duplicate and ghost entries from Gov lists (corruption)Must be SMS based, and scale to 30K users flawlessly. Must allow interactionKannel SMS and WAP gatewayCommunicationsCorruption is a way of lifeAudit module included and code is available for audit! Transparency win!Leakages, system gaming and patronage

Licensed under Creative Commons

Deduplicating without enough details was a nightmare

Twenty thousand records supplied with no unique ID or adherence to convention and unique characteristics missingImportant fields like Identification, telephone numbers, address etc that we could use to deduplicate were mostly missingExtensive spelling mistakes added several feathers to our hats of frustration

Devops and an appreciation/patience for major scope changes and feature creeps was KeyAbility to respond to how users interacts with the system and the deficiencies in processes that the system was meant to support and data supplied was paramountAlmost daily deployment to opswork for the first two monthslongest streak 29 days328 commit in the first month alone after the system was already in production longest stay in office 3 days without sleep or shower...The gods named Cheap Coffee and yet still Cheaper Energy Drinks kept us going

Deployment Complications SolutionProblemNo power grid, No data centers, No good sysadmins, No infrastructure.

Emerson persuades GoSL into letting the system be hosted at Amazon.

Government demands data hosted in SLHad to be instantly available

99.999 reliabilityOpsWorksAmazon EC2Amazon RDSAmazon Route 53Amazon SQSAmazon SES

InfrastructureMust be robust Berkshelf/ChefDeployment managementConstant scope changeCoffee, Energy Drinks, Camp beds in office, no showers, not enough sleepDevOps

Licensed under Creative Commons

Devops and an appreciation/patience for major scope changes and feature creeps was KeyAbility to respond to how users interacts with the system and the deficiencies in processes that the system was meant to support and data supplied was paramountAlmost daily deployment to opswork for the first two monthslongest streak 29 days328 commit in the first month alone after the system was already in production longest stay in office 3 days without sleep or shower...The gods named Cheap Coffee and yet still Cheaper Energy Drinks kept us going

Open Source Software restored faith in ability of systems to be run honestly

Licensed under Creative Commons

After a few weeks of operation and once people were confident they were being paid on time and with no deductions, strikes stopped completely

We hacked together biometric registration kits from voter registration kits, replacing secure tamper proof parts which wouldnt run our software with laptops borrowed in a hurry from World Vision (an NGO) after some hasty phone calls.

Seeing the team and seeing the technology built faith in the system in the health workers

The real challenge is never technical

Business process development and implementation is much harder than tech in these contexts.

Licensed under Creative Commons

ResultsDuplicate Records Removed through Information Management System3,054

Number of Fraudulent Ebola Response Workers Reported to the Anti-Corruption Commission150

Number of Double Dipping Ebola Response Workers Reported to Anti-Corruption Commission78

Medical Centers reported to Anti-Corruption Commission 3

# ERWs PaidTotal # ERWs in Country% of Total ERWs managed IMSDirect CashDigital MoneyGuinea 1,40023,174N/A78%22%Liberia 1,39311,000N/A43%58%Sierra Leone 21,05827,000100%0%100%

Licensed under Creative Commons

WIN

Licensed under Creative Commons

Questions?

I LOVE ITWHEN A PLAN COMES TOGTHERSalton: [email protected]: [email protected]