trust, safety and reliability (1)

8/9/2019 Trust, Safety and Reliability (1)

1/18

TRUST,SAFETY, AND

RELIABILITY


2/18

CAUSES OF COMPUTERFAILURE

Hardware errors

Software errors

The co!"ter so#$es the wro%&!ro'#e

M(s"se

Co"%(cat(o% fa(#"re Ma#(ce


3/18

Seatwor) * Therac + case

S"!!ose a %ew &rad"ate (% sa-, eco%o(cs, who hadco!#eted se$era# co"rses (% !ro&ra(%& w(th &ood&rades, was o.ered a /o' !ro&ra(%& for aco!a%- that ade 01ra- ach(%es2 S"!!ose a#so

that the 3rst !ro/ect for that !erso% was to wr(te a!ro&ra that co%tro##ed the dosa&e for a %ew 01ra-ach(%e2 The %ew !ro&raer wo"#d ha$e so#eres!o%s('(#(t- for de$e#o!(%& a%d test(%& the !ro&ra2

A2 4o"#d (t 'e ora##- !er(ss('#e for the %ew &rad"ate to

ta)e that /o' 5 E0!#a(%B2 4o"#d (t 'e ora##- !er(ss('#e for the co!a%- to o.er

the %ew &rad"ate that /o' 5 E0!#a(%


4/18

CAUSES OF SOFT4AREFAILURE

a2 Fa(#"re of the de$e#o!ers to fo##owset r(&oro"s e%&(%eer(%& !r(%c(!#es2

'2 U%rea#(st(c sched"#e

c2 Lac) of doa(% )%ow#ed&e

d2 M(sta)es (% de3%(%& "serre6"(ree%ts a%d t"r%(%& the (%to#(%es of codes2


5/18

7"(8 9 :

:2 S"!!ose -o" were a'#e to (de%t(f-the !art(c"#ar !erso%s who ade thedec(s(o% to (&%ore the '"& (% the

codes of Thera1+2 4o"#d -o" ho#dthe !erso% or !erso%s res!o%s('#e forthe acc(de%t2 C(te a Mora# Theor- for

-o"r !os(t(o% 2


6/18

4h- (s there a %eed for software

6"a#(t- 5 acc"rate, thoro"&h a%d t(e#- !rocess(%& of

'"s(%ess tra%sact(o%s e&2 A(r#(%e o%#(%e1t(c)et reser$at(o%, e#ectro%(c1 f"%ds

tra%sfer s-ste of 'a%)s2

Red"ce waste a%d costs, E#((%ate h"a% error

I!ro$e 6"a#(t- of !rod"cts

E#((%ate !rod"ct defects before the- a.ect the

!rod"ct 6"a#(t-2 shorte% the !rod"ct(o% t(e to a%"fact"re

!rod"cts2

Ca% create a safe o!erat(%& co%d(t(o%s for !eo!#e ;e!#o-ees


7/18

Do Co!"ter ; IT !rofess(o%a#s ha$ea%- Mora# res!o%s('(#(t- 5

M(chae# Ba-#es ?

@ Professionals have a special obligation totheir clients to be worthy of a clients trust,and this leads to obligations of honesty,

candor ,competence, diligence, loyaltyand discretion.


8/18

Do Co!"ter ; IT !rofess(o%a#s ha$ea%- Mora# res!o%s('(#(t- 5

otter'ar%


9/18

Safet-1 Cr(t(ca# Software

Refers to co!"ter s-stes that ca%ha$e a @ direct life-threateningimpact. < e$(% Bow-er, +==:? A(rcraft a%d a(r trac co%tro# s-ste

Mass tra%s!ortat(o% s-stes

N"c#ear reactors,

M(ss(#e s-stes Med(ca# treate%t s-stes2


10/18

Safet-1 Cr(t(ca# Software

Software a!!#(cat(o%s "sed (% thedes(&% of !h-s(ca# s-stes a%dstr"ct"res whose fa(#"res ca% a#so ha$e

a% (!act that (s #(fe threate%(%&2E&2 Software "sed (% the

1 des(&% of 'r(d&es a%d '"(#d(%&s

1 se#ect(o% of water d(s!osa# s(tes1 de$e#o!e%t of a%a#-t(ca# ode#s for ed(ca#treate%t


11/18

Examples of Safety CriticalFailures


12/18

Co%(cts of Profess(o%a# Res!o%s('(#(t- *E!#o-ee Lo-a#t- a%d 4h(st#e1B#ow(%&

Do employees have an obligationof Loyalty to Employers?

Many ethicist believe that whileloyalty may not be an obligation thatis absolute, nonetheless, employeeshave a prima facie obligation of

loyalty in employment contexts.


13/18

Co%(cts of Profess(o%a# Res!o%s('(#(t- *E!#o-ee Lo-a#t- a%d 4h(st#e1B#ow(%&

Do computerI! professionals necessarilyhave an obligation to be loyal to their

employers ?

"hat if #I! professional$s obligation ofloyalty come into conict %ith his

obligation to society as a %hole? Does itstill follo% that he or she has an absolute

obligation of loyalty to his employer ?


14/18

Whistleblowing

he disclosure by a person, usuallyan employee in a governmentagency or private enterprise, to the

public or to those in authority, ofmismanagement, corruption,illegality, or some other wrongdoing

that threaten the public interest.


15/18

Being Morally Permitted toBlow the Whistle

De eor&es three co%d(t(o%s

:2 The !rod"ct w(## do @ ser(o"s a%dco%s(dera'#e har to the !"'#(c

+2 The e%&(%eers ha$e re!orted the @ ser(o"sthreat to the(r (ed(ate s"!er$(sor2

>2 The e%&(%eers ha$e @ e0ha"sted the(%ter%a# !roced"res a%d !oss('(#(t(es

w(th(% the co!a%-, (%c#"d(%& &o(%& tothe 'oard of d(rectors, ha$(%& rece($ed %os"!!ort fro the(r (ed(ate s"!er$(sor2


16/18

Being Morally Reuired toBlow the Whistle

De eor&es two co%d(t(o%s

:2 The e%&(%eers ha$e @ access('#e,

doc"e%ted e$(de%ce that wo"#dco%$(%ce a reaso%a'#e, (!art(a#, o'ser$erthat o%es $(ew of the s(t"at(o% (s correct2

+2 The e%&(%eers ha$e @ &ood reaso%s to'e#(e$e that '- &o(%& !"'#(c the %ecessar-cha%&es w(## 'e 'ro"&ht a'o"t2


17/18

Case : * 4h(st#e1 B#ow(%&a%d BART

I% the :G=s a% (%c(de%t at Ba- Area Ra!(dTra%s(t occ"rred where a certa(% tra%s!ort s-ste(s 'e(%& de$e#o!ed2 Three e%&(%eers wor)(%& o%the !ro/ect were co%cer%ed a'o"t the safet- ofthe tra%s(t s-stes A"toat(c Tra(% co%tro#

S-ste2 The- dec(ded to ta)e the(r co%cer%s tothe(r (ed(ate a%a&ers '"t were %ot sat(s3edw(th the a%swers the- rece($ed2 So, the threee%&(%eers %e0t too) the(r co%cer%s to the

or&a%(8at(o%s 'oard of d(rectors2 O%ce a&a(%,howe$er, the- were d(ssat(s3ed w(th the #ac) ofs"!!ort fro the 'oard2 At that !o(%t thee%&(%eers dec(ded to '#ow the wh(st#e2 Short#-afterwards, the- were 3red2

C + 4h( # '# (


18/18

Case + * 4h(st#e1'#ow(%&a%d SDI

I% the ear#- :G=s, a U2S (#(tar- !ro!osa#ca##ed the Strategic !efense "nitiati#e was(%trod"ced a%d de'ated2 SDI was a Nat(o%a#M(ss(#e Defe%se s-ste that wo"#d !ro$(de a @defe%se sh(e#d a&a(%st (%co(%& 'a##(st(c(ss(#es2 The SDI !ro!osa#, wh(ch was $(&oro"s#-s"!!orted '- the Pres(de%ts ad(%(strat(o%,soo% 'ecae $er- co%tro$ers(a#2 4h(#e SDIss"!!orters ar&"ed that the (ss(#e s-ste was

esse%t(a# for the co"%tr-s %at(o%a# defe%se,cr(ct(cs ar&"ed that the s-ste was "%re#(a'#e2O%e Cr(t(c, Da$(d Par%as, dec(ded to &o !"'#(cw(th h(s co%cer% a'o"t SDI2

trust, safety and reliability (1)

Documents