evaluation of the distance mediation project: report on phase ii of the technology-assisted family...

8/12/2019 Evaluation of the Distance Mediation Project: Report on Phase II of the Technology-Assisted Family Mediation Project Volume II: Appendices

1/34

EVALUATION OF THE DISTANCE MEDIATION PROJECT:

Report on Phase II of the Technology-AssistedFamily Mediation Project

Volume II: Appendices


2/34

Eva luation of The Distanc e M ed iation Projec t

TABLE OF CONTENTS

VOLUME II. Appendices

Appendix A. Evaluation Framework TablesAppendix B. Client Survey and Case Notes FormsAppendix C. Distance and Emission Avoidance CalculationsAppendix D. Suggested Guidelines for Distance Mediation


3/34


APPENDIX A

Evaluation Framework Tables


4/34

DISTANCE MEDIATION PROJECT:

PHASE II

EVALUATION FRAMEWORK

EVALUATION QUESTIONS

MEASURABLE

INDICATORS OF

SUCCESS

DATA REQUIREMENTS/

SOURCES

1

Program Goal: To explore the feasibil ity of p roviding Brit ish Columbians in remote, non-urban areas with accfamily mediators through the use of information and communication technolog ies (ICTs).

Objective 1.To use a variety of ICTs to facilitate access to quality family mediation services for British Columbians, with a particulaservices to families residing in remote, non-urban areas.

1.1. Do families residing in remote, non-urbanareas of the province access the Projectsservices?

one or both parties ineach Project mediationcase reside in a remote,non-urban location in the

province the volume of inquiries

and the rate of uptakeover the pilot perioddemonstrates that partiesfrom rural B.C. wish to,and have accessed, theProjects services

content analysis, caseacceptance criteria forProject

# of parties identified aslocated in a remote,non-urban location, asrecorded oninquiry/intakeform andcase trackingspreadsheet

# of cases initiatedduring pilot period, asrecorded oninquiry/intake form andcase trackingspreadsheet

if known, the reasonswhy people whootherwise qualify for theProject choose not toparticipate in theProject, or did notconclude mediation

ndepiw

pe th

afsofecofatoruofgethdeco

trasepowmco


5/34


MEASURABLE

INDICATORS OF

SUCCESSDATA REQUIREMENTS/

SOURCES

2

1.2. What is the demographic profile of theProjects clientele, and does this profilegenerally match the profile of B.C.s non-urban residents?

the demographic profile ofthe Projects clientele andthat of B.C.s non-urbanresidents are roughlysimilar to one another

demographic statisticson rural B.C.

demographic statisticson Project clients, assolicited by Project

mediators and recordedon the Case Notes formand as accessedthrough a written survey

thPrBond

(ssoun

thshtotraselittprwtrase

sobestreFaDmwcoth


6/34


MEASURABLE

INDICATORS OF


SOURCES

3

1.3. What barriers commonly referred to asdigital divide issues might preventparties in remote, non-urban areas fromaccessing technology-assisted mediationservices?

an analysis ofdemographic data on ruralB.C. reveals that digitaldivide factors are eithernot likely to prevent

parties in rural B.C. fromaccessing technology-assisted mediationservices, or that thesefactors can be mitigated

demographic statisticson digital divide factorsin rural B.C., such as:- cultural background- broadband availability

- age- disability- income- geography, and- education

dethreCa

renoan

1.4. Are the parties generally satisfied withtheir experience with ICTs in mediation,and do they believe that their use hasbeen helpful as an aid in disputeresolution?

a majority of distancemediation parties expresssatisfaction with theirexperience with ICTs inmediation, and report thatICTs are an aid to disputeresolution

written survey of Projectclients

clcomthw

it co

wreexm

cldiprmprmdopr

1.5. Are Project mediators generally satisfiedwith their experience with ICTs inmediation, and do they believe that theiruse has been helpful as an aid to disputeresolution?

a majority of Projectmediators expresssatisfaction with theirexperience with ICTs inmediation, and report thatICTs are an aid to disputeresolution

interviews with Projectmediators content analysis of case

notes/case trackingspreadsheet

mthobPr


7/34


MEASURABLE

INDICATORS OF


SOURCES

4

1.6. Is the Project design consistent with, anddoes it support: the Mediator RosterSociety and Law Foundation mandatesregarding access; and the Notice toMediate (Family) Regulationregarding

the use of alternate communicationmediums?

the project design is foundto be consistent with, andto support, the relevantmandates and applicableregulations

content analysis ofProject documentation,including: Agreement toMediate, checklists,Distance Mediation

Guidelines, and otherpractice aids developedfor use during and afterthe pilot period

ththRLath

RePr

1.7. What is the feasibility of deliveringtechnology-assisted family mediationservices on a large scale in remote, non-urban areas of B.C.?

an analysis of issuesrelevant to the delivery ofdistance mediationservices suggests that it isfeasible to deliver theseservices in remote, non-urban areas of B.C.

interviews withstakeholders andsubject matter experts

interview with ProjectCoordinator

administrative notes(notes retained byProject Coordinator for

administration purposes)

isofinsodiinan

se2.


8/34


MEASURABLE

INDICATORS OF


SOURCES

5

Objective 2.To increase knowledge about using ICTs in a competent, safe and appropriate manner to deliver family mediation serv

2.1. Do the policy/procedural tools developedfor the Project support and promotecompetent, safe and appropriate methodsin respect of technology-assisted familymediation?

before and during thepilot period, the practiceguidelines and otherdocumentation (some ofwhich Project mediatorsparticipate in developing)require familiarity withand application ofcompetent, safe andappropriate methods intechnology-assistedfamily mediation

after the pilot period, thepractice guidelines andother documentation

developed over thecourse of the Projectprovide clear direction onthe competent, safe, andappropriate use of ICTsin family mediation


content analysis ofselection criteria forProject mediators

content analysis ofProject referencematerials

content analysis ofProject documentation,including: Agreement toMediate, checklists,Distance MediationGuidelines, and otherpractice aids developed

for use during and afterthe pilot period

thdeafsoPrwhaspasmcr

Pr

2.2. Do the policy/procedural tools developedfor the Project address screening forviolence and assessing mediationcapacity when ICTs are used in familymediation?

the practice guidelinesand other documentationdeveloped over thecourse of the Projectprovide clear direction onscreening for violence

and assessing mediationcapacity when ICTs areused in family mediation

content analysis ofProject documentation,including: Agreement toMediate, checklists,Distance MediationGuidelines, and other

practice aids developedfor use during and afterthe pilot period


9/34


MEASURABLE

INDICATORS OF


SOURCES

6

2.3. Do the policy/procedural tools developedfor the Project address screening/assessing for the suitability of ICT use infamily mediation?

the practice guidelinesand other documentationdeveloped over thecourse of the Projectprovide clear direction on

screening/assessingwhether ICT use issuitable in a familymediation case

content analysis ofProject documentation,including: Agreement toMediate, checklists,Distance Mediation

Guidelines, and otherpractice aids developedfor use during and afterthe pilot period

2.4. Of the ICTs utilized by the Project, whichappear to be best suited for distancemediation purposes, and which are bettersuited to different parts of the distancemediation process?

a variety of ICTs areidentified as best suited toproviding services toparties living in remote,non-urban areas of theprovince


interviews with Projectmediators


content analysis of casenotes, case tracking

spreadsheet, anddistance mediationguidelines

cMobsisrep

ineremnthau

2.5. Are there particular types of family casesthat lend themselves more to theapplication of technology-assistedmediation methods than others?

a variety of case types aredocumented in which ICTuse is particularlyappropriate



thexinar

w


10/34


MEASURABLE

INDICATORS OF


SOURCES

7

2.6. What are observed to be the advantagesand disadvantages of the ICTs used inmediation during the pilot period?

the advantages anddisadvantages of the ICTsused in distancemediation are identified




content analysis of casenotes, case trackingspreadsheet, anddistance mediationguidelines

awadm

reobmu

daincfrre

p

refala(etofucctrc


11/34


MEASURABLE

INDICATORS OF


SOURCES

8

2.7. How does ICT use compare with existingdispute resolution approaches (e.g.shuttle mediation) when distance is afactor?

a variety of circumstancesare documented in whichICT use comparesfavourably to existingapproaches when

distance is a factor




content analysis of casenotes and distancemediation guidelines

mthmnum

copatafois rethaswicaciIC

thofdiisanwthmadpr

inwtraw

thmw

Conti


12/34


MEASURABLE

INDICATORS OF


SOURCES

9

if thbemse

beanmfa

2.8. Can some of the broader benefits ofmediation be realized when ICTs areutilized in the mediation process?

mediators believe thatsome of the broaderbenefits of mediation areachieved when atechnology-assistedprocess is used

distance mediation partiesindicate that some of the

broader benefits ofmediation are achievedwhen a technology-assisted process is used



thmfacocodesk

2.9. What additional skills or training shouldmediators acquire to employ competent,safe and appropriate methods intechnology-assisted family mediation?

the Project Coordinatorand mediators can pointto specific skills ortraining that mediatorsshould acquire to employcompetent, safe andappropriate methods intechnology-assisted

family mediation




13/34


MEASURABLE

INDICATORS OF


SOURCES

10

2.10. Do Project mediators believe that theirown knowledge of ICT use in mediationhas increased as a result of theirparticipation in the Project?

Project mediators canpoint to specific ways inwhich their ownknowledge has increasedas a result of their

participation in theProject


ingrprinw

soprchthgaprmthprbeco

2.11. What are the primary lessons learned in

respect of competent, safe andappropriate ICT use in family mediation?

after the pilot period, thepractice guidelines andother documentationdeveloped over thecourse of the Projectprovide insights on thecompetent, safe, andappropriate use of ICTsin family mediation



content analysis ofProject documentation,including: Agreement toMediate, checklists,Distance MediationGuidelines, and otherpractice aids developedover the course of thepilot period

ptathaa


14/34


15/34


MEASURABLE

INDICATORS OF


SOURCES

12

Objective 3.To work collaboratively with stakeholders in the family justice system to develop knowledge about using ICTs to delive

3.1. What methods are used to promotecollaboration with stakeholders in thefamily justice system in developingknowledge about ICT use in familymediation?

a description of themethods used to promotecollaboration withstakeholders over thecourse of the Projectdiscloses methods thatare conducive tocollaboration


3.2. Is the Project designed to explore thedelivery of family mediation servicesusing ICTs that may be of interest andpotential utility to other stakeholders inthe family justice system?

the Project Coordinatorand project document-ation specificallyaddresses ways in whichefforts were taken toexplore technologies that

may be of interest tovarious stakeholders inthe family justice system


content analysis ofProject documentation,including: Project Mapand administrative file

notes

thinofusinot

ju


16/34


MEASURABLE

INDICATORS OF


SOURCES

13

3.3. Do stakeholders in the family justicesystem direct clientele to the Projectduring the pilot period?

cases are referred to theProject by justice-systemcolleagues outside thethe Mediator RosterSociety

referral sources forProject cases, asrecorded oninquiry/intake sheet andin the written survey of

Project clients

onreSoSepa

RthofCsefo

caFaDsenereM

anof

ju

3.4. Are steps taken to encouragecommunication amongst the stakeholdersin the family justice system, as it relatesto the delivery of family mediationservices using ICTs?

the Project Coordinatorand team members canpoint to specific stepstaken to encouragecommunication amongstthe stakeholders in thefamily justice system, asit relates to the delivery offamily mediation services

using ICTs



interviews with selectedstakeholders in thefamily justice system

stre(FDOorManof

Seprboinfoocse


17/34


MEASURABLE

INDICATORS OF


SOURCES

14

Objective 4.To explore the extent to which the use of ICTs might reduce reliance on fossil fuels when delivering and accessing fam

4.1. Are remote, non-urban areas of theprovince served without the necessity of

travel?

the Projects clients areprovided with familymediation services withoutthe necessity of travellingoutside their homecommunities


mileage/travel notes, asrecorded on mediatortravel claims and casenotes

socoloeqwcoob

4.2. What are the distances between theparticipants who choose to participate intechnology-assisted mediation during theproject period?

the distances betweenparties, and/or betweenparties and their Projectmediator, would beprohibitive without ICTuse

distance betweenparties (and/or counseland other participants),as calculated fromlocations recorded onthe case notes/casetracking spreadsheet

distance from the parties(and/or counsel andother participants) totheir Project mediator,as calculated fromlocations recorded onthe case notes/casetracking spreadsheet


18/34


MEASURABLE

INDICATORS OF


SOURCES

15

4.3. What distances might the participantshave travelled for family mediationservices if ICTs had not been utilized?

the distances from theparties to the nearestfamily mediator, would beprohibitive without ICTuse

distance from the parties(and/or counsel andother participants) to thenearest qualified familymediator who can

address the issuespresented in the case,as calculated fromdistances recorded onthe case notes/casetracking spreadsheet

it mfualm

traemprdiav

asconoqubethmpr

RSemMFathDceCofca


19/34


MEASURABLE

INDICATORS OF


SOURCES

16

4.4. What is the savings in fuel associatedwith the distances not travelled, and howmight these savings be expressed interms of carbon emissions avoided?

fuel savings are reportedin connection withdistances not travelled, foreach mediation and for allthe mediations conducted

during the pilot period carbon emissions are

avoided in connection withdistances not travelled, foreach mediation and for allthe mediations conductedduring the pilot period

calculation of fuel thatmight otherwise havebeen used, per case

calculation of carbonemissions associated

with the fuel that mightotherwise have beenused, per case

caotbeabm

(sabtrausbocohaqucapr

cacaba

acca(aBC


20/34


APPENDIX B

Client Survey and Case Notes Forms


21/34

The Distance Mediation Project

~ Client Survey ~

No. _____1

A. About You

In this section, we ask you for some basic information that will help us better understandthe clients of the Distance Mediation Project.

1. Is this the first time you have participated in a mediation?

Yes No Dont Know

2. How did you first hear about the Distance Mediation Project?

The B.C. Mediator Roster Society officeThe B.C. Mediator Roster Societywebsite

A Family Justice CentreA Government Agents OfficeA public library

Other(Please specify)

3. Where might you have gone for help to resolve the issues you brought for mediationif the Distance Mediation Projecthad not been available?

Other service available through a localFamily Justice CentreOther service available through an out-of-town Family Justice CentreLocal family lawyer

Out-of-town family lawyerLocal Family CourtOut-of-town Family CourtWould not have got helpDont Know

Other (Please specify)

4. By what means would you normally travel to get to the largest community centre

near you?

Private vehicle Bus Train Boat Aircraft

B. About Your Mediation

In this section, we ask you about your impressions of your mediation with the DistanceMediation Project.

1. At the time you are completing this survey questionnaire, have all the mediationsessions been finished in your case?

YesNo, but another mediation session has already been scheduledNo, but another mediation session has not yet been scheduledDont know

2. Did you feel that you were fully able to express your thoughts, feelings, and concernsduring your mediation? (Please comment on the next page)

Yes No Somewhat Dont know


22/34

~ Client Survey~

No. _____2

Please comment:

3. Has the mediation process helped to improve the way you communicate with theother person(s) with whom you were in mediation?

Yes No Somewhat Dont know

Please comment:

4. How satisfied are you with the outcome or end result of your mediation? (Use arating scale from 1 to 5, in which 1 is very unsatisfied and 5 is very satisfied)

1 2 3 4 5 Dont KnowNot applicable (no outcome, as my mediation has not yet been completed)

5. How satisfied are you with the mediation processyou experienced (apart from yourimpression of the mediationoutcome)? (Use a rating scale from 1 to 5, in which 1 is veryunsatisfied and 5 is very satisfied)

1 2 3 4 5 Dont Know6. If you have participated in a mediation before, how favourably did your mediation

with the Distance Mediation Projectcompare with the other mediation(s) in which youparticipated? (Use a rating scale from 1 to 5, in which 1 is very unfavourable and 5 is veryfavourable)

1 2 3 4 5 Dont KnowNot applicable (I have not previously participated in a mediation)

C. About Technology and Your Mediation

In this section, we ask you about the information and communication technologies youused during the mediation process.

1. To which of the following information/communication technologies did you haveaccess for the mediation? This could include access at home, at work, with friends,or at a local agency or service. (Select all that apply)

Dedicated (or landline) telephoneCell phoneTelephone conferencing equipmentDedicated video conferencingequipment

ComputerWeb camOther (please specify)


23/34

~ Client Survey~

No. _____3

2. Which of the following information/communication technologies did you use indiscussions and/or mediation sessions with your mediator? (Select all that apply)

Dedicated (or landline) telephone

Cell phoneTelephone conferencing equipmentDedicated video conferencingequipment

Computer

Web camOther (please specify)

3. Did you experience any difficulties in your discussions and/or mediation sessionsbecause of these technologies?

Yes No Dont know Not applicable

If yes, please describe these difficulties:

4. Did using the technology(ies) you identified in question 2, above, influence howeffectively the mediator was able to manage any safety concerns you may havehad?

Yes, it increased his/her effectivenessYes, it decreased his/her effectivenessNo, it did not influence his/her effectivenessDont knowNot applicable (I did not have any safety concerns)

Please comment:

5. Did using the technology(ies) you identified in question 2, above, influence howeffectively the mediator was able to manage the discussion between people duringyour mediation sessions?

Yes, it increased his/her effectivenessYes, it decreased his/her effectivenessNo, it did not influence his/her effectivenessDont know

Please comment:

D. Your General Impressions

In this section, we ask you about your impressions of mediation generally, and about thedistance mediationprocess specifically.

1. Overall, how favourable is your impression of the mediation process you experienced apart from the information/communication technologies you used?(Use a ratingscale from 1 to 5, in which 1 is very unfavourable and 5 is very favourable)

1 2 3 4 5 Dont Know


24/34

~ Client Survey~

No. _____4

2. Overall, how would you rate your satisfaction with the information/communicationtechnologies you used apart from your feelings about the mediation process itself,or the outcome of your mediation?(Use a rating scale from 1 to 5, in which 1 is veryunsatisfactory and 5 is very satisfactory)

1 2 3 4 5 Dont Know3. If another issue arose, would you choose a distance mediation process (a

mediation using information/communication technologies) for help in resolving it?

YesNo, I would choose an in-person mediation processNo, I would not choose mediation of any kindDont Know

4. Would you recommend that others choose a distance mediation process (amediation using information/communication technologies) for help in resolving anissue?

YesNo, I would recommend an in-person mediation processNo, I would not recommend mediation of any kindDont Know

5. The Distance Mediation Project offered mediation services without charge. If youanswered yes in question 4, would you recommend that others choose a distancemediation process even if they had to pay for these services?

Yes No Dont knowNot applicable (answered no or dont know to question 4)

6. Do you have any other remarks or observations to make about the distancemediation process in which you took part? (Please comment, and continue on the back ifspace is insufficient)

Thank you for taking the time to participate in this survey!

Please return your completed survey in the enclosed envelope to:C.A. Walker & Associates, 1649 Brousson Dr., Victoria, B.C., V8N 5N2


25/34

The Distance Mediation Project~ Case Notes ~

1

A. Administrative Information

1. Project case number:

2. Name of mediator:

3. Date of case assignment/file opening (dd/mm/yy):

4. Case closing date at conclusion of project-allotted time period:

B. Party Details Demographic and Digital Divide Factors

Number of parties:

1. Party 1

Gender: male femaleBirth date:

Location:

1stlanguage:

1st

Nations: yes noDisability: yes no

Highest level of educationcompleted:

< grade 12high school (gr. 12)college/tech. inst.under graduate postsecondarygraduate postsecondary

Approx. annual net income:under $50,000$50,000 to $100,000over $100,000

2. Party 2


Location:

1stlanguage:

1st





3. Party 3


Location:

1stlanguage:

1st





*If more than 3 parties, please provide details below or on overleaf

( /mm/yy)

( /mm/yy)

( /mm/yy)

( /mm/yy)


26/34

~ Case Notes ~

2

C. Issues In Dispute (check all that apply)

reorganization of the family

Parenting

custody/guardianship

Access

child support

spousal support

property matters under $25,000 (please describe):

property matters over $25,000 (please describe):

other issue (please specify):

D. Description of Technologies Utilized in this Case (please list/describe)

1. Technologies used at initial contact:

2. Technologies used during pre-mediation:

3. Technologies used during mediation:

4. Technologies used during post-mediation:

E. Observations Related to Technology Use in this Case (please specify)

1. Advantages of technology use:


27/34

~ Case Notes ~

3

2. Disadvantages of technology use:

3. Practice Notes (ideas or principles that have broad general application) relating totechnology use as drawn from this case:

F. Observations at Close of Case

1. Outcome at conclusion of project-allotted time period:

agreement some issues; mediation continuing outside of project

agreement some issues; mediation concluded

agreement all issues; mediation concluded

no agreement all issues; mediation continuing outside of project

no agreement all issues; mediation concluded

no agreement mediation ended/discontinued before conclusion

other (please specify)

2. If the mediation concluded past the project-allotted time period, did you continue toemploy technology-assisted methods?

Yes

No


28/34

~ Case Notes ~

4

If no, what were the reasons you decided not to continue employing these methods?

3. At the conclusion of this mediation, approximately how long did you spend on thiscase whether inside or outside the project-allotted time period? (include anyadministrative time spent, as well as time spent in meetings and mediation sessionswith the parties):

approximately hours

4. In your experience as a mediator, was that time more, less, or about the sameamount of time you would have spent had you conducted this mediation witheveryone together, physically, in your office/mediation room?

more time, by approximately hoursless time, by approximately hoursabout the same amount of time

5. Did you undertake any travel in this case?

yes, vehicle travel of kmsyes, air travel of kmsNo

6. Other notes or observations you may have:

Once completed, please return this form to: Susanna Jani at [email protected] Colleen Getz at [email protected]


29/34


APPENDIX C

Distance and Emission

Avoidance Calculations


30/34

(). , ,

. , ,

.

:

1. ,

, , .

.1

2. 3 : B..

, ( ),

B.. A .

3. ,

.

4. $25,000,

.

5. , ,

. A

://../?=&=.::&=&= .

://./.

6. , , 3.5 100 .2

1 . A

, ,

.2 , , ,

. , ,


31/34

7. () (, )

B..

://..// 3

8. ,

. (

) .

9. .

10.A ,

1 3 .

11. 4 ,

.

3.5 100 . 100

.3A ,

. , ,

.


32/34

( ,

)

( ,

)

( ,

)

001 A 432 864 2592 95.04 285.11

002 A 923 1846 5538 203.06 609.18

003 A 782 1564 4692 172.04 516.11

004 A 472 944 2832 103.84 311.51005 A 586 1172 3516 128.92 386.76

006 A 1424 2848 8544 313.28 939.84

007 A 1437 2874 8622 316.14 948.42

008 A 353 706 2118 77.66 232.98

009 A 1636 3272 9816 114.52 343.56

011 A 1751 3502 10506 385.22 1155.67

014 A 604 1208 3624 132.88 398.64

016 A 692 1384 4152 152.24 456.71

017 A/A 1455 2910 8730 236.55 709.65

018 A 594 1188 3564 130.68 392.04

019 A 98 196 588 21.56 64.69

020 A 646 1292 3876 142.12 426.36

021 A 89 178 534 19.58 58.73

022 A 656 1312 3936 144.32 432.96

023 A 533 1066 3198 117.26 351.78

024 A/A 3867 7734 23202 316.74 950.22

025 A 306 612 1836 67.32 201.96

029 A 2068 4136 12408 454.96 1364.89

031 A 466 932 2796 307.56


33/34

( ,

)

( ,

)

( ,

)

001 A 432 864 2592 0.228 0.684

002 A 923 1846 5538 0.487 1.461

003 A 782 1564 4692 0.413 1.239

004 A 472 944 2832 0.249 0.747005 A 586 1172 3516 0.309 0.927

006 A 1424 2848 8544 0.752 2.256

007 A 1437 2874 8622 0.759 2.277

008 A 353 706 2118 0.186 0.558

009 A 1636 3272 9816 1.44 4.32

011 A 1751 3502 10506 0.925 2.775

014 A 604 1208 3624 0.319 0.957

016 A 692 1384 4152 0.365 1.095

017 A/A 1455 2910 8730 0.502 1.506

018 A 594 1188 3564 0.314 0.942

019 A 98 196 588 0.052 0.156

020 A 646 1292 3876 0.341 1.023

021 A 89 178 534 0.047 0.141

022 A 656 1312 3936 0.346 1.038

023 A 533 1066 3198 0.281 0.843

024 A/A 3867 7734 23202 2.762 8.286

025 A 306 612 1836 0.162 0.486

029 A 2068 4136 12408 1.092 3.276

031 A 466 932 2796 0.246 0.738


34/34


APPENDIX D

Suggested Guidelines for

Distance Mediation

evaluation of the distance mediation project: report on phase ii of the technology-assisted family...

Documents