SheFigures:datagaps,lessons&futuredirectionsPlenary:ImprovingqualityofSTEMgenderequalityindicators

GS9-Brussels,November8th,2016

2

SheFiguresStructure

§ Poolofgraduatetalent§ ParticipationinS&T

occupations§ Labourmarketparticipationas

researchers§ Workingconditionsof

researchers§ Careeradvancement&

participationindecision-making

§ Researchandinnovationoutputs

3

SheFiguresDataSources

§ Eurostat(38indicators):§ EducationStatistics(6)

§ HRST(8)

§ High-techIndustryandknowledge-intensiveservices(2)

§ R&DStatistics(20)

§ Structureofearningssurvey(2)

§ MORE2Survey(4)

§ ERASurvey2014(3)

§ WomeninScience(WiS)questionnaire(13)

§ WebofScience(WoS)(8)

§ PATSTAT-EPO(2)

Secondarysources

Primary

sources

Highly reliable & continuity is not an issue

Reliable but continuity could be an issueReliable, continuity is not an issue, lessons learnedReliable, continuity is not an issue, account for biases

4

NoveltyinWorkingConditions

1. Part-timeemploymentofresearchersintheHigherEducationSector(HES),outofthetotalresearcherpopulation,bysex,2012

2. ‘Precariousworkingcontracts’ofresearchersintheHigherEducationSector(HES),outofthetotalresearcherpopulation,bysex,2012

1. SexdifferencesforinternationalmobilityofresearchersduringtheirPhD,2012

2. Sexdifferencesforinternationalmobilityofresearchersinpost-PhDcareerstages,2012

1. ProportionofRPOsthatadoptedGenderEqualityPlans,20132. Share(%)R&DPersonnelworkinginRPOsthatadoptedGender

EqualityPlans,20133. ImplementationofgenderequalitymeasuresinRPOs,2013

MORE2 Survey ERA Survey

ERA Survey - discontinued in 2016 ERA monitoring exercise

Continuity will be an issue for ~ 30% of the figures in the Working Conditions chapter of SF2018

Alternatives?Change in methodology à New data likely not

comparable to old data

MORE3 Survey - results for 2016 expected to be released end 2016

Continuity will not be an issue for SF2018

5

DataGapsinWorkingConditions

ExampleofalternativesforgenderequalityplansinRPOs:§ JRCpolicyrepository(Nat'l.levelonly):

§ Legal/policyinitiativesandincentivesrelatedtowomenresearchers'recruitment,retentionandcareerprogression

§ Policies/measuressupportingculturalandinstitutionalchangeongender

§ IntegrationintoWiS questionnaire:§ Advantage:Eliminatecontinuity/dependencyissue,reducingtheriskoffuturebreakintimeseriesformonitoringprogress

§ Disadvantage:IncreaseStatisticalCorrespondentworkload(alreadyverytightdatacollectiontimeframe)

6

DataGapsinWorkingConditionsFeasibilityofintegrationinWiS

Indicator%ofrespondentswhoknowofpre-existingnatl.data(N=32)

%ofrespondentswhocouldsendaquestionnairetoRPOsindifferentsectorsHES GOV BES PNP

Existenceof Gender EqualityPlan orequivalentwithinRPOs

16%

38% 28% 22% 19%

ShareofRPOsoverallR&Dbudgetallocated totheGenderEqualityPlan orequivalent

0%

Existenceofspecificmeasures/actionsintroducedbyRPOstosupporttheGender EqualityPlanorequivalent

9%(or60%)

Unpublished data

7

DataGapsinWorkingConditions

§ PerceivedbarrierstointegrationofquestionsongenderequalityplansinWiS questionnaire:§ Lowperceivedrelevancewhereplansaremandatoryornotexplicitly

encouraged

§ TimeconsumingtoaddquestionsinNationalStatisticalProgrammesàshouldbeplannedwellbeforetheproductionofSF2018starts

§ WiS asastandalonetoolfeedingtheSFpublicationandothers?

§ Othergapsinworkingconditions:§ Proportionofmen/womenresearcherswithchildren:

§ EUstatisticsonincomeandlivingconditions(EU-SILC)

§ Issue: Eurostatdoesnotprovidethedataattheadequateaggregationlevelàsamplesizetoosmallà lowreliabilityofestimates

Availability of reliable and timely indicators is at greatest risk for the

chapter on working conditions

8

WiS DataCollection:SF2015

§ WiSquestionnaireandguidelinesrevisedwithfeedbackfromplenaryandsteeringgroupmeetings§ ReviseddatacollectionstructureinExcelà prefilledquestionnaires

§ 10-weekdatacollectionperiod

§ Single,centralisedemailaddressforalloutgoingandincomingexchangesbetweenstudyteamandSCs§ Automaticallyforwardedtotwoteammemberswhowerethenresponsibleforrespondingdependingonthequestion§ Issueswiththequestionnaireitself(e.g.formatting,morecolumnsneeded)§ Content-relatedquestions(e.g.uncertaintyabouthowtofillatable,questionsrelatedtoguidelines)

§ Biweeklyemailreminderssentfromcentraladdress

9

WiS DataCollection:LessonsLearned

§ Excelprovidesgreatflexibilitybutincreasestheworkloadofthestudyteamatthevalidationandcomputationstages

§ Managingflagswaschallengingà twoseparatesheetswereused(dataandflags)increasingtheriskofprocessingerrors

§ Flaggingemptycellswasinconsistent/incompletemakingitdifficulttodistinguishmissingdatafrom0s

§ Lockedsheetstomaintaintheintegrityofthequestionnaireà ad-hocadjustmentsnecessaryinspecificcasesàmultiplebackandforthwithSC

§ Differencesintheinterpretationoftheguidelinesâ intl.comparability

§ Massemailsarenotthemostefficient/effectivewayofmakingdecisionsorsharinginformation

§ Balancebetweennotoverloadingpeoplewithemails,andtryingtoensurethatanyresponserelevanttoallSCswascirculated

10

WiS DataCollection:Ideasforimprovement?

OnlineplatformwithmultiplewindowsData capture

Seamless integration of data& flag (prefilled)If no data is captured flag is set to (:)Worksheet structure allows filling multiple cells at once

Gui

delin

es

Discussion forum

Engage SCs in discussing the guidelines & their issuesModerated by 2 study team members à homogeneous interpretationNo need to overload SCs with mass emailsFast response rate & transparent communications

Validation toolkit

Outliers in time series and across countriesBreaks in time seriesBetter quality of submitted data ä intl. comparabilityFewer issues æ workload of study team and SCsEasier to meet the tight project schedule

Sign-off by SCsFeeds directly into the validation and computation procedures implemented in MSSQL

11

Futuredirections:R&Iindicators

§ Moreorlessconfirmstheunder-representationofwomenamongstresearchersconsistentwithEurostatdatashowingunder-representationofwomenamongstresearchers§ Increasingvalueofdata:

Reportingondifferencesbetweentheaverageproductionsizeofwomenandmenresearchers

§ Dataneed:#ofresearchersbysexbysubfield

§ Outputsizevariesacrosssubfields

12

Futuredirections:R&Iindicators

§ The%ofpublicationswithagenderdimensionishighestintheSS,HandMS,andlowestinNS,ET,andAS

§ Relevanceisnotuniformacrossfieldsà differentbaselinesareobservedandnotargetsestablishedà iftargetswereset,theyshouldvaryacrossfields

§ Aggregateddataforallfieldsshouldaccountfordifferencesinthespecialisationpatternsofcountries

§ Futurework:GDRCinH2020projectsandrelativecontributionofwomen/menresearcherstovariouspolicyissues(GDRC,OpenAcess,etc.)

13

SpecialThanks!

Studyteam:

Science-MetrixChantale TippettÉric ArchambaultContact: David Campbelldavid.campbell@science-metrix.com

ICFInternationalKaterina MantouvalouLucy Arora

KULeuvenJulie Callaert

Other key contributors:

European Commission,DG-RTDRoberta PattonoViviane Willis-Mazzichi

HelsinkiGrouponGenderinResearch andInnovation&itsStatistical Correspondents

Eurostat,EIGE&OECD

Andalltheunlisted contributors!