oddc at ictd2013 - research methods discussion - expert survey and composite index
DESCRIPTION
At ICTD2013 the Exploring the Emerging Impacts of Open Data in Developing Countries (ODDC) network discussed different methods for open data research. This presentation provides an overview of the Open Data Barometer methodology.TRANSCRIPT
Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org
The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).
The Open Data Barometer
• Building on the 2012 Web Index
• Based on primary expert survey data & secondary indicator data
• A pilot methodology to provide a macro-level picture of open data policy and practice
Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org
The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).
The process...
Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org
The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).
The process...
Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org
The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).
The process...
Literature review
Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org
The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).
The process...
Literature review
Idea storm
Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org
The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).
The process...
Literature review
Review of qualitative cases
Idea storm
Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org
The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).
The process...
Literature review
Review of qualitative cases
Idea storm
Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org
The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).
The process...
Context & impact themes
Literature review
Review of qualitative cases
Idea storm
Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org
The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).
The process...
Context & impact themes
Supply side questions
Literature review
Review of qualitative cases
Idea storm
Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org
The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).
The process...
Context & impact themes
Supply side questions
Literature review
Review of qualitative cases
Idea storm
Secondary datashortlist
Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org
The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).
The process...
Context & impact themes
Supply side questions
Literature review
Review of qualitative cases
Idea storm
Expert survey
Secondary datashortlist
Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org
The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).
The process...
Expert survey
Recruit researchers
Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org
The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).
The process...
Expert survey
Recruit researchers
Research handbook
Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org
The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).
The process...
Expert survey
Recruit researchers
Research handbook
Onlinetraining
Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org
The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).
The process...
Expert survey
Recruit researchers
Research handbook
Onlinetraining
Initialresearch
Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org
The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).
The process...
Expert survey
Recruit researchers
Research handbook
Onlinetraining
Initialresearch
Spotcheck
Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org
The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).
The process...
Expert survey
Recruit researchers
Research handbook
Onlinetraining
Initialresearch
Spotcheck
Clarifications
Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org
The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).
The process...
Expert survey
Recruit researchers
Research handbook
Onlinetraining
Initialresearch
Spotcheck
ClarificationsDouble-blindpeer-review
Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org
The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).
The process...
Expert survey
Recruit researchers
Research handbook
Onlinetraining
Initialresearch
Spotcheck
ClarificationsDouble-blindpeer-review
Furtherclarification
Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org
The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).
The process...
Expert survey
Recruit researchers
Research handbook
Onlinetraining
Initialresearch
Spotcheck
ClarificationsDouble-blindpeer-review
Furtherclarification
Technicalreview
Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org
The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).
The process...
Expert survey
Recruit researchers
Research handbook
Onlinetraining
Initialresearch
Spotcheck
ClarificationsDouble-blindpeer-review
Furtherclarification
Cross-checking& calibration
Technicalreview
Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org
The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).
The process...
Expert survey
Recruit researchers
Research handbook
Onlinetraining
Initialresearch
Spotcheck
ClarificationsDouble-blindpeer-review
Furtherclarification
Cross-checking& calibration
Export dataTechnicalreview
Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org
The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).
Question structure...
Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org
The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).
Question structure...
Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org
The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).
Dataset assessment...
Ten point checklista - Does the data exist?
b - Is it available online from government in any form?
c - Is the dataset provided in machine-readable formats?
d - Is the machine-readable data available in bulk?
e - Is the dataset available free of charge?
f - Is the data openly licensed?
g - Is the dataset up to date?
h - Is the publication of the dataset sustainable?
i - Was it easy to find information about this dataset?
j - Are (linked) data URIs provided for key elements of the data?
Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org
The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).
Dataset assessment...
Ten point checklista - Does the data exist?
b - Is it available online from government in any form?
c - Is the dataset provided in machine-readable formats?
d - Is the machine-readable data available in bulk?
e - Is the dataset available free of charge?
f - Is the data openly licensed?
g - Is the dataset up to date?
h - Is the publication of the dataset sustainable?
i - Was it easy to find information about this dataset?
j - Are (linked) data URIs provided for key elements of the data?Detailed justification data
Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org
The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).
Dataset assessment...
Ten point checklista - Does the data exist?
b - Is it available online from government in any form?
c - Is the dataset provided in machine-readable formats?
d - Is the machine-readable data available in bulk?
e - Is the dataset available free of charge?
f - Is the data openly licensed?
g - Is the dataset up to date?
h - Is the publication of the dataset sustainable?
i - Was it easy to find information about this dataset?
j - Are (linked) data URIs provided for key elements of the data?Detailed justification data
Category definitions and guidance
Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org
The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).
Datasets assessed...
D1: Map data (full map coverage of the country)D2: Land ownership data(D3: Government service directory)D4: Detailed census dataD5: Detailed government budgetD6: Detailed data on government spendD7: Company registerD8: LegislationD9: Public transport timetablesD10: International trade dataD11: Health sector performanceD12: Primary or secondary education performance dataD13: Crime statisticsD14: National environment statisticsD15: National election results
Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org
The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).
Tools...
Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org
The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).
Tools...
Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org
The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).
Analysis...
Z-score normalization
Creation of sub-components (unweighted mean)
Creation of sub-indices(unweighted mean)
Creating of overall ranking
Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org
The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).
The result...
Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org
The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).
The result...
Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org
The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).
The result...
Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org
The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).
The result...
Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org
The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).
The result...
Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org
The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).
Results...
Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org
The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).
Results...
Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org
The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).
Next steps...
• Improving questions, definitions and datasets selected;
• Iterative development of the data collection methodology;
• Checking relevance of created data for policy influence, and supporting in-depth local research;
www.opendatabarometer.org | @timdavies
Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org
The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).
Questions?
www.opendatabarometer.org
Presentation at ICTD2013 - Cape Town - 10th December - www.opendatabarometer.org
The funding for this work has been provided through the World Wide Web Foundation 'Exploring the Emerging Impacts of Open Data in Developing Countries' research project, supported by grant 107075 from Canada’s International Development Research Centre (web.idrc.ca).