keeping ontology development agile
DESCRIPTION
"Invited talk at workshop on laboratory protocol standards, Upsala, 2011 "TRANSCRIPT
![Page 1: Keeping ontology development Agile](https://reader033.vdocuments.site/reader033/viewer/2022061214/547e76c15906b5dd718b469f/html5/thumbnails/1.jpg)
Keeping ontology development Agile
Robert StevensBioHealth Informatics GroupSchool of Computer Science
University of ManchesterOxford RoadManchester
![Page 2: Keeping ontology development Agile](https://reader033.vdocuments.site/reader033/viewer/2022061214/547e76c15906b5dd718b469f/html5/thumbnails/2.jpg)
Motivation
• Ontology development is long and difficult– Never really complete
• Getting the conceptualisations right is hard, because it’s hard
• Requirements change• The underlying science changes• The perfect is the enemy of the good• A counsel of perfection is a counsel of despair• Delivering early and often, changing as necessary
![Page 3: Keeping ontology development Agile](https://reader033.vdocuments.site/reader033/viewer/2022061214/547e76c15906b5dd718b469f/html5/thumbnails/3.jpg)
The Waterfall
Knowledge GatheringKnowledge Gathering
ConceptualisationConceptualisation
EncodingEncoding
EvaluationEvaluation
![Page 4: Keeping ontology development Agile](https://reader033.vdocuments.site/reader033/viewer/2022061214/547e76c15906b5dd718b469f/html5/thumbnails/4.jpg)
Spirals
Knowledge GatheringKnowledge Gathering
ConceptualisationConceptualisation
EncodingEncoding
EvaluationEvaluation
![Page 5: Keeping ontology development Agile](https://reader033.vdocuments.site/reader033/viewer/2022061214/547e76c15906b5dd718b469f/html5/thumbnails/5.jpg)
Elements of agile Programming
• Iterative and incremental• Evolving requirements and solutions• Self-organising and cross-functional teams• Short time boxes; rapid and responsive
development• Doing what is important first• Users embedded in the process and are first
class citizens• Test driven; regular and frequent builds and so
on
![Page 6: Keeping ontology development Agile](https://reader033.vdocuments.site/reader033/viewer/2022061214/547e76c15906b5dd718b469f/html5/thumbnails/6.jpg)
Experiences from the Software Ontology project and others
• A short, six month project to start a software ontology
• Provide a vocabulary to describe software used in bioinformatics analyses and more
• Centre around two requirements gathering workshops
• http://softwareontology.wordpress.com
![Page 7: Keeping ontology development Agile](https://reader033.vdocuments.site/reader033/viewer/2022061214/547e76c15906b5dd718b469f/html5/thumbnails/7.jpg)
SWO people
• Andy Brown (Manchester)
• James Malone (EBI)
• Helen Parkinson (EBI)
• Robert Stevens (Manchester)
![Page 8: Keeping ontology development Agile](https://reader033.vdocuments.site/reader033/viewer/2022061214/547e76c15906b5dd718b469f/html5/thumbnails/8.jpg)
Workshop Programme
• What do you want to say about software? – clustering exercise
• What questions do you want to ask about software in archives? – Clustering activity
• Use cases• Which of these features are most important?• The persona of our users• Describe some software…• Re-visit elements to re-prioritise and so on
![Page 9: Keeping ontology development Agile](https://reader033.vdocuments.site/reader033/viewer/2022061214/547e76c15906b5dd718b469f/html5/thumbnails/9.jpg)
Angels on the head of a pin
![Page 10: Keeping ontology development Agile](https://reader033.vdocuments.site/reader033/viewer/2022061214/547e76c15906b5dd718b469f/html5/thumbnails/10.jpg)
Rules of Engagement
• No death by PowerPoint
• Actually get a workshop to do some work
• No Ontologising
• Show some early results
![Page 11: Keeping ontology development Agile](https://reader033.vdocuments.site/reader033/viewer/2022061214/547e76c15906b5dd718b469f/html5/thumbnails/11.jpg)
Workshop Attendees
THE BRITISH LIBRARY
Bioinformaticians
Bio-ontologists
LibrariansSoftware
Preservation
Data Preservation
Service Registaries
Workflow Repositories
Publishers
Astronomical Data Archive
Biology
Project Managers
![Page 12: Keeping ontology development Agile](https://reader033.vdocuments.site/reader033/viewer/2022061214/547e76c15906b5dd718b469f/html5/thumbnails/12.jpg)
Flow of Events
• Develop Persona to drive other requirements gathering
• Gather an cluster features• Gather and cluster competency questions• Prioritise features• Describe some software (informally)• Develop axiom patterns for the ontology• Describe more software• Do each bit again (and again)
![Page 13: Keeping ontology development Agile](https://reader033.vdocuments.site/reader033/viewer/2022061214/547e76c15906b5dd718b469f/html5/thumbnails/13.jpg)
Persona Headings
• Age
• Background
• Dress Code
• Favourite food
• Work
• Story
![Page 14: Keeping ontology development Agile](https://reader033.vdocuments.site/reader033/viewer/2022061214/547e76c15906b5dd718b469f/html5/thumbnails/14.jpg)
Persona
Brenda the Brenda the BioinformaticianBioinformatician
Brenda the Brenda the BioinformaticianBioinformatician
Percy the Percy the ProfessorProfessorPercy the Percy the ProfessorProfessor
Archie the Software Archie the Software ArchitectArchitect
Rufus the Digital Rufus the Digital Preservation Preservation
ManagerManager
Rufus the Digital Rufus the Digital Preservation Preservation
ManagerManager
Adrian the PhD Adrian the PhD StudentStudent
Bender the RobotBender the RobotBender the RobotBender the Robot
Fergus the FunderFergus the FunderFergus the FunderFergus the Funder
Ollie the Operations Ollie the Operations Support GuySupport Guy
![Page 15: Keeping ontology development Agile](https://reader033.vdocuments.site/reader033/viewer/2022061214/547e76c15906b5dd718b469f/html5/thumbnails/15.jpg)
Features Gathered
SoftwareSoftware
Source Code Location
Interfaces
Dependencies
Supplier
Version
Life Cycle
Configure/run Parameters
AlgorithmsCost of Ownership
Platform
Licenses
ArchitectureData
![Page 16: Keeping ontology development Agile](https://reader033.vdocuments.site/reader033/viewer/2022061214/547e76c15906b5dd718b469f/html5/thumbnails/16.jpg)
Competency questions• What software works best with my dataset?• Does it do what I want or need it do data e.g. render a gif?• Which software tool created this data?• What software can perform task x?• Is it appropriate software for my task?• What are the primary inputs and outputs?• Is this software available as a web service?• What open source, maintained software can I use to process these
in this format?• Where can I get the software?• Is there a mailing list?• How and where has this software been used successfully in the
past?• http://softwareontology.wordpress.com/2011/04/01/user-sourced-
competency-questions-for-software/
![Page 17: Keeping ontology development Agile](https://reader033.vdocuments.site/reader033/viewer/2022061214/547e76c15906b5dd718b469f/html5/thumbnails/17.jpg)
Priority poker
• Estimate the cost and complexity of each feature• Attendees give effort of 0.5, 1, 5, 10, …, 40 and
negotiate• Each attendee has “money” to the value of half
mean effort cost of a feature• The attendees collectively “spend” money on
features…• The result is a priority list of those features the
collective are prepared to buy
![Page 18: Keeping ontology development Agile](https://reader033.vdocuments.site/reader033/viewer/2022061214/547e76c15906b5dd718b469f/html5/thumbnails/18.jpg)
Ontology Modules
Interfaces
Data
SWO
Algorithms
Licenses
Maturity
Objectives
OrganizationsVersions
![Page 19: Keeping ontology development Agile](https://reader033.vdocuments.site/reader033/viewer/2022061214/547e76c15906b5dd718b469f/html5/thumbnails/19.jpg)
Implementation route
Requirements
Priority Poker
Implementation of top
requirements
Evaluation
![Page 20: Keeping ontology development Agile](https://reader033.vdocuments.site/reader033/viewer/2022061214/547e76c15906b5dd718b469f/html5/thumbnails/20.jpg)
Requirements priorities change
• In workshop one “hardware platform” was not prioritised
• In workshop two it was
• Working through examples indicated that it was important
• Add some “doing” to the #”thinking”….
![Page 21: Keeping ontology development Agile](https://reader033.vdocuments.site/reader033/viewer/2022061214/547e76c15906b5dd718b469f/html5/thumbnails/21.jpg)
Populating the Ontology Modules
![Page 22: Keeping ontology development Agile](https://reader033.vdocuments.site/reader033/viewer/2022061214/547e76c15906b5dd718b469f/html5/thumbnails/22.jpg)
What we’ve Learnt
• Collaborative authoring doesn’t mean everyone writes axioms
• Not everyone has to be a trained ontologist• Can separate knowledge gatherring from
axiomatisation (esp. via spreadsheets)• Ontologising is important, but not all the time
and not for everyone• Priorities change• One can manage workshops to have everyone
contribute and avoid “wars of words”• Don’t try to achieve everything in one go
![Page 23: Keeping ontology development Agile](https://reader033.vdocuments.site/reader033/viewer/2022061214/547e76c15906b5dd718b469f/html5/thumbnails/23.jpg)
Questions
• What features and characteristics of an experiment must be recorded to enable replicability?
• What features and characteristics of an experiment need not be recorded to enable replicability?
• What questions would you like to be able to ask of a repository of experimental protocols?