aaron ponti - eth zürich - homepage | eth zürich · obit – openbis importer toolset the openbis...

33
Aaron Ponti Single Cell Unit, D-BSSE ETHZ (Basel) [email protected] EUBIAS 2015 Paris, January 6 th , 2015

Upload: others

Post on 28-Aug-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Aaron Ponti - ETH Zürich - Homepage | ETH Zürich · oBIT – openBIS Importer Toolset The openBIS Importer Toolset is a tightly integrated collection of tools that allows for the

Aaron Ponti Single Cell Unit, D-BSSE ETHZ (Basel) [email protected]

EUBIAS 2015 Paris, January 6th, 2015

Page 2: Aaron Ponti - ETH Zürich - Homepage | ETH Zürich · oBIT – openBIS Importer Toolset The openBIS Importer Toolset is a tightly integrated collection of tools that allows for the

Tuesday 13 January 15 2 Single Cell Unit / D-BSSE

Raw data

centralized storage

HRM

backed up annotated

Page 3: Aaron Ponti - ETH Zürich - Homepage | ETH Zürich · oBIT – openBIS Importer Toolset The openBIS Importer Toolset is a tightly integrated collection of tools that allows for the

openBIS – open Biology Information System

openBIS  is an extensible, open source software framework for constructing user-friendly, scalable and powerful information systems for data and metadata acquired in biological experiments. It enables users to collect, integrate, share, publish data and to connect to data processing pipelines. http://www.cisd.ethz.ch/software/openBIS

3 Tuesday 13 January 15 Single Cell Unit / D-BSSE

Page 4: Aaron Ponti - ETH Zürich - Homepage | ETH Zürich · oBIT – openBIS Importer Toolset The openBIS Importer Toolset is a tightly integrated collection of tools that allows for the

§  Separate metadata (application server) and data (data store server) §  Clean and flexible hierarchical metadata structure:

§  Space > Project > Experiment > Sample > Dataset > File §  Authorization at space level §  Samples and datasets: entities have parent/child or container relationships §  Datasets belong to samples or experiments §  All entities have user defined types, properties and vocabularies §  Attachments can be associated to most entities

§  Information indexing and searching by metadata §  Rich set of APIs and plug-in interfaces

§  Java, Python (Jython), RESTful web services

openBIS core

Tuesday 13 January 15 4 Single Cell Unit / D-BSSE

Page 5: Aaron Ponti - ETH Zürich - Homepage | ETH Zürich · oBIT – openBIS Importer Toolset The openBIS Importer Toolset is a tightly integrated collection of tools that allows for the

§  Core plug-ins §  Dropboxes (dataset ingestion) §  Master data (import/export/update) §  Data sources (additional databases) §  Aggregation (reporting) plug-ins (metadata collection) §  Processing plug-ins (on datasets) §  Ingestion plug-ins (create/update entities) §  Maintenance tasks (update/fix) §  Web applications / RESTful web services (custom openBIS views)

§  An organized set of core plug-ins can become a “core technology” §  Core plug-ins extend openBIS APIs to interface with custom client

apps

openBIS extensions

Tuesday 13 January 15 5 Single Cell Unit / D-BSSE

Page 6: Aaron Ponti - ETH Zürich - Homepage | ETH Zürich · oBIT – openBIS Importer Toolset The openBIS Importer Toolset is a tightly integrated collection of tools that allows for the

openBIS “vanilla”

Page 7: Aaron Ponti - ETH Zürich - Homepage | ETH Zürich · oBIT – openBIS Importer Toolset The openBIS Importer Toolset is a tightly integrated collection of tools that allows for the

Current technologies

Tuesday 13 January 15 7 Single Cell Unit / D-BSSE

Page 8: Aaron Ponti - ETH Zürich - Homepage | ETH Zürich · oBIT – openBIS Importer Toolset The openBIS Importer Toolset is a tightly integrated collection of tools that allows for the

Screening core technology

Tuesday 13 January 15 8 Single Cell Unit / D-BSSE

Page 9: Aaron Ponti - ETH Zürich - Homepage | ETH Zürich · oBIT – openBIS Importer Toolset The openBIS Importer Toolset is a tightly integrated collection of tools that allows for the

Custom web apps

Tuesday 13 January 15 9 Single Cell Unit / D-BSSE

Page 10: Aaron Ponti - ETH Zürich - Homepage | ETH Zürich · oBIT – openBIS Importer Toolset The openBIS Importer Toolset is a tightly integrated collection of tools that allows for the

Custom web apps

Tuesday 13 January 15 10 Single Cell Unit / D-BSSE

Page 11: Aaron Ponti - ETH Zürich - Homepage | ETH Zürich · oBIT – openBIS Importer Toolset The openBIS Importer Toolset is a tightly integrated collection of tools that allows for the

Custom web apps

Tuesday 13 January 15 11 Single Cell Unit / D-BSSE

Page 12: Aaron Ponti - ETH Zürich - Homepage | ETH Zürich · oBIT – openBIS Importer Toolset The openBIS Importer Toolset is a tightly integrated collection of tools that allows for the

Embedded openBIS

Tuesday 13 January 15 12 Single Cell Unit / D-BSSE

Page 13: Aaron Ponti - ETH Zürich - Homepage | ETH Zürich · oBIT – openBIS Importer Toolset The openBIS Importer Toolset is a tightly integrated collection of tools that allows for the

Embedded openBIS

Tuesday 13 January 15 13 Single Cell Unit / D-BSSE

Page 14: Aaron Ponti - ETH Zürich - Homepage | ETH Zürich · oBIT – openBIS Importer Toolset The openBIS Importer Toolset is a tightly integrated collection of tools that allows for the

Tuesday 13 January 15 14 Single Cell Unit / D-BSSE

Raw data

centralized storage

HRM

backed up annotated

Page 15: Aaron Ponti - ETH Zürich - Homepage | ETH Zürich · oBIT – openBIS Importer Toolset The openBIS Importer Toolset is a tightly integrated collection of tools that allows for the

oBIT – openBIS Importer Toolset

The openBIS Importer Toolset is a tightly integrated collection of tools that allows for the semi-automated, semi-unsupervised registration of annotated datasets into openBIS directly from the acquisition stations. It also extends openBIS with custom data viewers and server-side core plug-ins packaged into two new official core technologies (flow cytometry and microscopy).

15 Tuesday 13 January 15 Single Cell Unit / D-BSSE

Page 16: Aaron Ponti - ETH Zürich - Homepage | ETH Zürich · oBIT – openBIS Importer Toolset The openBIS Importer Toolset is a tightly integrated collection of tools that allows for the

openBIS

Data store openBIS

Tuesday 13 January 15 16 Single Cell Unit / D-BSSE

Export or save

as a Windows service

Acquisition station

dropbox

Example: BD LSRFortessa cell analyzer

Scan

Annotate

Incoming

User folder

Annotation Tool

Page 17: Aaron Ponti - ETH Zürich - Homepage | ETH Zürich · oBIT – openBIS Importer Toolset The openBIS Importer Toolset is a tightly integrated collection of tools that allows for the

[Admin] Annotation Tool Admin

Tuesday 13 January 15 17 Single Cell Unit / D-BSSE

An administrator must set up the acquisition machine before the first use.

Page 18: Aaron Ponti - ETH Zürich - Homepage | ETH Zürich · oBIT – openBIS Importer Toolset The openBIS Importer Toolset is a tightly integrated collection of tools that allows for the

[Admin] Annotation Tool Admin

Tuesday 13 January 15 18 Single Cell Unit / D-BSSE

Set the openBIS URL(s)

Page 19: Aaron Ponti - ETH Zürich - Homepage | ETH Zürich · oBIT – openBIS Importer Toolset The openBIS Importer Toolset is a tightly integrated collection of tools that allows for the

[Admin] Annotation Tool Admin

Tuesday 13 January 15 19 Single Cell Unit / D-BSSE

Select the acquisition station or type

Page 20: Aaron Ponti - ETH Zürich - Homepage | ETH Zürich · oBIT – openBIS Importer Toolset The openBIS Importer Toolset is a tightly integrated collection of tools that allows for the

[Admin] Annotation Tool Admin

Tuesday 13 January 15 20 Single Cell Unit / D-BSSE

Set the local working directories

Page 21: Aaron Ponti - ETH Zürich - Homepage | ETH Zürich · oBIT – openBIS Importer Toolset The openBIS Importer Toolset is a tightly integrated collection of tools that allows for the

[User] Annotation Tool

Tuesday 13 January 15 21 Single Cell Unit / D-BSSE

pontia

●●●●●●●●●●●●

Page 22: Aaron Ponti - ETH Zürich - Homepage | ETH Zürich · oBIT – openBIS Importer Toolset The openBIS Importer Toolset is a tightly integrated collection of tools that allows for the

[User] Annotation Tool

Tuesday 13 January 15 22 Single Cell Unit / D-BSSE

pontia

●●●●●●●●●●●●

Page 23: Aaron Ponti - ETH Zürich - Homepage | ETH Zürich · oBIT – openBIS Importer Toolset The openBIS Importer Toolset is a tightly integrated collection of tools that allows for the

Tuesday 13 January 15 23 Single Cell Unit / D-BSSE

1

2

3

4 5

6

Incoming

User folder

Page 24: Aaron Ponti - ETH Zürich - Homepage | ETH Zürich · oBIT – openBIS Importer Toolset The openBIS Importer Toolset is a tightly integrated collection of tools that allows for the
Page 25: Aaron Ponti - ETH Zürich - Homepage | ETH Zürich · oBIT – openBIS Importer Toolset The openBIS Importer Toolset is a tightly integrated collection of tools that allows for the
Page 26: Aaron Ponti - ETH Zürich - Homepage | ETH Zürich · oBIT – openBIS Importer Toolset The openBIS Importer Toolset is a tightly integrated collection of tools that allows for the
Page 27: Aaron Ponti - ETH Zürich - Homepage | ETH Zürich · oBIT – openBIS Importer Toolset The openBIS Importer Toolset is a tightly integrated collection of tools that allows for the
Page 28: Aaron Ponti - ETH Zürich - Homepage | ETH Zürich · oBIT – openBIS Importer Toolset The openBIS Importer Toolset is a tightly integrated collection of tools that allows for the

User scratch folder

Tuesday 13 January 15 28 Single Cell Unit / D-BSSE

Page 29: Aaron Ponti - ETH Zürich - Homepage | ETH Zürich · oBIT – openBIS Importer Toolset The openBIS Importer Toolset is a tightly integrated collection of tools that allows for the

Deconvolution (Huygens Remote Manager)

Tuesday 13 January 15 29 Single Cell Unit / D-BSSE

Page 30: Aaron Ponti - ETH Zürich - Homepage | ETH Zürich · oBIT – openBIS Importer Toolset The openBIS Importer Toolset is a tightly integrated collection of tools that allows for the

openBIS – new technologies

Tuesday 13 January 15 30 Single Cell Unit / D-BSSE

Page 31: Aaron Ponti - ETH Zürich - Homepage | ETH Zürich · oBIT – openBIS Importer Toolset The openBIS Importer Toolset is a tightly integrated collection of tools that allows for the

https://wiki-bsse.ethz.ch/display/oBIT

Tuesday 13 January 15 31 Single Cell Unit / D-BSSE

Page 32: Aaron Ponti - ETH Zürich - Homepage | ETH Zürich · oBIT – openBIS Importer Toolset The openBIS Importer Toolset is a tightly integrated collection of tools that allows for the

§  The openBIS/openBIS Importer Toolset synergy aims to:

§  offer a powerful and scalable data and metadata management system

§  streamline data registration directly from the acquisition machines

§  support multiple acquisition hardware classes

§  offer a reasonably simple way for third parties to add support for new hardware classes

Summary

Tuesday 13 January 15 32 Single Cell Unit / D-BSSE

Page 33: Aaron Ponti - ETH Zürich - Homepage | ETH Zürich · oBIT – openBIS Importer Toolset The openBIS Importer Toolset is a tightly integrated collection of tools that allows for the

SIS Bernd Rinn Chandrasekhar Ramakrishnan Piotr Kupczyk Antti Luomi Jakub Straszewski Franz-Josef Elmer Juan Fuentes Serna Pawel Glyzewski Caterina Barillari Manuel Kohler

Acknowledgments

Tuesday 13 January 15 33 Single Cell Unit / D-BSSE

ITSC Vernon Bailey Simon Paul Diethelm John Ryan Andreas Jecklin

openBIS http://www.cisd.ethz.ch/software/openBIS

oBIT https://wiki-bsse.ethz.ch/display/oBIT http://www.scs2.net/next/index.php?id=150 https://github.com/aarpon