virtual institute for social research: powered by ... · by discovery environment, irods and...

VIRTUALINSTITUTEFORSOCIALRESEARCH:POWEREDBYDISCOVERYENVIRONMENT,IRODS ANDDATAVERSE

THEODUMINSTITUTEFORRESEARCHINSOCIALSCIENCEDAVISLIBRARY, 2ND FLOOR,CB#3355UNIVERSITYOFNORTHCAROLINAATCHAPELHILLWWW.ODUM.UNC.EDU

MIKECONWAY

DICEGroup

JONATHANCRABTREE

OdumInstitute

MATTHEWKRAUSE

DICEGroup

DONSIZEMORE

OdumInstitute

OVERVIEW¡ WhatisVISR

¡ VISRcomponents

¡ DiscoveryEnvironment

¡ VISRusecasesandnextsteps

¡ DFC/OdumeffortstoadoptDE

¡ Integratingmobiledevices

¡ Matt&Ceasar

VISR/DISCOVERYENVIRONMENTDRAFTOVERVIEWVIDEO

VIRTUALINSTITUTEFORSOCIALRESEARCH(VISR)

GENERATE MANAGE

USESHARE

A platform for services & tools…

…to sustain the data lifecycle…

…and enable better science.

« More mileage from every dataset

« More transparency & replicability

« More collaboration

« New insights

VIRTUALINSTITUTEFORSOCIALRESEARCH(VISR)

COUPLINGSYSTEMSFORSOCIALSCIENTISTS

¡ CyVerse DiscoveryEnvironment(DE)

¡ iRODS

¡ Dataverse

ODUMINSTITUTEDATAVERSE

http://arc.irss.unc.edu/dvn/

ODUMINSTITUTEDATAVERSE

31,896 146,272534,728

PUBLISHED STUDIES

AVAILABLE FILES

FILE DOWNLOADS

GROWINGDATAVERSECOMMUNITY

Peking University:● Custom homepage ● Internationalization ● EZID Support

Scholars Portal:● Archivematica Integration● Internationalization

Odum Institute at UNC:● iRods Integration

Dataverse Installations

Harvard:● Core Development Team● Support Team● Birthplace of Dataverse

SlidebyE.Quigleyhttp://dataverse.org/presentations/dataverse-community-future-work

VISRDEINALPHAPHASETESTING

DATAMANAGEMENT,ANALYSIS,ANDSHARING

¡ ExpandablewithDOCKERtools

¡ Createcustomworkflowsandapplications

¡ Upload,shareandmanagedata

¡ Shareandexchangecustomworkflows

¡ Scheduling viaCONDOR

¡ PoweredbyiRODS datamanagement

¡ Scalableanalysiswithsimple touse interface

¡ Dataaccessible withanyiRODS interface

¡ Abilitytoaddandtrackcustommetadata

CURRENTODUMDEMONSTRATIONS¡ R Statistical Analysis

¡ Library of Congress BagIt Packager

SOCIALSCIENCECOMMUNITYBENEFITSFROMVISR

¡ Scalableresources

¡ Workflowmanagement

¡ Jobscheduling

¡ Communitybased datasharing

¡ Rules baseddatamanagement

¡ Automatedmetadatageneration

¡ Streamlined publication ofdata

¡ Secureenvironmenttosharesensitive data

¡ Sharedapplications andcode

5. Data publication4. Data verification3. Data submission

1. Article submission

REPLICATIONDATAVERIFICATION

2. Conditional accept 6. Final accept 7. Article publication

AUTOMATEDARCHIVEPRESERVATIONACTIONS

HIGHPRIORITYNEXTSTEPS

¡ PublishtoDataverse

¡ InCommonAuthentication

¡ Handle SensitiveData

¡ FederationbetweenDE’s

CURRENTDISCOVERYENVIRONMENTEFFORTS

¡ iRODSonitswaytoindustrial grade¡ CyVerseaddsaseasoned, production-readymiddleware layeranduser

environmentfordatadrivenresearch

CURRENTDISCOVERYENVIRONMENTEFFORTS

¡ Odum,CyVerse,andDFCdevelopers havesuccessfully broughtDEupoutsideofCyVerse.

¡ https://github.com/angrygoat/DE¡ WorkingtowardsaCyVerse ‘communityDE’release thatweintendtofocuson,

andcontributeto.

CURRENTSTATE

¡ Developed a‘referenceimplementation’ thatincludes defaultenvironmentsuitable fortesting,prototyping.

¡ Successfully integratedsocialscience, hydrology,andoceanscienceresearchersthroughpolicies andcomputational toolprovisioning.

¡ RightafterUserGroupMeetingwearemutuallydoingproductiondeployments

CURRENTDEVELOPMENTS/ENHANCEMENTS

¡ Addingapluggable publishmechanism, capableofusing ‘apps’framework,thatallowscollections iniRODStobeformattedanddisseminated usingmultiple vectors.CurrenttargetsareDataONEandDataverse.

¡ Addingcapability topublishgriddataasaDataONEmembernode.

COMPUTATIONALRESOURCES

Storage Storage Storage Storage+Compute

Storage+Compute

iRODS

DE

COMPUTATIONALRESOURCES

Storage Storage Storage Storage+Compute

Storage+Compute

iRODS PEP

● Metadataextraction, NLP● Subsetting● Indexing● Publishing

ACKNOWLEDGEMENTSANDTHANKSTOMANY

¡ RENCI

¡ CyVerse

¡ DFC

¡ iRODS Consortium

¡ DonSizemore

¡ MikeConway

¡ LisaStillwell

¡ ReaganMoore

¡ Nirav Merchant

¡ DennisRoberts

¡ KashaMammone

¡ HelenTibbo

¡ CalLee

¡ AkioSone

¡ RodneyHodson

¡ CraigWillis

NationalScienceFoundationCooperativeAgreement:OCI-0940841

LINKS

¡ http://dx.doi.org/10.7910/DVN/ITNETO

¡ https://github.com/DICE-UNC/dfc-dataverse-integration¡ https://github.com/DICE-UNC/indexing-irods¡ https://github.com/akio-sone/dvn/tree/Odum-Ext¡ https://github.com/donsizemore/odum/tree/master/irods_rules

¡ http://datafed.org¡ http://www.odum.unc.edu/odum/home2.jsp¡ http://Dataverse.org¡ http://nationaldataservice.org

THANKS!

FollowusonTwitter@Odum_Institute

SubscribetoourChannelTheOdumInstitute

OurWebsitewww.odum.unc.edu

JonathanCrabtreeJonathan_Crabtree@unc.edu