collaborative management environment cio technical presentation thomas e. potok and mark elmore...

Collaborative Management Environment

CIO Technical Presentation

Thomas E. Potok and Mark ElmoreCollaborative Technologies Research CenterComputer Science and Mathematics Division

Oak Ridge National Laboratory

Collaborative Management Environment: Goals and Objectives

Create an environment to Create an environment to financially manage and analyze financially manage and analyze research funding research funding Minimal impact to the Minimal impact to the

laboratorieslaboratories Provide complete and Provide complete and

consistent data to DOEconsistent data to DOE Gain an order of magnitude Gain an order of magnitude

efficiency in the proposal efficiency in the proposal submission processsubmission process

Provide a safe and trusted Provide a safe and trusted environment for researchers and environment for researchers and program managersprogram managers

Reuse information from Reuse information from proposals to populate the R&D proposals to populate the R&D tracking databasetracking database

Current situation

Field Work Proposals (FWPs) submitted to Field Work Proposals (FWPs) submitted to DOE are in paper booksDOE are in paper books

Weeks and thousands of dollars are spend Weeks and thousands of dollars are spend in collating, copying, binding, and shipping in collating, copying, binding, and shipping these booksthese books

The books provide very limited query and The books provide very limited query and search capabilitysearch capability

This paper system makes management of This paper system makes management of research programs very difficultresearch programs very difficult

CME Pilot Goals

Plan to develop a pilot based on FWP data from three labsPlan to develop a pilot based on FWP data from three labs ORNLORNL LANLLANL FNLFNL

Gathering lab dataGathering lab data Different formatsDifferent formats Very limited resources from the labsVery limited resources from the labs

Initial software commitment problemsInitial software commitment problems Lab feedbackLab feedback

We want the capability of CME, We want the capability of CME, howeverhowever…they have “been …they have “been burned before…”burned before…”

We will be unable to provide data in needed format due to lack of We will be unable to provide data in needed format due to lack of resource.resource.

Information Integration Alternatives Distributed relational databases (Data Warehouse)Distributed relational databases (Data Warehouse)

Too expensive for labs to setup and maintainToo expensive for labs to setup and maintain Object Request BrokersObject Request Brokers

Too expensive for labsToo expensive for labs Too complex for our needsToo complex for our needs

Groupware (Lotus Notes)Groupware (Lotus Notes) Too expensive for the labsToo expensive for the labs Lack of flexibility in formats supportedLack of flexibility in formats supported

HTML and internetHTML and internet Difficult to store and manage structured dataDifficult to store and manage structured data XML provides a possibilityXML provides a possibility

Distributed Information through XML Strengths - Strengths - We are at the ground level of this technologyWe are at the ground level of this technology

XML is the de-facto standard, accepted by Microsoft, XML is the de-facto standard, accepted by Microsoft, Sun, IBM, and the software industry in generalSun, IBM, and the software industry in general

XML allows simple storage of structured, distributed XML allows simple storage of structured, distributed datadata

XML allows queries and data presentationXML allows queries and data presentation Weakness - Weakness - We are at the ground level of this We are at the ground level of this

technologytechnology XML is an evolving standardXML is an evolving standard The tools to support XML are limited, and weakThe tools to support XML are limited, and weak Supporting standards for data presentation are very Supporting standards for data presentation are very

limitedlimited

Approach Data model developed with LANL, FNL, Data model developed with LANL, FNL,

ORNL, and OSTIORNL, and OSTI Reviewed by business systems experts as well as Reviewed by business systems experts as well as

technical expertstechnical experts Pioneered use of XML as a means of storing, Pioneered use of XML as a means of storing,

querying, and presenting FWP information.querying, and presenting FWP information. Simple data storage technologySimple data storage technology Very low costs to the labs, integration work done Very low costs to the labs, integration work done

by CME teamby CME team Very well received article at XML’98Very well received article at XML’98

Sample FWP

CME Data Mapping Example

CME Pilot Data Model Sample

CME Information Model

has

1

has1

has

1

parentOf 1

partOf

1..n

PartOf

1

1..n

contains

contains

ParentOf1

Project

Funding

ParentOf

1

HasReport

1

1..n

Reporttypetext

HasCostEstimate

1..n

1

OutyearCostEstimateoutyearamount

HasResult

1..n

1..n

Deliverabletype

HasSubcontractor

1..n

1..n

Subcontractornamecode

HasMajorCostAttachment

1

1..n

HasEquipmentAttachment

1

1..nHasBudgetAttachment

1

1..n

BudgetAttachmentnamefyamount

HasRequestedEquipment

1

1..n

HasRequestedFunds

1

1..n

HasRequestedStaff

1..n

1

StaffResourcesnameyearSpecificationamount

HasMilestone

1..n1

MilestoneTasknameamountProposedamountAuthorizeddateProposeddateAuthorized

PIWorksFor1..n 1

PMWorksFor

1..n

1

OOReviewerWorksFor

1..n

1

DOEPMWorksFor

1..n

1

HQOrganizationnamecode

ManagesProposal

1..n

1

ReviewedBy

1..n

1

ManagedAtDOEBy

1..n

1

DOEProgramManagernamephone

IsResponsible

1..n

1..n

PInamephone

HasRDCosts

1..n

1

Costs

1..n

1..n

RDCostRecordtotalCostidfundingTypeurlnonFederalPercent

HasAttachment

1

Funds

1..n

1

DOEProgrambrCode

Attachmenttypenametext

HasTimeStamp

1

1

ProposalidtitlerevisionNoinstitutionalPlanningFlagdescriptionreportingRequirements

TimestartDatecompletionDatedatePrepared

OOReviewernamephone

ProposalManagernamephone

OperationsOfficenamecode

Contractornamecodezipcountry

FundsResourcesnameyearSpecificationamount

EquipmentResourcesnameyearSpecificationamount

EquipmentAttachmentnamefycostAmountobligationAmount

MajorCostAttachmentnamefyamount

Research PeriodYears

Research TopicTopic

Sample XML file<cme-proposal>

<proposal-rec-item><proposal>

<ben> 19980727115540408 </ben><work-prop-no>

ERKJE09 </work-prop-no><work-prop-title>

Collaborative Management Environment</work-prop-title><rev-no>

0 </rev-no><inst-plan-flag>

Y</inst-plan-flag><work-prop-desc>

The Collaborative Management Environment (CME) is a jointresearch project between the Oak Ridge NationalLaboratory (ORNL) and Lawrence Berkely NationalLaboratory (LBNL) that is funded by the U.S. Departmentof Energy (DOE). CME is designed to support …

</work-prop-desc><fwp-rpt-rqmt>

Results will be reported in periodic highlights to DOEand in peer-reviewed journals and conference proceedings.

</fwp-rpt-rqmt></proposal>

…</proposal-rec-item>

</cme-proposal>

Keyword Search

Gathering Data from the LabsOriginal Lab FWP

Lab XML Formats

CommonXMLFormat

LabHTMLFormat

CommonSQLFormat

Infoseek HTML Registry

Keyword and Schema Search

LANL

ORNL

CMETitlePIDate

New CME Tools Developed

Original Lab FWP

Lab XML Formats

CommonXMLFormat

LabHTMLFormat

CommonSQLFormat

Infoseek HTML Registry


LANL

ORNL

CMETitlePIDate

Data Translation to XML

XML To HTMLGenerator

XML to SQL Generator

Future VisionOriginal Lab FWP

Lab XML Formats

CommonXMLFormat

LabXSLFormat

CommonSQLFormat


LANL

ORNL

CMETitlePIDate

Full CME System

CMEClient

CMEServer

WebBrowser

OracleDatabase

LogicSocket

DataSocket

DataSocket

NetscapeWeb

Server

CMEData Model

Funding

ProposalProject

XMLData

HTMLData

InfoseekHTML

Registry

DTDs

Manual

Automatic

Operational

DataSocket

Lab FWPReport

CTRC

Phthia

CTRCNenad NT

Key Pilot Milestones

1998 ORNL and LANL data in CME Pilot1998 ORNL and LANL data in CME Pilot Distributed information using XMLDistributed information using XML Low-cost participation by ORNL and LANL, (only 2 Low-cost participation by ORNL and LANL, (only 2

person-days from the lab is required!)person-days from the lab is required!) Lab information presented in lab FWP formatLab information presented in lab FWP format Capable of adding a new lab in 1 month or lessCapable of adding a new lab in 1 month or less

Very strong interest in CME, limit lab resourcesVery strong interest in CME, limit lab resources Fermi participation delayedFermi participation delayed Berkeley is very interestedBerkeley is very interested PPPL will participate in the futurePPPL will participate in the future

Extended Pilot Goals

Add three labs to the CME systemAdd three labs to the CME system Strive for a wide representation over the DOE Strive for a wide representation over the DOE

laboratory systemlaboratory system Add OSTI to the development teamAdd OSTI to the development team

Begin transition to production through training, Begin transition to production through training, and development of key database componentsand development of key database components

Begin merger of CME and R&D Tracking data Begin merger of CME and R&D Tracking data models models

Prototype CME and R&D Tracking interactionPrototype CME and R&D Tracking interaction

Pilot Findings Not all labs have data in database format, Not all labs have data in database format,

Full databases (ORNL, SNL)Full databases (ORNL, SNL) Partial databases (LANL)Partial databases (LANL) MS Word template (LBNL, PNNL, LANL)MS Word template (LBNL, PNNL, LANL) Scanned images (PNNL)Scanned images (PNNL)

General situation General situation First page of the FWP created from a word First page of the FWP created from a word

processing package by the PI, then printed. The processing package by the PI, then printed. The source file is lost.source file is lost.

Financial data is manually entered into a financial Financial data is manually entered into a financial databasedatabase

How to get ALL labs into CME? Scan paper documents into CMEScan paper documents into CME

Benefit: All labs can participate Benefit: All labs can participate Drawbacks: Drawbacks:

Another step and more cost is added to the processAnother step and more cost is added to the process Limited searching capabilityLimited searching capability Limited presentation capabilityLimited presentation capability

Require labs to present information in database report formatRequire labs to present information in database report format Benefit: Pilot can be moved into production immediately for some labs Benefit: Pilot can be moved into production immediately for some labs Drawback: A heavy burden for a number of labs that may take years to Drawback: A heavy burden for a number of labs that may take years to

supportsupport Capture electronic information from PIsCapture electronic information from PIs

Benefit: PI’s original information is capturedBenefit: PI’s original information is captured Drawback: Drawback:

The structure of the information is lostThe structure of the information is lost Central control of the data is lostCentral control of the data is lost

Word Processor Support BenefitsBenefits

Richer description for the Program ManagerRicher description for the Program Manager In the current paper based system, an FWP is limited to text In the current paper based system, an FWP is limited to text

only.only. CME will allow a proposal to contain any of the following: CME will allow a proposal to contain any of the following:

• Equations, Equations, • Graphs, Graphs, • Audio, Audio, • Video, Video, • VR, VR, • Any future web presentation technologies.Any future web presentation technologies.

The FWPs are keyword searchableThe FWPs are keyword searchable The information resides at the labs under lab controlThe information resides at the labs under lab control PI has full control over how an FWP looksPI has full control over how an FWP looks

Word Processor Support

DrawbacksDrawbacks The FWPs are not field searchable, only The FWPs are not field searchable, only

keyword searchablekeyword searchable Labs and PIs need to slightly change their Labs and PIs need to slightly change their

processes to:processes to:Save the word processor files as HTMLSave the word processor files as HTMLPost the FWP page at the sitePost the FWP page at the site

PI has full control over how an FWP looksPI has full control over how an FWP looks

Extended Pilot participant labs Currently we are working closely with:Currently we are working closely with:

ORNLORNL LANLLANL SandiaSandia PNNLPNNL

Have contacts with: LBNL, Fermi, PPPL, and, SLACHave contacts with: LBNL, Fermi, PPPL, and, SLAC These labs represent a broad range of differing formats, These labs represent a broad range of differing formats,

and approaches to FWPsand approaches to FWPs The lab representatives are very supportive of the extended The lab representatives are very supportive of the extended

pilot approach!pilot approach! Major issue are business related rather than Major issue are business related rather than

technicaltechnical

Summary

Pilot demonstrated the gathering of FWP data Pilot demonstrated the gathering of FWP data from two labsfrom two labs

Extended Pilot to add three labs to the CME Extended Pilot to add three labs to the CME systemsystem Supporting all lab FWP formatsSupporting all lab FWP formats Partnering with OSTI Partnering with OSTI Merging with R&D Tracking DatabaseMerging with R&D Tracking Database

Estimated annual savings to $1MEstimated annual savings to $1M Poised for a successful deployment of CMEPoised for a successful deployment of CME

collaborative management environment cio technical presentation thomas e. potok and mark elmore...

Documents

distributed data u xml

technology u xml

structured data u xml

labs u ornl u lanl u

general u xml

laboratories u

osti u

weak u