welcome to the lter data co-op with pasta (provenance aware synthesis tracking architecture) all...

All Scientists Meeting 2012

WELCOME to the LTER Data Co-op

with PASTA (Provenance Aware Synthesis Tracking Architecture)

Your source

for LT

ER data


What is the Co-op?• The foundations of the Co-op have been laid to provide accessibility

to LTER Data with cooperation (hence the Co-op) from LTER Scientists and the Network Information System

•You (as an LTER Scientist, Information Manager, Grad Student) are a shareholder in the Co-op• The LTER Data Co-op will open for business in December 2012

with core functionality provided by the Provenance Aware Synthesis Tracking Architecture (PASTA)


The goals of the Co-op•Producers (scientists and others) harvest their data into the Co-op

for consumers to use.

•Consumers (researchers, other scientists, graduate students, educators, the general public) go to the Data Portal to find information about various ecological sites and conditions.

•Publication of data is the end result and rather than dollar bills exchanging hands, recognition is the currency for the Data Co-op’s transactions. The more data in the warehouse, the more recognition its members receive


Where can I find the new Co-op?The Co-op is located at

portal.lternet.edu


The highlights…

•How can I contribute data to NIS (the Co-op)?•How do I find data in NIS (the Co-op)?•How does the NIS enable Network synthesis?•How will the NIS maintain data provenance for derived products?•How can I track who is using my data?


How do I contribute data to NIS?1. Select the tools button to manage your data packages within PASTA

2. The NIS recommends always Evaluate your data prior to Harvesting.3. Select Evaluate Data Packages


Evaluating data packages4. Select Browse to find your xml document.5. Once your xml document is listed in the file box, select the evaluate button6. A Data Package Quality Report is generated. One of the columns within the report is status – this status is what’s important in this report: valid, info, warn, error. 7. Once all the errors are cleared, your xml is good to go for Harvesting.


Harvesting data packages• Go back to the tools page and select Harvest Data Packages link.

• If you haven’t logged in prior to this point, you will need to complete your login to gain access to the Harvest functions.


Harvesting data packages• On the Harvest page, data packages can be evaluated prior to being

inserted.

• Note: Batch harvesting is available. A warning message will appear to indicate that the batch harvest may take some time. To view your reports, a link is provided on the tools page.


Viewing Harvest Reports• Select the View Harvest Reports link

• In the Summary Table, the batch of xml files is listed. If you harvest 100 xml files, all 100 packages will be listed in the table.


The highlights…



How do I find data in the data portal?1. Select the Discover button2. Choose from the listed options


How do I search PASTA for information on biomass?• Basic and Advanced Searches can be done without logging in

• The Basic Search searches the dataset title, abstract, and keywords• Just type in your search term and select the search button.


Biomass – Simple Search


Biomass – Selecting a data package• Package Identifier: knb-lter-arc.10025.3

Selecting the link will bring up the Data Package Browser


Biomass – Data Package views available

• In the data package selected; knb-lter-arc.10025.3, PASTA shows four separate available documents. • One Metadata document• Two Data documents (in this case the

two documents contain the same data, one is in a comma separated format and the other is an Excel file format)• The data package browser also shows

the Quality Report for the package.


Advanced Searches• The advance search functions of PASTA allow for a variety of searches,

including searching by Spatial criteria.

Subject, Creator/Organization, Temporal Criteria, and Taxonomic Criteria can also be used in an Advanced Search


The highlights…



How does the NIS enable Network Synthesis?• Subscriptions are used to automate workflows.• Workflows can be basic - # of updates or• Workflows can be advanced – create derived data products

• Users can subscribe to package updates and to package inserts• Users must be an LTER member and be logged in to subscribe to

events


Subscribe to events1. From the tools page, choose Subscribe/Review/Test/Delete

2. The Event Subscription page contains four sections: Subscribe, Review, Test, and Delete3. The packageId used for this demonstration is knb-lter-lno.4128


Reviewing existing SubscriptionsSo you know you created a subscription but you are not sure what number it is.In the Review box, simply select the review button.


Testing an existing subscription• Want to make sure that subscription you just created works?• Put the Id # (remember in Review we retrieved our list of

subscriptions?) in the SubscriptionId field and select test.


The highlights…



How will the NIS maintain data provenance for derived products?• Ties derived data to original data – provenance chaining• When users create a synthetic or derived data product, they can copy

a portion of the original metadata into the new derived data’s metadata – thereby maintaining the lineage of the new data.• On the tools page, select Provenance Viewer


PASTA Provenance Viewer

• Type your packageId (knb-lter-nin.1.1) into the field on the page and select view


The highlights…



How can I track who is using/viewing my data?• Information viewed/downloaded within the LTER Network Data Portal is

stored in the Audit logs and is searchable.• Select the tools button to go back to the tools page.• Under Review PASTA Audit Reports, select the link Data Package Audit

Reports.

• Let’s look at who has been viewing data package knb-lter-nin.1.1 in PASTA.


Who’s been looking at my data?• On the Data Package Audit Report page, the package ID is a

mandatory field.• Enter knb-lter-nin.1.1 as the Package ID. Leave the remaining fields

empty.


PASTA Audit Report for knb-lter-nin.1.1


Want to know more?

Attend the Working Group Session

A Shareholders Introduction to the LTER Data Co-op

on Thursday, September 13 from 10:00 to 12:00 in Longs Peak – Granite Pass

welcome to the lter data co-op with pasta (provenance aware synthesis tracking architecture) all...

Documents

lter data coop

data provenance

data packages slide

lter data slide

data portal

publication of data

harvesting data packages

harvest data packages