datamover lite instructions - twiki · pdf filedatamover lite this version of data mover lite...
TRANSCRIPT
DataMover Lite
This version of Data Mover Lite (DML) supports file transfers based on protocols: gsiftp, http and https.
The Webstart enabled DML can be downloaded from the location:
http://datagrid.lbl.gov/dml4/jnlp/dml.jnlp
Instructions:
Step 1
o Open the link http://datagrid.lbl.gov/dml4/jnlp/dml.jnlp. It downloads webstart version of
DML to the target machine.
o Click on the “Get Credential” button on the DML main window.
o User may login in one of the two possible ways.
User can choose a Gateway from the drop down menu and just login with their
username and password.
User can choose to login with their OpenId.
o Select a gateway endpoint from the drop down menu. Default lifetime is 72 hours, user can
also request a specific credential lifetime . The lifetime granted depends on the configuration
of the gateway. NOTE: Some gateways don’t grant more than 12 hours.
o Credential is stored at user’s local disk and will be reused later for another transfers until its
valid lifetime time.
Figure 1: A sample screen shot for obtaining ESGF credentials with user login and password.
Figure 2: A sample screen shot for obtaining ESGF credentials with OpenId.
Step 2
o User downloads the wget-download.sh file from the gateway.
Figure 3: A sample screen shot for wget script download.
Step 3
o User opens the downloaded wget-download.sh file by clicking on the “Open” button from the main
DML window. DML parses the file and creates a transfer window.
Figure 4: A sample screen shot for wget script download.
o User clicks on the “Transfer” button on the DML main window. The file is transferred using
the credential retrieved previously by the user.
Step 4
o User can either select to download all the files (default behavior) or just a subset of files from
the wget-download.sh by marking the checkbox for the file.
o The selected files will be downloaded, and the remaining files are marked as skipped. More
files can be added or skipped to the subset during the file transfer. Once the current transfer
is done user can transfer more subset(s) of files from the same wget-download.sh.
o Files can be selected either by selecting them individually or contiguous block of files can be
selected by Shift+Click.
Figure 5: A sample screen shot for downloading first subset of files.
Figure 6: A sample screen shot for downloading second subset of files.
o DML can handle only one request at a time. When the transfer is done, user can open up another
wget-request.sh or an inputfile.
o If user wants to cancel the request, they can click on the “Cancel” button, DML cancels the request
after the current “active” file transfer is done.
NCAR gsridftp transfers:
User opens up the DML input file downloaded from the portal. The input file also contains the
gateway login endpoint.
During the transfer DML opens up a dialog box with username/password and retrieves the credential
and continues the transfers.
Figure 7: A sample screen shot for downloading NCAR gsiftp files.
Catalog Browsing Prototype Catalog browsing feature is included in this version of DML. Currently, Browsing feature is enabled
only for NASA-JPL gateway. Soon we will include browsing capability for other gateways. Click on CatalogMenu->BrowseCatalog to bring the catalog browsing window. Click on the desired tree node and filter the search. The selected files come on the right side panel.
Search results are grouped by “20”. ”Transfer All” button will move all the files on the right side panel to the transfer window. “Transfer Selected” button will move the selected files from the right side panel to the transfer window. Transfer window will show the source, target, and file size for each files. User can choose again which files they want to transfer among the list, and click “Transfer”.
Figure 8: A sample screen shot for catalog browsing
New Features Added in DML-4
o Target Files are downloaded in Hierarchy by default. Please unclick this checkbox if you
want to download the files in flat-fashion.
o By default files are downloaded with plain single connection. To increase download speed
please click on SplitTransfer. This will open up “5” connections and downloads the files in
to pieces. After the transfer is done, downloaded pieces are merged to form a single file.
o Concurrency can also be choosen alongwith SplitTransfer. Files are downloaded in
concurrency alongwith SplitTransfer.
Figure 9: Target files are downloaded in Hierarchy
Table of Messages:
This table shows Error Messages or Warning Messages that can happen during “GetCredential”
process.
ErrorMessages/WarningMessages Explanations
Please check your login username for the
selected Gateway host.
Please check your password for the selected
Gateway host.
User clicked on “GetCredential” button without
selecting a Gateway host. Please select a
Gateway Host from the pulldown menu.
User clicked on “GetCredential” button without
provided username and password.Please
provide username and password.
Passphrase is not provided to initiate
userproxy credential. Please provide the
passphrase.
Login to Gateway host failed for 3 times. Please
clear the panel, reopen the ncar input file and
click Transfer again to login again.
User has tried to transfer the files, without
getting the credentials first. Please click on the
GetCredential button and retrieve credentials.
User clicked on CredentialInfo or
DeleteCredential without obtained credential
first. Please get credential first.
User proxy has only few seconds left, may not
be enough for the transfer. Please get your
credentials again or renew your userproxy.
User selected “userproxy” credential” and
clicked on “GetCredential” without providing
values for UserCert/UserKey. Please provide
values for UserCert and UserKey.
User decided to cancel to login to the Gateway
host Authorization service.
This table shows Warning Messages or Error Messages that can happen during file transfers.
ErrorMessages/WarningMessages Explanations
This current request was already cancelled
by the user. If you want to resume please
click on the “Clear” button on the top and
reopen the wget-download.sh input file and
click “Transfer”
Target Dir is not selected to download files.
Please click on the “choose Target Dir”
button to choose a target directory on the
local machine for downloading files.
Please wait until the all the files in the
request is transferred fully.
The target dir selected to download files
does not exist on the local computer.
Choose a different existing target dir.
All files in this request already exists in the
local disk, please use use DML-
>Preferences->Config and choose overwrite
option.
User used a non wget-download.sh file as
an input file or incorrect input file. Please
check your input file.
This table shows other informational messages in DML.
Information Message Explanations
Showing users current credential
information. This information
message is shown after user “clicked”
on “CredentialInfo” button.
User clicked on “Delete Credential”
button, message is showing that
credential is deleted successfully.
After a credential is received from the
Gateway Host, information about the
credential is shown to the user.