DataMover-Lite ...
DataMover-Lite (DML) is a client program whose purpose is to automatically manage multi-file transfers to clients. It expects as its input a transfer-instruction file, and a local target directory where the files will be moved to. The input file contains the Logical File Names (LFNs) and the transfe...
Main Authors: | , , |
---|---|
Format: | Article in Journal/Newspaper |
Language: | English |
Published: |
Lawrence Berkeley National Laboratory (LBNL), Berkeley, CA (United States)
2011
|
Subjects: | |
Online Access: | https://dx.doi.org/10.11578/dc.20210416.53 https://www.osti.gov/doecode/biblio/54833 |
id |
ftdatacite:10.11578/dc.20210416.53 |
---|---|
record_format |
openpolar |
spelling |
ftdatacite:10.11578/dc.20210416.53 2023-08-27T04:09:09+02:00 DataMover-Lite ... Natarajan, Vijaya Sim, Alex Shoshani, Arie 2011 https://dx.doi.org/10.11578/dc.20210416.53 https://www.osti.gov/doecode/biblio/54833 en eng Lawrence Berkeley National Laboratory (LBNL), Berkeley, CA (United States) SoftwareSourceCode article Software DataMover-Lite 2011 ftdatacite https://doi.org/10.11578/dc.20210416.53 2023-08-07T14:24:23Z DataMover-Lite (DML) is a client program whose purpose is to automatically manage multi-file transfers to clients. It expects as its input a transfer-instruction file, and a local target directory where the files will be moved to. The input file contains the Logical File Names (LFNs) and the transfer URLs (TURLs) of files that need to be transferred. The TURLs can have various protocols depending on the server that manages the files, including gridftp, ftp, https, and srm. Given a multi-file request for a large number of files, the DML can issue concurrently a number of transfers in order to get the files. The number of transfers it can issue is set as a parameter and is usually less than 10. For example, if the multi-file is for 100 files, the DML may keep active only 5 transfers at any one time. When any of the 5 transfers completes it will initiate another transfer. It is not necessary for a single request to contain files whose TURLs have same protocol. If the request to the DML contains TURLs with ... Article in Journal/Newspaper DML DataCite Metadata Store (German National Library of Science and Technology) |
institution |
Open Polar |
collection |
DataCite Metadata Store (German National Library of Science and Technology) |
op_collection_id |
ftdatacite |
language |
English |
description |
DataMover-Lite (DML) is a client program whose purpose is to automatically manage multi-file transfers to clients. It expects as its input a transfer-instruction file, and a local target directory where the files will be moved to. The input file contains the Logical File Names (LFNs) and the transfer URLs (TURLs) of files that need to be transferred. The TURLs can have various protocols depending on the server that manages the files, including gridftp, ftp, https, and srm. Given a multi-file request for a large number of files, the DML can issue concurrently a number of transfers in order to get the files. The number of transfers it can issue is set as a parameter and is usually less than 10. For example, if the multi-file is for 100 files, the DML may keep active only 5 transfers at any one time. When any of the 5 transfers completes it will initiate another transfer. It is not necessary for a single request to contain files whose TURLs have same protocol. If the request to the DML contains TURLs with ... |
format |
Article in Journal/Newspaper |
author |
Natarajan, Vijaya Sim, Alex Shoshani, Arie |
spellingShingle |
Natarajan, Vijaya Sim, Alex Shoshani, Arie DataMover-Lite ... |
author_facet |
Natarajan, Vijaya Sim, Alex Shoshani, Arie |
author_sort |
Natarajan, Vijaya |
title |
DataMover-Lite ... |
title_short |
DataMover-Lite ... |
title_full |
DataMover-Lite ... |
title_fullStr |
DataMover-Lite ... |
title_full_unstemmed |
DataMover-Lite ... |
title_sort |
datamover-lite ... |
publisher |
Lawrence Berkeley National Laboratory (LBNL), Berkeley, CA (United States) |
publishDate |
2011 |
url |
https://dx.doi.org/10.11578/dc.20210416.53 https://www.osti.gov/doecode/biblio/54833 |
genre |
DML |
genre_facet |
DML |
op_doi |
https://doi.org/10.11578/dc.20210416.53 |
_version_ |
1775350276378591232 |