NBFTP: A Dedicated Data Transfer System for Remote Astronomical Observation at Dome A
Dome A, Antarctica has been thought to be one of the best astronomical sites on the earth since decades ago. From it was first visited by astronomers in 2008, dozens of facilities for astronomical observation and site testing were deployed. Due to its special geographical location, the data and mess...
Main Authors: | , , , , , , , |
---|---|
Format: | Article in Journal/Newspaper |
Language: | unknown |
Published: |
arXiv
2020
|
Subjects: | |
Online Access: | https://dx.doi.org/10.48550/arxiv.2008.11923 https://arxiv.org/abs/2008.11923 |
id |
ftdatacite:10.48550/arxiv.2008.11923 |
---|---|
record_format |
openpolar |
spelling |
ftdatacite:10.48550/arxiv.2008.11923 2023-05-15T13:59:00+02:00 NBFTP: A Dedicated Data Transfer System for Remote Astronomical Observation at Dome A Huang, Siyuan Yu, Ce Sun, Chao Hu, Yi Shang, Zhaohui Ma, Bin Che, Ming Lu, Xiaoxiao 2020 https://dx.doi.org/10.48550/arxiv.2008.11923 https://arxiv.org/abs/2008.11923 unknown arXiv https://dx.doi.org/10.1088/1674-4527/21/3/054 arXiv.org perpetual, non-exclusive license http://arxiv.org/licenses/nonexclusive-distrib/1.0/ Instrumentation and Methods for Astrophysics astro-ph.IM FOS Physical sciences article-journal Article ScholarlyArticle Text 2020 ftdatacite https://doi.org/10.48550/arxiv.2008.11923 https://doi.org/10.1088/1674-4527/21/3/054 2022-03-10T15:48:21Z Dome A, Antarctica has been thought to be one of the best astronomical sites on the earth since decades ago. From it was first visited by astronomers in 2008, dozens of facilities for astronomical observation and site testing were deployed. Due to its special geographical location, the data and message exchange between Dome A and the domestic control center could only depend on Iridium. Because the link bandwidth of Iridium is extremely limited, meanwhile the network traffic cost is quite expensive and the network is rather unstable, the commonly used data transfer tools, such as rsync and scp, are not suitable in this case. In this paper, we design and implement a data transfer tool called NBFTP (narrow bandwidth file transfer protocol) for the astronomical observation of Dome A. NBFTP uses a uniform interface to arrange all types of data and matches specific transmission schemes for different data types according to rules. Break-point resuming and extensibility functions are also implemented. Our experimental results show that NBFTP consumes 60% less network traffic than rsync when detecting the data pending to be transferred. And when transferring small files of 1KB, the network traffic consumption of NBFTP is 40% less than rsync. However, as the file size increases, the network traffic consumption of NBFTP tends to approach rsync, but it is still smaller than rsync. Article in Journal/Newspaper Antarc* Antarctica DataCite Metadata Store (German National Library of Science and Technology) |
institution |
Open Polar |
collection |
DataCite Metadata Store (German National Library of Science and Technology) |
op_collection_id |
ftdatacite |
language |
unknown |
topic |
Instrumentation and Methods for Astrophysics astro-ph.IM FOS Physical sciences |
spellingShingle |
Instrumentation and Methods for Astrophysics astro-ph.IM FOS Physical sciences Huang, Siyuan Yu, Ce Sun, Chao Hu, Yi Shang, Zhaohui Ma, Bin Che, Ming Lu, Xiaoxiao NBFTP: A Dedicated Data Transfer System for Remote Astronomical Observation at Dome A |
topic_facet |
Instrumentation and Methods for Astrophysics astro-ph.IM FOS Physical sciences |
description |
Dome A, Antarctica has been thought to be one of the best astronomical sites on the earth since decades ago. From it was first visited by astronomers in 2008, dozens of facilities for astronomical observation and site testing were deployed. Due to its special geographical location, the data and message exchange between Dome A and the domestic control center could only depend on Iridium. Because the link bandwidth of Iridium is extremely limited, meanwhile the network traffic cost is quite expensive and the network is rather unstable, the commonly used data transfer tools, such as rsync and scp, are not suitable in this case. In this paper, we design and implement a data transfer tool called NBFTP (narrow bandwidth file transfer protocol) for the astronomical observation of Dome A. NBFTP uses a uniform interface to arrange all types of data and matches specific transmission schemes for different data types according to rules. Break-point resuming and extensibility functions are also implemented. Our experimental results show that NBFTP consumes 60% less network traffic than rsync when detecting the data pending to be transferred. And when transferring small files of 1KB, the network traffic consumption of NBFTP is 40% less than rsync. However, as the file size increases, the network traffic consumption of NBFTP tends to approach rsync, but it is still smaller than rsync. |
format |
Article in Journal/Newspaper |
author |
Huang, Siyuan Yu, Ce Sun, Chao Hu, Yi Shang, Zhaohui Ma, Bin Che, Ming Lu, Xiaoxiao |
author_facet |
Huang, Siyuan Yu, Ce Sun, Chao Hu, Yi Shang, Zhaohui Ma, Bin Che, Ming Lu, Xiaoxiao |
author_sort |
Huang, Siyuan |
title |
NBFTP: A Dedicated Data Transfer System for Remote Astronomical Observation at Dome A |
title_short |
NBFTP: A Dedicated Data Transfer System for Remote Astronomical Observation at Dome A |
title_full |
NBFTP: A Dedicated Data Transfer System for Remote Astronomical Observation at Dome A |
title_fullStr |
NBFTP: A Dedicated Data Transfer System for Remote Astronomical Observation at Dome A |
title_full_unstemmed |
NBFTP: A Dedicated Data Transfer System for Remote Astronomical Observation at Dome A |
title_sort |
nbftp: a dedicated data transfer system for remote astronomical observation at dome a |
publisher |
arXiv |
publishDate |
2020 |
url |
https://dx.doi.org/10.48550/arxiv.2008.11923 https://arxiv.org/abs/2008.11923 |
genre |
Antarc* Antarctica |
genre_facet |
Antarc* Antarctica |
op_relation |
https://dx.doi.org/10.1088/1674-4527/21/3/054 |
op_rights |
arXiv.org perpetual, non-exclusive license http://arxiv.org/licenses/nonexclusive-distrib/1.0/ |
op_doi |
https://doi.org/10.48550/arxiv.2008.11923 https://doi.org/10.1088/1674-4527/21/3/054 |
_version_ |
1766267368414117888 |