NBFTP: a dedicated data transfer system for remote astronomical observation at Dome A*
Abstract Dome A, Antarctica, has been thought to be one of the best astronomical sites on the Earth for decades. Since it was first visited by astronomers in 2008, dozens of facilities for astronomical observation and site testing were deployed. Due to its special geographical location, the data and...
Published in: | Research in Astronomy and Astrophysics |
---|---|
Main Authors: | , , , , , , , |
Format: | Article in Journal/Newspaper |
Language: | unknown |
Published: |
IOP Publishing
2021
|
Subjects: | |
Online Access: | http://dx.doi.org/10.1088/1674-4527/21/3/054 https://iopscience.iop.org/article/10.1088/1674-4527/21/3/054 https://iopscience.iop.org/article/10.1088/1674-4527/21/3/054/pdf |
id |
crioppubl:10.1088/1674-4527/21/3/054 |
---|---|
record_format |
openpolar |
spelling |
crioppubl:10.1088/1674-4527/21/3/054 2024-06-02T07:56:31+00:00 NBFTP: a dedicated data transfer system for remote astronomical observation at Dome A* Huang, Si-Yuan Yu, Ce Sun, Chao Hu, Yi Shang, Zhaohui Ma, Bin Che, Ming Lu, Xiao-Xiao 2021 http://dx.doi.org/10.1088/1674-4527/21/3/054 https://iopscience.iop.org/article/10.1088/1674-4527/21/3/054 https://iopscience.iop.org/article/10.1088/1674-4527/21/3/054/pdf unknown IOP Publishing https://iopscience.iop.org/page/copyright https://iopscience.iop.org/info/page/text-and-data-mining Research in Astronomy and Astrophysics volume 21, issue 3, page 054 ISSN 1674-4527 journal-article 2021 crioppubl https://doi.org/10.1088/1674-4527/21/3/054 2024-05-07T14:01:12Z Abstract Dome A, Antarctica, has been thought to be one of the best astronomical sites on the Earth for decades. Since it was first visited by astronomers in 2008, dozens of facilities for astronomical observation and site testing were deployed. Due to its special geographical location, the data and message exchange between Dome A and the domestic control center could only depend on Iridium. Because the link bandwidth of Iridium is extremely limited, the network traffic cost is quite expensive and the network is rather unstable, the commonly used data transfer tools, such as rsync and scp, are not suitable in this case. In this paper, we design and implement a data transfer tool called NBFTP (narrow bandwidth file transfer protocol) for the astronomical observation of Dome A. NBFTP uses a uniform interface to arrange all types of data and matches specific transmission schemes for different data types according to rules. Break-point resuming and extensibility functions are also implemented. Our experimental results show that NBFTP consumes 60% less network traffic than rsync when detecting the data pending to be transferred. When transferring small files of 1KB, the network traffic consumption of NBFTP is 40% less than rsync. However, as the file size increases, the network traffic consumption of NBFTP tends to approach rsync, but it is still smaller than rsync. Article in Journal/Newspaper Antarc* Antarctica IOP Publishing Research in Astronomy and Astrophysics 21 3 054 |
institution |
Open Polar |
collection |
IOP Publishing |
op_collection_id |
crioppubl |
language |
unknown |
description |
Abstract Dome A, Antarctica, has been thought to be one of the best astronomical sites on the Earth for decades. Since it was first visited by astronomers in 2008, dozens of facilities for astronomical observation and site testing were deployed. Due to its special geographical location, the data and message exchange between Dome A and the domestic control center could only depend on Iridium. Because the link bandwidth of Iridium is extremely limited, the network traffic cost is quite expensive and the network is rather unstable, the commonly used data transfer tools, such as rsync and scp, are not suitable in this case. In this paper, we design and implement a data transfer tool called NBFTP (narrow bandwidth file transfer protocol) for the astronomical observation of Dome A. NBFTP uses a uniform interface to arrange all types of data and matches specific transmission schemes for different data types according to rules. Break-point resuming and extensibility functions are also implemented. Our experimental results show that NBFTP consumes 60% less network traffic than rsync when detecting the data pending to be transferred. When transferring small files of 1KB, the network traffic consumption of NBFTP is 40% less than rsync. However, as the file size increases, the network traffic consumption of NBFTP tends to approach rsync, but it is still smaller than rsync. |
format |
Article in Journal/Newspaper |
author |
Huang, Si-Yuan Yu, Ce Sun, Chao Hu, Yi Shang, Zhaohui Ma, Bin Che, Ming Lu, Xiao-Xiao |
spellingShingle |
Huang, Si-Yuan Yu, Ce Sun, Chao Hu, Yi Shang, Zhaohui Ma, Bin Che, Ming Lu, Xiao-Xiao NBFTP: a dedicated data transfer system for remote astronomical observation at Dome A* |
author_facet |
Huang, Si-Yuan Yu, Ce Sun, Chao Hu, Yi Shang, Zhaohui Ma, Bin Che, Ming Lu, Xiao-Xiao |
author_sort |
Huang, Si-Yuan |
title |
NBFTP: a dedicated data transfer system for remote astronomical observation at Dome A* |
title_short |
NBFTP: a dedicated data transfer system for remote astronomical observation at Dome A* |
title_full |
NBFTP: a dedicated data transfer system for remote astronomical observation at Dome A* |
title_fullStr |
NBFTP: a dedicated data transfer system for remote astronomical observation at Dome A* |
title_full_unstemmed |
NBFTP: a dedicated data transfer system for remote astronomical observation at Dome A* |
title_sort |
nbftp: a dedicated data transfer system for remote astronomical observation at dome a* |
publisher |
IOP Publishing |
publishDate |
2021 |
url |
http://dx.doi.org/10.1088/1674-4527/21/3/054 https://iopscience.iop.org/article/10.1088/1674-4527/21/3/054 https://iopscience.iop.org/article/10.1088/1674-4527/21/3/054/pdf |
genre |
Antarc* Antarctica |
genre_facet |
Antarc* Antarctica |
op_source |
Research in Astronomy and Astrophysics volume 21, issue 3, page 054 ISSN 1674-4527 |
op_rights |
https://iopscience.iop.org/page/copyright https://iopscience.iop.org/info/page/text-and-data-mining |
op_doi |
https://doi.org/10.1088/1674-4527/21/3/054 |
container_title |
Research in Astronomy and Astrophysics |
container_volume |
21 |
container_issue |
3 |
container_start_page |
054 |
_version_ |
1800756569609076736 |