NBFTP: A Dedicated Data Transfer System for Remote Astronomical Observation at Dome A

Dome A, Antarctica has been thought to be one of the best astronomical sites on the earth since decades ago. From it was first visited by astronomers in 2008, dozens of facilities for astronomical observation and site testing were deployed. Due to its special geographical location, the data and mess...

Full description

Bibliographic Details
Main Authors: Huang, Siyuan, Yu, Ce, Sun, Chao, Hu, Yi, Shang, Zhaohui, Ma, Bin, Che, Ming, Lu, Xiaoxiao
Format: Article in Journal/Newspaper
Language:unknown
Published: arXiv 2020
Subjects:
Online Access:https://dx.doi.org/10.48550/arxiv.2008.11923
https://arxiv.org/abs/2008.11923
id ftdatacite:10.48550/arxiv.2008.11923
record_format openpolar
spelling ftdatacite:10.48550/arxiv.2008.11923 2023-05-15T13:59:00+02:00 NBFTP: A Dedicated Data Transfer System for Remote Astronomical Observation at Dome A Huang, Siyuan Yu, Ce Sun, Chao Hu, Yi Shang, Zhaohui Ma, Bin Che, Ming Lu, Xiaoxiao 2020 https://dx.doi.org/10.48550/arxiv.2008.11923 https://arxiv.org/abs/2008.11923 unknown arXiv https://dx.doi.org/10.1088/1674-4527/21/3/054 arXiv.org perpetual, non-exclusive license http://arxiv.org/licenses/nonexclusive-distrib/1.0/ Instrumentation and Methods for Astrophysics astro-ph.IM FOS Physical sciences article-journal Article ScholarlyArticle Text 2020 ftdatacite https://doi.org/10.48550/arxiv.2008.11923 https://doi.org/10.1088/1674-4527/21/3/054 2022-03-10T15:48:21Z Dome A, Antarctica has been thought to be one of the best astronomical sites on the earth since decades ago. From it was first visited by astronomers in 2008, dozens of facilities for astronomical observation and site testing were deployed. Due to its special geographical location, the data and message exchange between Dome A and the domestic control center could only depend on Iridium. Because the link bandwidth of Iridium is extremely limited, meanwhile the network traffic cost is quite expensive and the network is rather unstable, the commonly used data transfer tools, such as rsync and scp, are not suitable in this case. In this paper, we design and implement a data transfer tool called NBFTP (narrow bandwidth file transfer protocol) for the astronomical observation of Dome A. NBFTP uses a uniform interface to arrange all types of data and matches specific transmission schemes for different data types according to rules. Break-point resuming and extensibility functions are also implemented. Our experimental results show that NBFTP consumes 60% less network traffic than rsync when detecting the data pending to be transferred. And when transferring small files of 1KB, the network traffic consumption of NBFTP is 40% less than rsync. However, as the file size increases, the network traffic consumption of NBFTP tends to approach rsync, but it is still smaller than rsync. Article in Journal/Newspaper Antarc* Antarctica DataCite Metadata Store (German National Library of Science and Technology)
institution Open Polar
collection DataCite Metadata Store (German National Library of Science and Technology)
op_collection_id ftdatacite
language unknown
topic Instrumentation and Methods for Astrophysics astro-ph.IM
FOS Physical sciences
spellingShingle Instrumentation and Methods for Astrophysics astro-ph.IM
FOS Physical sciences
Huang, Siyuan
Yu, Ce
Sun, Chao
Hu, Yi
Shang, Zhaohui
Ma, Bin
Che, Ming
Lu, Xiaoxiao
NBFTP: A Dedicated Data Transfer System for Remote Astronomical Observation at Dome A
topic_facet Instrumentation and Methods for Astrophysics astro-ph.IM
FOS Physical sciences
description Dome A, Antarctica has been thought to be one of the best astronomical sites on the earth since decades ago. From it was first visited by astronomers in 2008, dozens of facilities for astronomical observation and site testing were deployed. Due to its special geographical location, the data and message exchange between Dome A and the domestic control center could only depend on Iridium. Because the link bandwidth of Iridium is extremely limited, meanwhile the network traffic cost is quite expensive and the network is rather unstable, the commonly used data transfer tools, such as rsync and scp, are not suitable in this case. In this paper, we design and implement a data transfer tool called NBFTP (narrow bandwidth file transfer protocol) for the astronomical observation of Dome A. NBFTP uses a uniform interface to arrange all types of data and matches specific transmission schemes for different data types according to rules. Break-point resuming and extensibility functions are also implemented. Our experimental results show that NBFTP consumes 60% less network traffic than rsync when detecting the data pending to be transferred. And when transferring small files of 1KB, the network traffic consumption of NBFTP is 40% less than rsync. However, as the file size increases, the network traffic consumption of NBFTP tends to approach rsync, but it is still smaller than rsync.
format Article in Journal/Newspaper
author Huang, Siyuan
Yu, Ce
Sun, Chao
Hu, Yi
Shang, Zhaohui
Ma, Bin
Che, Ming
Lu, Xiaoxiao
author_facet Huang, Siyuan
Yu, Ce
Sun, Chao
Hu, Yi
Shang, Zhaohui
Ma, Bin
Che, Ming
Lu, Xiaoxiao
author_sort Huang, Siyuan
title NBFTP: A Dedicated Data Transfer System for Remote Astronomical Observation at Dome A
title_short NBFTP: A Dedicated Data Transfer System for Remote Astronomical Observation at Dome A
title_full NBFTP: A Dedicated Data Transfer System for Remote Astronomical Observation at Dome A
title_fullStr NBFTP: A Dedicated Data Transfer System for Remote Astronomical Observation at Dome A
title_full_unstemmed NBFTP: A Dedicated Data Transfer System for Remote Astronomical Observation at Dome A
title_sort nbftp: a dedicated data transfer system for remote astronomical observation at dome a
publisher arXiv
publishDate 2020
url https://dx.doi.org/10.48550/arxiv.2008.11923
https://arxiv.org/abs/2008.11923
genre Antarc*
Antarctica
genre_facet Antarc*
Antarctica
op_relation https://dx.doi.org/10.1088/1674-4527/21/3/054
op_rights arXiv.org perpetual, non-exclusive license
http://arxiv.org/licenses/nonexclusive-distrib/1.0/
op_doi https://doi.org/10.48550/arxiv.2008.11923
https://doi.org/10.1088/1674-4527/21/3/054
_version_ 1766267368414117888