NBFTP: A Dedicated Data Transfer System for Remote Astronomical Observation at Dome A

Dome A, Antarctica has been thought to be one of the best astronomical sites on the earth since decades ago. From it was first visited by astronomers in 2008, dozens of facilities for astronomical observation and site testing were deployed. Due to its special geographical location, the data and mess...

Full description

Bibliographic Details
Published in:Research in Astronomy and Astrophysics
Main Authors: Huang, Siyuan, Yu, Ce, Sun, Chao, Hu, Yi, Shang, Zhaohui, Ma, Bin, Che, Ming, Lu, Xiaoxiao
Format: Text
Language:unknown
Published: 2020
Subjects:
Online Access:http://arxiv.org/abs/2008.11923
https://doi.org/10.1088/1674-4527/21/3/054
id ftarxivpreprints:oai:arXiv.org:2008.11923
record_format openpolar
spelling ftarxivpreprints:oai:arXiv.org:2008.11923 2023-09-05T13:13:41+02:00 NBFTP: A Dedicated Data Transfer System for Remote Astronomical Observation at Dome A Huang, Siyuan Yu, Ce Sun, Chao Hu, Yi Shang, Zhaohui Ma, Bin Che, Ming Lu, Xiaoxiao 2020-08-27 http://arxiv.org/abs/2008.11923 https://doi.org/10.1088/1674-4527/21/3/054 unknown http://arxiv.org/abs/2008.11923 doi:10.1088/1674-4527/21/3/054 Astrophysics - Instrumentation and Methods for Astrophysics text 2020 ftarxivpreprints https://doi.org/10.1088/1674-4527/21/3/054 2023-08-16T16:03:36Z Dome A, Antarctica has been thought to be one of the best astronomical sites on the earth since decades ago. From it was first visited by astronomers in 2008, dozens of facilities for astronomical observation and site testing were deployed. Due to its special geographical location, the data and message exchange between Dome A and the domestic control center could only depend on Iridium. Because the link bandwidth of Iridium is extremely limited, meanwhile the network traffic cost is quite expensive and the network is rather unstable, the commonly used data transfer tools, such as rsync and scp, are not suitable in this case. In this paper, we design and implement a data transfer tool called NBFTP (narrow bandwidth file transfer protocol) for the astronomical observation of Dome A. NBFTP uses a uniform interface to arrange all types of data and matches specific transmission schemes for different data types according to rules. Break-point resuming and extensibility functions are also implemented. Our experimental results show that NBFTP consumes 60% less network traffic than rsync when detecting the data pending to be transferred. And when transferring small files of 1KB, the network traffic consumption of NBFTP is 40% less than rsync. However, as the file size increases, the network traffic consumption of NBFTP tends to approach rsync, but it is still smaller than rsync. Text Antarc* Antarctica ArXiv.org (Cornell University Library) Research in Astronomy and Astrophysics 21 3 054
institution Open Polar
collection ArXiv.org (Cornell University Library)
op_collection_id ftarxivpreprints
language unknown
topic Astrophysics - Instrumentation and Methods for Astrophysics
spellingShingle Astrophysics - Instrumentation and Methods for Astrophysics
Huang, Siyuan
Yu, Ce
Sun, Chao
Hu, Yi
Shang, Zhaohui
Ma, Bin
Che, Ming
Lu, Xiaoxiao
NBFTP: A Dedicated Data Transfer System for Remote Astronomical Observation at Dome A
topic_facet Astrophysics - Instrumentation and Methods for Astrophysics
description Dome A, Antarctica has been thought to be one of the best astronomical sites on the earth since decades ago. From it was first visited by astronomers in 2008, dozens of facilities for astronomical observation and site testing were deployed. Due to its special geographical location, the data and message exchange between Dome A and the domestic control center could only depend on Iridium. Because the link bandwidth of Iridium is extremely limited, meanwhile the network traffic cost is quite expensive and the network is rather unstable, the commonly used data transfer tools, such as rsync and scp, are not suitable in this case. In this paper, we design and implement a data transfer tool called NBFTP (narrow bandwidth file transfer protocol) for the astronomical observation of Dome A. NBFTP uses a uniform interface to arrange all types of data and matches specific transmission schemes for different data types according to rules. Break-point resuming and extensibility functions are also implemented. Our experimental results show that NBFTP consumes 60% less network traffic than rsync when detecting the data pending to be transferred. And when transferring small files of 1KB, the network traffic consumption of NBFTP is 40% less than rsync. However, as the file size increases, the network traffic consumption of NBFTP tends to approach rsync, but it is still smaller than rsync.
format Text
author Huang, Siyuan
Yu, Ce
Sun, Chao
Hu, Yi
Shang, Zhaohui
Ma, Bin
Che, Ming
Lu, Xiaoxiao
author_facet Huang, Siyuan
Yu, Ce
Sun, Chao
Hu, Yi
Shang, Zhaohui
Ma, Bin
Che, Ming
Lu, Xiaoxiao
author_sort Huang, Siyuan
title NBFTP: A Dedicated Data Transfer System for Remote Astronomical Observation at Dome A
title_short NBFTP: A Dedicated Data Transfer System for Remote Astronomical Observation at Dome A
title_full NBFTP: A Dedicated Data Transfer System for Remote Astronomical Observation at Dome A
title_fullStr NBFTP: A Dedicated Data Transfer System for Remote Astronomical Observation at Dome A
title_full_unstemmed NBFTP: A Dedicated Data Transfer System for Remote Astronomical Observation at Dome A
title_sort nbftp: a dedicated data transfer system for remote astronomical observation at dome a
publishDate 2020
url http://arxiv.org/abs/2008.11923
https://doi.org/10.1088/1674-4527/21/3/054
genre Antarc*
Antarctica
genre_facet Antarc*
Antarctica
op_relation http://arxiv.org/abs/2008.11923
doi:10.1088/1674-4527/21/3/054
op_doi https://doi.org/10.1088/1674-4527/21/3/054
container_title Research in Astronomy and Astrophysics
container_volume 21
container_issue 3
container_start_page 054
_version_ 1776204871089782784