Next: User provided reduced data, catalogues and atlases in the ISO Data Archive
Up: Surveys &
Large Scale Data Management
Previous: The LOFAR Global Sky Model: Some Design Challenges
Table of Contents -
Subject Index -
Author Index -
Search -
PS reprint -
PDF reprint
Tamura, T., Baba, H., Matsuzaki, K., Miura, A., Shinohara, I., Nagase, F., Fukushi, M., & Uchida, K. 2003, in ASP Conf. Ser., Vol. 314 Astronomical Data
Analysis Software and Systems XIII, eds. F. Ochsenbein, M. Allen, & D. Egret (San Francisco: ASP), 22
Data Archive and Transfer System (DARTS) of ISAS
Takayuki Tamura, Hajime Baba, Keiichi Matsuzaki,
Akira Miura, Iku Shinohara, and Fumiaki Nagase
PLAIN center, Institute of Space and Astronautical Science (ISAS), Japan Aerospace Exploration Agency (JAXA), Japan
Masahiko Fukushi and Kenji Uchida
Fujitsu Limited, Japan
Abstract:
The Data Archive and Transfer System
(DARTS) is a central database for the scientific data obtained by satellites of the Institute of Space and Astronautical Science (ISAS) in Japan.
We have archived and released the data from several past and current ISAS
missions.
In the near future, the data from Astro-E2 (X-ray astronomy), Astro-F (Infrared astronomy), and Solar-B (solar physics) will be released from DARTS.
These satellites will provide data sets much larger in quantity and quality than previous satellites.
To manage these upcoming data, we are developing a new data management system.
In addition, a new data distribution system on 'Super- SINET', which is an ultrahigh speed network dedicated to academic institutes in Japan, is under construction.
The DARTS project commenced in 1995 and with the public release of data from 1997 is maintained by the PLAIN Center (Center for PLAnning and INformation Systems) at ISAS in cooperation with various ISAS satellite teams.
The objectives of DARTS are
1) to archive and release the ISAS mission data,
2) to provide search engines for the data users,
3) to provide an on-line data analysis system,
4) to provide information and links related to the data,
and
5) to provide mirroring of the US and European mission data to Japanese and other Asian scientists.
The system consists of a file server, www server, proxy server and analysis server along with data storage devices (see Miura et al. 2000 for details). The total data size is several Tera bytes (TB) including the mirrored data.
The main data catalogues are implemented in the Oracle database.
The current DARTS services are summarized in Table 1.
We have also provided mirroring services including
the X-ray astronomical data of Beppo-SAX (SAX SDC, Italy) and ROSAT (MPE, Germany),
solar observation data of TRACE and RHESSI,
and CDAWeb.
These data are mostly mirrored through NASA/GSFC.
Data from the forthcoming missions will be added to the DARTS archive in the near future.
- Astro-E2
- A Japanese-US X-ray astronomical satellite has been constructed and tested for launch in early 2005.
The satellite will provide excellent spectroscopic resolution
together with a very wide energy band, ranging from soft X-rays up to gamma-rays (0.3-600 keV).
The data will be processed at ISAS and NASA/GSFC.
The calibrated data will be distributed from and archived at DARTS (at NASA/HEASARC for US observers).
The amount of telemetry data and science data will be about 1 GB/day and a few TB for the whole mission time.
- Astro-F
- This ambitious infrared mission is scheduled to be launched in late FY 2005.
Astro-F will make an all-sky survey catalogue to much higher sensitivities (50 - 100 times higher at 100
m and more than 1000 times that at mid-infrared wavelengths),
better spatial resolutions and wider wavelength coverage than the Infrared Astronomical Satellite (IRAS).
The data will be processed at ISAS in collaboration with UK and Dutch scientists and delivered via DARTS.
- Solar-B
- A multi-wavelength solar mission planed to be launched in 2006.
The observatory consists of a coordinated set of optical, X-ray and EUV telescopes.
A new archive system, SODA (SOlar Database and Archive) based on Java and XML software, is under development.
This will provide a data analysis platform for multi-wavelength solar observations, a central data base for Japanese observatories, and an effective data mining system.
To cope with future data expansion,
we have been developing a system in ISAS based on the Storage Area Network (SAN) technology.
In this system, all levels of the satellite data ranging from telemetry to public archive data are processed and stored.
The system would provide not only fast access to data, but also cost reduction of the data administration.
Fig.1 shows the system configuration.
The central data storage is a FUJITSU hard disk array (
TB in total, hardware-RAID) along with a Storagetek backup tape library.
File servers are FUJITSU PRIMEPOWER (Solaris) and PRIMERGY (Linux).
The storage, servers, and tape library are connected with each other by the fibre channel (G Bits/s) switches.
Super-SINET is an ultrahigh speed network dedicated to academic institutes in Japan and operated by the National Institute of Informatics.
ISAS and the National Astronomical Observatory (NAO) lead a sub-division of space and astronomical science.
A direct and fast access to DARTS and other data bases at ISAS can be provided to several key institutes in Japan (13 sites are connected so far).
The DARTS and NAO databases are also directly connected, for developing and sharing multi-wavelength astronomical data bases.
Examples of the collaboration are jMAISON
(Java-based Multi-wavelength Astronomical Image Service On line) and SODA (SOlar Database and Archive).
Figure 1:
A new data management system at ISAS, including DARTS.
 |
Acknowledgments
We thank C. Pearson for checking the manuscript.
References
Miura et al. 2000, in ASP Conf. Ser., Vol. 216,
Astronomical Data Analysis Software and Systems
IX, ed. N. Manset,
C. Veillet, & D. Crabtree (San Francisco: ASP), 180
© Copyright 2004 Astronomical Society of the Pacific, 390 Ashton Avenue, San Francisco, California 94112, USA
Next: User provided reduced data, catalogues and atlases in the ISO Data Archive
Up: Surveys &
Large Scale Data Management
Previous: The LOFAR Global Sky Model: Some Design Challenges
Table of Contents -
Subject Index -
Author Index -
Search -
PS reprint -
PDF reprint