S. ter Veen
M. van den Akker
- Status of LOFAR Data in HDF5 Format
- Astronomical Society of the Pacific conference series
- Pages (from-to)
- Document type
- Faculty of Science (FNWI)
- Anton Pannekoek Institute for Astronomy (API)
The Hierarchical Data Format, version 5 (HDF5) is a data model, library, and file format for storing and managing data. It is designed for flexible and efficient I/O and for high volume, complex data. The Low Frequency Array (LOFAR) project is solving the challenge of data size and complexity using HDF5. Most of LOFAR's standard data products will be stored using HDF5; the beam-formed time-series data and transient buffer board data have already transitioned from project-specific binary format to HDF5. We report on our effort to pave the way towards new astronomical data encapsulation using HDF5, which can be used by future ground and space projects. The LOFAR project has formed a collaboration with NRAO, the Virtual Astronomical Observatory (VAO) and the HDF Group to obtain funding for a full-time staff member to work on documenting and developing standards for astronomical data written in HDF5. We hope our effort will enhance HDF5 visibility and usage within the community, specifically for LSST, the SKA pathfinders (ASKAP, MeerKAT, MWA, LWA), and other major new radio telescopes such as EVLA, ALMA, and eMERLIN.
Proceedings title: Astronomical data analysis software and systems XXI: proceedings of a conference held at Marriott Rive Gauche Conference Center, Paris, France, 6-10 November 2011
Publisher: Astronomical Society of the Pacific
Place of publication: San Francisco
Editors: P. Ballester, D. Egret, N.P.F. Lorente
If you believe that digital publication of certain material infringes any of your rights or (privacy) interests, please let the Library know, stating your reasons. In case of a legitimate complaint, the Library will make the material inaccessible and/or remove it from the website. Please Ask the Library, or send a letter to: Library of the University of Amsterdam, Secretariat, Singel 425, 1012 WP Amsterdam, The Netherlands. You will be contacted as soon as possible.