- The researcher's guide to the data deluge: querying a scientific database in just a few seconds
- Proceedings of the VLDB Endowment
- Volume | Issue number
- 4 | 12
- Pages (from-to)
- Document type
- Faculty of Science (FNWI)
- Informatics Institute (IVI)
There is a clear need for interactive exploration of extremely large
databases, especially in the area of scientific data management where
ingestion of multiple Terabytes on a daily basis is foreseen. Unfortunately,
current data management technology is not well-suited for
such overwhelming demands.
In light of these challenges, we should rethink some of the strict
requirements database systems adopted in the past. We envision
that next generation database systems should interpret queries by
their intent, rather than as a contract carved in stone for complete
and correct answers. The result set should aid the user in understanding
the database’s content and provide guidance to continue
the data exploration journey. A scientist can stepwise explore
deeper and deeper into the database, and stop when the result content
and quality reaches his satisfaction point. At the same time,
response times should be close to instant such that they allow a
scientist to interact with the system and explore the data in a contextualized way.
Several research directions are carved out to realize this vision.
They range from engineering a novel database kernel where speed
rather than completeness is the first class citizen, up to refusing to
process a costly query in the first place, but providing advice on
how to reformulate it instead, or even providing alternatives the
system believes might be relevant for the exploration patterns observed.
- Proceedings title: Proceedings of the 37th International Conference on Very Large Data Bases, Seattle, WA. - Industrial, Applications
and Experience Track, Demonstrations, Challenges & Visions Track, Tutorials and Panels
Editors: J. Blakely, J.M. Hellerstein, N. Koudas, W. Lehner, S. Sarawagi, U. Röhm
If you believe that digital publication of certain material infringes any of your rights or (privacy) interests, please let the Library know, stating your reasons. In case of a legitimate complaint, the Library will make the material inaccessible and/or remove it from the website. Please Ask the Library, or send a letter to: Library of the University of Amsterdam, Secretariat, Singel 425, 1012 WP Amsterdam, The Netherlands. You will be contacted as soon as possible.