Skip to main content
SpringerLink
Log in

RawVis: Visual Exploration over Raw Data

  • Conference paper
  • First Online:
Advances in Databases and Information Systems (ADBIS 2018)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 11019))

Included in the following conference series:

Abstract

Data exploration and visual analytics systems are of great importance in Open Science scenarios, where less tech-savvy researchers wish to access and visually explore big raw data files (e.g., json, csv) generated by scientific experiments using commodity hardware and without being overwhelmed in the tedious processes of data loading, indexing and query optimization. In this work, we present our work for enabling efficient query processing on raw data files for interactive visual exploration scenarios. We introduce a framework, named RawVis, built on top of a lightweight in-memory tile-based index, VALINOR, that is constructed on-the-fly given the first user query over a raw file and adapted based on the user interaction. We evaluate the performance of prototype implementation compared to three other alternatives and show that our method outperforms in terms of response time, disk accesses and memory consumption.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    Available at: https://research.yahoo.com.

  2. 2.

    https://github.com/HBPMedical/PostgresRAW.

  3. 3.

    https://github.com/davidmoten/rtree.

  4. 4.

    The source code is available at https://github.com/Ploigia/RawVis.

References

  1. Alagiannis, I., Borovica, R., Branco, M., Idreos, S., Ailamaki, A.: NoDB: efficient query execution on raw data files. In: SIGMOD (2012)

    Google Scholar 

  2. Battle, L., Chang, R., Stonebraker, M.: Dynamic prefetching of data tiles for interactive visualization. In: SIGMOD 2016 (2016)

    Google Scholar 

  3. Bikakis, N., Liagouris, J., Krommyda, M., Papastefanatos, G., Sellis, T.: GraphVizdb: a scalable platform for interactive large graph visualization. In: ICDE (2016)

    Google Scholar 

  4. Bikakis, N., Papastefanatos, G., Skourla, M., Sellis, T.: A hierarchical aggregation framework for efficient multilevel visual exploration and analysis. Semant. Web J. 8, 139–179 (2017)

    Google Scholar 

  5. Blanas, S., Wu, K., Byna, S., Dong, B., Shoshani, A.: Parallel data analysis directly on scientific file formats. In: SIGMOD (2014)

    Google Scholar 

  6. Cheng, Y., Rusu, F.: SCANRAW: a database meta-operator for parallel in-situ processing and loading. ACM Trans. Database Syst. 40(3), 1–45 (2015)

    Article  MathSciNet  Google Scholar 

  7. Ciaccia, P., Patella, M., Zezula, P.: M-tree: an efficient access method for similarity search in metric spaces. In: VLDB (1997)

    Google Scholar 

  8. de Lara Pahins, C.A., Stephens, S.A., Scheidegger, C., Comba, J.L.D.: Hashedcubes: simple, low memory, real-time visual exploration of big data. TVCG 23(1), 671–680 (2017)

    Google Scholar 

  9. El-Hindi, M., Zhao, Z., Binnig, C., Kraska, T.: VisTrees: fast indexes for interactive data exploration. In: HILDA (2016)

    Google Scholar 

  10. Hwang, S., Kwon, K., Cha, S.K., Lee, B.S.: Performance evaluation of main-memory R-tree variants. In: Hadzilacos, T., Manolopoulos, Y., Roddick, J., Theodoridis, Y. (eds.) SSTD 2003. LNCS, vol. 2750, pp. 10–27. Springer, Heidelberg (2003). https://doi.org/10.1007/978-3-540-45072-6_2

    Chapter  Google Scholar 

  11. Idreos, S., Alagiannis, I., Johnson, R., Ailamaki, A.: Here are my data files. Here are my queries. Where are my results? In: CIDR (2011)

    Google Scholar 

  12. Ivanova, M., Kersten, M.L., Manegold, S., Kargin, Y.: Data vaults database technology for scientific file repositories. Comput. Sci. Eng. 15(3), 32–42 (2013)

    Article  Google Scholar 

  13. Jugel, U., Jerzak, Z., Hackenbroich, G., Markl, V.: VDDA: automatic visualization-driven data aggregation in relational databases. VLDBJ 25, 53–77 (2015)

    Article  Google Scholar 

  14. Kalinin, A., Çetintemel, U., Zdonik, S.B.: Interactive data exploration using semantic windows. In: SIGMOD (2014)

    Google Scholar 

  15. Karpathiotakis, M., Branco, M., Alagiannis, I., Ailamaki, A.: Adaptive query processing on raw data. PVLDB 7(12), 1119–1130 (2014)

    Google Scholar 

  16. Olma, M., Karpathiotakis, M., Alagiannis, I., Athanassoulis, M., Ailamaki, A.: Slalom: coasting through raw data via adaptive partitioning and indexing. PVLDB 10(10), 1106–1117 (2017)

    Google Scholar 

  17. Tian, Y., Alagiannis, I., Liarou, E., Ailamaki, A., Michiardi, P., Vukolic, M.: DiNoDB: an interactive-speed query engine for ad-hoc queries on temporary data. IEEE TBD (2017)

    Google Scholar 

Download references

Acknowledgments

This research is implemented through the Operational Program “Human Resources Development, Education and Lifelong Learning” and is co-financed by the European Union (European Social Fund) and Greek national funds.

Author information

Authors and Affiliations

  1. University of Ioannina, Ioannina, Greece

    Nikos Bikakis, Stavros Maroulis, George Papastefanatos & Panos Vassiliadis

Authors
  1. Nikos Bikakis
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Stavros Maroulis
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. George Papastefanatos
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Panos Vassiliadis
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Nikos Bikakis .

Editor information

Editors and Affiliations

  1. Eötvös Loránd University, Budapest, Hungary

    András Benczúr

  2. Christian-Albrechts-Universität, Kiel, Germany

    Bernhard Thalheim

  3. Eötvös Loránd University, Budapest, Hungary

    Tomáš Horváth

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Bikakis, N., Maroulis, S., Papastefanatos, G., Vassiliadis, P. (2018). RawVis: Visual Exploration over Raw Data. In: Benczúr, A., Thalheim, B., Horváth, T. (eds) Advances in Databases and Information Systems. ADBIS 2018. Lecture Notes in Computer Science(), vol 11019. Springer, Cham. https://doi.org/10.1007/978-3-319-98398-1_4

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-98398-1_4

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-98397-4

  • Online ISBN: 978-3-319-98398-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation