Query-Driven Data Profiling with OCEANProfile

Conference contribution
(Original article)


Publication Details

Author(s): Wahl AM, Sauerhammer C, Schwab P, Herbst S, Lenz R
Editor(s): ACM
Publisher: ACM
Publication year: 2018
Conference Proceedings Title: Proceedings of the International Workshop on Real-Time Business Intelligence and Analytics
ISBN: 978-1-4503-6607-6
Language: English


Abstract



Complex data analysis scenarios often
require discovering and combining multiple data sources. Data scientists
usually formulate a series of SQL queries building on each other, also
called a session, to iteratively derive results. However, due to a lack
of familiarity with data sources or the complexity of query results, it
can be a hard task to decide on the next query iteration solely based on
the results of the last one.

While existing approaches provide
mechanisms to assess the results of a specific query, support for
analyzing results in the context of the respective session remains
mostly absent. Such approaches do also not seamlessly integrate with
established tools and workflows.

To overcome these problems, we
introduce OCEANProfile, a framework for session-based profiling of query
results. Query results are intercepted at driver level and streamed
into our framework for automated data profiling. Result profiles can be
compared with those of previous queries and visualized in a companion
app compatible with existing analysis tools. Visualizations are
automatically ranked according to their usefulness in the context of the
respective session.




FAU Authors / FAU Editors

Herbst, Sebastian
Chair for Computer Science 6 (Data Management)
Lenz, Richard Prof. Dr.-Ing.
Professur für Informatik (Datenbanksysteme)
Schwab, Peter
Chair for Computer Science 6 (Data Management)
Wahl, Andreas Maximilian
Professur für Informatik (Datenbanksysteme)


Research Fields

Evolutionary Information Systems
Chair for Computer Science 6 (Data Management)
Data Integration
Chair for Computer Science 6 (Data Management)


How to cite

APA:
Wahl, A.M., Sauerhammer, C., Schwab, P., Herbst, S., & Lenz, R. (2018). Query-Driven Data Profiling with OCEANProfile. In ACM (Eds.), Proceedings of the International Workshop on Real-Time Business Intelligence and Analytics. Rio de Janeiro, BR: ACM.

MLA:
Wahl, Andreas Maximilian, et al. "Query-Driven Data Profiling with OCEANProfile." Proceedings of the International Workshop on Real-Time Business Intelligence and Analytics, Rio de Janeiro Ed. ACM, ACM, 2018.

BibTeX: 

Last updated on 2019-28-02 at 11:30