Propagation of Densities of Streaming Data within Query Graphs

Daum M, Lauterwald F, Baumgärtel P, Meyer-Wegener K (2010)

Publication Language: English

Publication Type: Conference contribution, Original article

Publication year: 2010

Journal

Lecture Notes in Computer Science Springer Verlag

Publisher: Springer-verlag

Edited Volumes: Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

City/Town: Heidelberg

Pages Range: 584-601

Edition: 1st

Conference Proceedings Title: Scientific and Statistical Database Management: 22nd International Conference

Event location: Heidelberg DE

ISBN: 978-3-642-13817-1

URI: http://www6.informatik.uni-erlangen.de/publications/public/2010/ssdbm2010_daum.pdf

DOI: 10.1007/978-3-642-13818-8_40

Abstract

Data Stream SystemsDSS use cost models to determine if a DSS can cope with a given workload and to optimize query graphs. However, certain relevant input parameters of these models are often unknown or highly imprecise. Especially selectivities are stream-dependent and application-specific parameters. In this paper, we describe a method that supports selectivity estimation considering input streams' attribute value distribution. The novelty of our approach is the propagation of the probability distributions through the query graph in order to give estimates for the inner nodes of the graph. For most common stream operators, we establish formulas that describe their output distribution as a function of their input distributions. For unknown operators like User-Defined OperatorsUDO, we introduce a method to measure the influence of these operators on arbitrary probability distributions. This method is able to do most of the computational work before the query is deployed and introduces minimal overhead at runtime. Our evaluation framework facilitates the appropriate combination of both methods and allows to model almost arbitrary query graphs. © 2010 Springer-Verlag Berlin Heidelberg.

Authors with CRIS profile

Michael Daum Chair for Computer Science 6 (Data Management) Frank Lauterwald Chair for Computer Science 6 (Data Management) Philipp Baumgärtel Chair for Computer Science 6 (Data Management) Klaus Meyer-Wegener Chair for Computer Science 6 (Data Management)

Related research project(s)

Data Stream Application Manager (DSAM) Oct. 1, 2008 - Sept. 30, 2017

How to cite

APA:

Daum, M., Lauterwald, F., Baumgärtel, P., & Meyer-Wegener, K. (2010). Propagation of Densities of Streaming Data within Query Graphs. In Scientific and Statistical Database Management: 22nd International Conference (pp. 584-601). Heidelberg, DE: Heidelberg: Springer-verlag.

MLA:

Daum, Michael, et al. "Propagation of Densities of Streaming Data within Query Graphs." Proceedings of the SSDBM, Heidelberg Heidelberg: Springer-verlag, 2010. 584-601.

BibTeX: Download