Predictive intelligence in analytics aggregation of partial ordered subsets

Abstract

Nowadays, the increased amount of users' devices produce huge volumes of data that should be efficiently managed by modern applications. Streams are adopted to deliver data that, usually, are stored into a number of partitions. Splitting the data offers a lot of advantages as applications can process them in parallel, thus, they increase the speed of processing. Progressive analytics are also adopted to deliver partial responses, during processing, thus, saving time in the execution of applications. Data exploration and analytics queries are very significant for future applications. Usually, such queries demand for an ordered set of objects as a response and require intelligent predictive schemes to deliver the responses on top of the partial results retrieved by the distributed data partitions. A finite set of query processors are adopted to produce these partial results. Processors are placed in front of each partition and report progressive analytics to a central entity. In this paper, we envision the query controller (QC) as the central entity that collects progressive analytics and return the final response to users/applications. The QC receives partial ordered sets of objects and aggregates them to derive the final outcome. We focus on a QC that applies time-optimized techniques and aggregation operators to deliver every response, i.e., ordered sets, over streams of partial ordered subsets. We perform a comprehensive performance assessment with synthetic data and report on the performance of the QC. Our experimental evaluation reveals the pros and cons of the proposed model and a comparison assessment places this paper in the respective literature. © 2013 IEEE.