An efficient framework for parallel and continuous frequent item monitoring

文献类型： 外文期刊

第一作者： Zhang, Yu

作者： Zhang, Yu;Zhang, Jianzhong;Xu, Jingdong;Wu, Ying;Sun, Yue

作者机构：

关键词： frequent items;parallel algorithms;weighted data streams;multi-core processors

期刊名称：CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE （ 影响因子：1.536； 五年影响因子：1.471 ）

ISSN： 1532-0626

年卷期： 2014 年 26 卷 18 期

页码：

收录情况： SCI

摘要： In high-speed network monitoring, the ever-growing traffic calls for a high-performance solution for the computation of frequent items. The increasing number of cores in the current commodity multi-core processors opens up new opportunities in parallelization. In this paper, we present a novel precision integrated framework (PRIF) that exploits the great parallel capability of multi-cores to speed up the famous frequent algorithm. PRIF equally distributes the input data stream into sub-threads that use the optimized weighted frequent algorithm to track local frequent items. The items with frequency increments exceeding a pre-defined threshold are sent to a merging thread which is able to return the global continuous epsilon-deficient frequent items. The theoretical correctness and complexity analyses are presented. Experiments with real and synthetic traces confirm the theoretical analyses and demonstrate the excellent performance as well as the effects of parameters and data skewness. The results show that PRIF is able to provide continuous frequent items and near-linear speedup at the cost of greater memory use. Copyright (c) 2013 John Wiley & Sons, Ltd.

分类号：

  • 相关文献
作者其他论文 更多>>

微信小程序