Traffic Measurement for Big Network Data by Shigang Chen, Min Chen, Qingjun Xiao

By Shigang Chen, Min Chen, Qingjun Xiao

This booklet offers a number of compact and speedy equipment for on-line site visitors dimension of massive community info. It describes demanding situations of on-line site visitors dimension, discusses the kingdom of the sphere, and offers an summary of the aptitude strategies to significant problems.
The authors introduce the matter of per-flow measurement size for giant community info and current a quick and scalable counter structure, referred to as Counter Tree, which leverages a two-dimensional counter sharing scheme to accomplish much better reminiscence potency and considerably expand estimation variety.
Unlike conventional techniques to cardinality estimation difficulties that allocate a separated info constitution (called estimator) for every stream, this publication takes a special layout course via viewing all of the flows jointly as a complete: every one circulation is allotted with a digital estimator, and those digital estimators percentage a standard reminiscence area. A framework of digital estimators is designed to use the assumption of sharing to an array of cardinality estimation suggestions, attaining much better reminiscence potency than the simplest present paintings.
To finish, the authors talk about power unfold estimation in high-speed networks. they give a compact info constitution referred to as multi-virtual bitmap, which may estimate the cardinality of the intersection of an arbitrary variety of units. utilizing multi-virtual bitmaps, an implementation that may carry excessive estimation accuracy lower than a really tight reminiscence house is gifted.
The result of those experiments will shock either pros within the box and advanced-level scholars attracted to the subject. by way of offering either an outline and the result of particular experiments, this booklet comes in handy for these new to on-line site visitors dimension and specialists at the topic.

Show description

Read Online or Download Traffic Measurement for Big Network Data PDF

Best nonfiction_14 books

De Havilland Sea Vixen

This can be the second one sequence of Warpaint. This sequence used to be just like the 1st, yet incorporated color illustrations and lined a much wider variety of airplane kinds. The sequence specializes in army plane from the second one global battle onwards, with an emphasis at the markings carried. each one booklet encompasses a concise written heritage of the topic lined, illustrated with color and b+w pictures - including color profiles and color multi-view drawings.

Image-Based Multilevel Biomechanical Modeling for Fall-Induced Hip Fracture

Fall-induced hip fracture is an outbreak healthiness chance between aged humans. This publication offers an image-based multilevel modeling method of realizing the biomechanics occupied with fall-induced hip fracture. via hierarchically integrating a body-level dynamics version, a femur-level finite point version, and an area bone failure version, the biomechanics strategy is ready to simulate all phases in sideways falls and to include all biomechanical variables affecting hip fracture.

Singularities in Geometry, Topology, Foliations and Dynamics: A Celebration of the 60th Birthday of José Seade, Merida, Mexico, December 2014

This ebook good points cutting-edge examine on singularities in geometry, topology, foliations and dynamics and offers an summary of the present country of singularity idea in those settings. Singularity idea is on the crossroad of assorted branches of arithmetic and technological know-how in most cases. in recent times there were outstanding advancements, either within the conception itself and in its family members with different components.

Advances in Memristors, Memristive Devices and Systems

This e-book studies at the most recent advances in and functions of memristors, memristive units and platforms. It gathers 20 contributed chapters via topic specialists, together with pioneers within the box akin to Leon Chua (UC Berkeley, united states) and R. S. Williams (HP Labs, USA), who're really expert within the quite a few subject matters addressed during this booklet, and covers large components of memristors and memristive units comparable to: memristor emulators, oscillators, chaotic and hyperchaotic memristive structures, keep watch over of memristive structures, memristor-based min-max circuits, canonic memristors, memristive-based neuromorphic purposes, implementation of memristor-based chaotic oscillators, inverse memristors, linear memristor units, not on time memristive structures, flux-controlled memristive emulators, and so on.

Extra info for Traffic Measurement for Big Network Data

Example text

B) 96 bits per flow, 3 registers of 32 bits each. (c) 32 bits per flow, 1 register of 32 bits. 3 LogLog and HyperLogLog LogLog [5] and HyperLogLog [9] were designed to compress the size of each register from 32 bits to 5 bits for the same estimation range of 232 . Their performance is presented in Figs. 4. The estimation accuracy of LogLog and HyperLogLog (HLL) is much improved as compared with PCSA, because smaller registers mean there are more of them under the same memory constraint, which drives the estimation variance down.

For comparison, we conduct the same experiments on E-CTE, and the results are depicted in Fig. 18. Owing to the status bits in E-CTE, the increase of h only slightly degrades the performance of ECT. , h D 6. 2 0 r=50 r=100 r=200 0 1 2 3 s (× 103) Fig. 15 Impact of r on the performance of CTE, where M D 0:5 MB, b D 4, and d D 2. (a) Shows estimation results of CTE when r D 50. (b) Shows estimation results of CTE when r D 100. (c) Shows estimation results of CTE when r D 200. 12, and 295,451 packets, respectively.

6 Counter Tree-Based Maximum Likelihood Estimation In this section, we provide and analyze another estimator for flow sizes called Counter Tree-based Maximum likelihood Estimation (CTM). 11), the probability of Zi D zi is ! n k zi ProbfZi D zi g D . 1 zi m k n / m zi : The value of n is known from the Counter Tree. The values of m and k are determined by prescribed system parameters M, b and d, h. zi /. zi /ProbfYi D xi zg / ! zi / D . s; yi / D ysi . s; 1r /. Hence, the likelihood function for observing X0 D x0 , X1 D x1 , .

Download PDF sample

Rated 4.13 of 5 – based on 15 votes