Batched stream processing is a new distributed data processing paradigm that models recurring batch computations on incrementally bulk-appended data streams. The model is inspired by our empirical study on a trace from a large-scale production data-processing cluster; it allows a set of effective query optimizations that are not possible in a traditional batch processing model.We have developed a query processing system called Comet that embraces batched stream processing and integrates with DryadLINQ. We used two complementary methods to evaluate the effectiveness of optimizations that Comet enables. First, a prototype system deployed on a 40-node cluster shows an I/O reduction of over 40% using our benchmark. Second, when applied to a real production trace covering over 19 million machine-hours, our simulator shows an estimated I/O saving of over 50%.
The deformation regional characteristics and fractal characteristics of crack propagation in raw coal and briquette coal under local loading were studied. The results show that the stress-strain curves of the two samples under local loading have typical stage characteristics, the deformation of the raw coal samples in the compaction stage is greater than that of the briquette coal samples, and the peak strength of the two samples increases linearly with the increase of the loading area. With the increase of loading time, the strain of the nonloading zone shows a slow growth stage and a strain stable stage. The farther away from the loading area, the smaller the strain and the strain rate are. Under local loading, the relation of the fractal dimension of the raw coal surface and strain can be described as a cubic function, while the relation can be expressed by a quadratic function for the briquette sample, and the relation of the fractal dimension and loading area of the raw coal and briquette both can be described as a quadratic function. Under uniaxial compression, the briquette coal mainly undergoes tensile failure, and the raw coal mainly undergoes x-type shear failure. Under local loading, the raw coal and briquette coal microcracks started propagation from the easy fracture zone, and the main control crack is located in the interface between the loading zone and the nonloading zone.
In vehicular ad hoc networks, opportunistic routing can effectively improve the reliability and throughput. However, opportunistic routing also has security issues. For example, malicious nodes can easily mix into node candidate sets, which can interfere with network performance. In this paper, a trust model based on node behavior is proposed for solving the problem of malicious nodes in the opportunistic routing and forwarding candidate set. The proposed trust model uses pruning and filtering mechanisms to remove malicious suggestions,and uses dynamic weight calculation methods to combine direct trust and indirect trust when calculating the comprehensive trust value, which can screen and filter low-trust nodes in the network. Then, combining the ETX (Expected Transmission Count) value and the node trust value, an opportunity routing algorithm based on trust model (BTOR) is proposed. Extensive simulation results represent that the algorithm can significantly improve the network performance and reduce the interference of malicious nodes to the network system.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.