Cluster-based distributed dynamic cuckoo filter system for Redis

Luo, Baozhou; Zhu, Wenjun; Xu, He

doi:10.1080/17445760.2019.1599889

Cited by 7 publications

(3 citation statements)

References 7 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Based on the stated requirements, a technical implementation of the method was proposed in the form of an IT infrastructure automation system. It is worth noting that a clustered approach was chosen as a data storage solution to meet the specified non-functional requirements, as Redis Cluster provides high fault tolerance due to data replication and automatic role transfer 14 . To ensure the processing of around 50 TPS and an SLA of approximately 3 seconds, a microservices horizontal scaling 15 approach was selected, and for message transmission between them, AVRO Schema 16 and Kafka Cluster were chosen, which also guarantee fault tolerance 17 .…”

Section: Implementation Of the Methods As A Systemmentioning

confidence: 99%

Automation method for configuring IT infrastructure for IT projects

Ivlev

Yusupova

2023

International Conference on Digital Transformation: Informatics, Economics, and Education (DTIEE2023)

View full text Add to dashboard Cite

This article discusses an automation method for configuring IT infrastructure for IT projects based on the use of natural language processing (NLP) algorithms. The paper begins by discussing the relevance of the topic, reviewing existing solutions and third-party research in the field. Next, a mathematical model for implementing the method is proposed, and the architecture and technical implementation of the system are described. The results of the work include an approach for assessing the effectiveness of the system, both with and without automation, and a description of the expected results. In conclusion, the authors summarize their work and offer directions for further development of the proposed method and system. This article is a significant contribution to the field of IT infrastructure setup automation, providing a fast and efficient setup process for projects of varying complexity. It can be useful for developers, engineers, and project managers who want to optimize the process of setting up IT infrastructure and improve the quality of their projects.

show abstract

Section: Implementation Of the Methods As A Systemmentioning

confidence: 99%

Automation method for configuring IT infrastructure for IT projects

Ivlev

Yusupova

2023

International Conference on Digital Transformation: Informatics, Economics, and Education (DTIEE2023)

View full text Add to dashboard Cite

show abstract

“…Determining whether a particular element belongs to a given set is a common problem in computer science, with widespread applications in bioinformatics, machine learning, computer networks, the Internet of Things, and database systems [39]. Filter data structures such as Bloom filters and Cuckoo filters can approximately determine if an element is part of a specified set and have been extensively applied in network routing [40], information retrieval, file merging [41], spam detection [42], and distributed systems [43].…”

Section: Cuckoo Filtermentioning

confidence: 99%

Enhancing Efficiency and Security in Unbalanced PSI-CA Protocols through Cloud Computing and Homomorphic Encryption in Mobile Networks

Tan,

Du,

Weng

2024

Future Internet

View full text Add to dashboard Cite

Private Set Intersection Cardinality (PSI-CA) is a cryptographic method in secure multi-party computation that allows entities to identify the cardinality of the intersection without revealing their private data.Traditional approaches assume similar-sized datasets and equal computational power, overlooking practical imbalances. In real-world applications, dataset sizes and computational capacities often vary, particularly in Internet of Things and mobile scenarios where device limitations restrict computational types. Traditional PSI-CA protocols are inefficient here, as computational and communication complexities correlate with the size of larger datasets. Thus, adapting PSI-CA protocols to these imbalances is crucial. This paper explores unbalanced scenarios where one party (the receiver) has a relatively small dataset and limited computational power, while the other party (the sender) has a large amount of data and strong computational capabilities.This paper, based on the concept of commutative encryption, introduces Cuckoo filter, cloud computing technology, and homomorphic encryption, among other technologies, to construct three novel solutions for unbalanced Private Set Intersection Cardinality (PSI-CA): an unbalanced PSI-CA protocol based on Cuckoo filter, an unbalanced PSI-CA protocol based on single-cloud assistance, and an unbalanced PSI-CA protocol based on dual-cloud assistance. Depending on performance and security requirements, different protocols can be employed for various applications.

show abstract

“…However, RabbitMQ has distributed consistency issues. Redis (Remote Dictionary Service) [42] is an open source memory-based storage middleware, which is very suitable for frequent search scenarios and often adopted as message broker, database and cache. It can be used to build middleware cluster to improve the scalability of IoT middleware [43].…”

Section: Related Workmentioning

confidence: 99%

Topic-Oriented Bucket-Based Fast Multicast Routing in SDN-Like Publish/Subscribe Middleware

et al. 2020

View full text Add to dashboard Cite

In traditional IP-based publish/subscribe middlewares, a detour to overlay network is demanded to match events with defined filters, which introduces more latency overhead for delivering events from publishers to subscribers. The emerging Software Defined Networking (SDN) creates boundless possibilities to improve the efficiency of event delivery because of its centralized control and customized programmability. In this paper, we propose a topic-oriented bucket-based fast multicast routing to improve the efficiency of delivering events in SDN-like publish/subscribe middlewares. First, we design an SDN-like publish/subscribe middleware hierarchical architecture with an implementation framework in SDN controller to deliver events. Topic encoding, topic prefix matching, and the subscription coverage relationships between topics are considered to reduce the number of flow entries and improve the matching abilities of SDN switches. Then, a topic-oriented multicast tree construction algorithm is proposed to build publish/subscribe overlay networks with the minimal total link delay of event transmission and minimal switches in SDN controllers to deliver events fast. A topic-oriented bucket-based multicast forwarding algorithm is designed to achieve efficient multicast forwarding in SDN switches. Finally, experiments are conducted to verify that our construction algorithm has the minimal total delay of event transmission and our bucket-based multicast forwarding algorithm is effective.

show abstract

Cluster-based distributed dynamic cuckoo filter system for Redis

Cited by 7 publications

References 7 publications

Automation method for configuring IT infrastructure for IT projects

Automation method for configuring IT infrastructure for IT projects

Enhancing Efficiency and Security in Unbalanced PSI-CA Protocols through Cloud Computing and Homomorphic Encryption in Mobile Networks

Topic-Oriented Bucket-Based Fast Multicast Routing in SDN-Like Publish/Subscribe Middleware

Contact Info

Product

Resources

About