Efficient Big Data Storage and Retrieval in Distributed Architecture using Blockchain and IPFS

Arer, Maruti M; Dhulavvagol, Praveen M.; Totad, Shashikumar G.

doi:10.1109/i2ct54291.2022.9824566

Cited by 9 publications

(5 citation statements)

References 6 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Therefore, this approach may pose security risks related to a single point of failure, data loss, or compromised server. In [20], the authors integrate blockchain, IPFS, and Elasticsearch to address big data storage challenges in distributed systems, resulting in reduced storage overhead, search latency, and access control. The proposed approach relies on blockchain's inherent security features.…”

Section: Query Optimization Techniquesmentioning

confidence: 99%

Efficient and Secure Distributed Data Storage and Retrieval Using Interplanetary File System and Blockchain

Bin Saif,

Migliorini,

Spoto

2024

Future Internet

View full text Add to dashboard Cite

Blockchain technology has been successfully applied in recent years to promote the immutability, traceability, and authenticity of previously collected and stored data. However, the amount of data stored in the blockchain is usually limited for economic and technological issues. Namely, the blockchain usually stores only a fingerprint of data, such as the hash of data, while full, raw information is stored off-chain. This is generally enough to guarantee immutability and traceability, but misses to support another important property, that is, data availability. This is particularly true when a traditional, centralized database is chosen for off-chain storage. For this reason, many proposals try to properly combine blockchain with decentralized IPFS storage. However, the storage of data on IPFS could pose some privacy problems. This paper proposes a solution that properly combines blockchain, IPFS, and encryption techniques to guarantee immutability, traceability, availability, and data privacy.

show abstract

Section: Query Optimization Techniquesmentioning

confidence: 99%

Efficient and Secure Distributed Data Storage and Retrieval Using Interplanetary File System and Blockchain

Bin Saif,

Migliorini,

Spoto

2024

Future Internet

View full text Add to dashboard Cite

show abstract

“…Sementara sistem file lain menggunakan alamat berbasis lokasi untuk mencari file, IPFS menggunakan alamat berbasis konten di mana alamat file didasarkan pada hash konten file [23]. IPFS juga menggunakan tabel hash terdistribusi untuk mengetahui di mana menemukan data atau jalurnya yang mengarah lebih dekat ke data [24]. Pada arsitektur sistem ini, IPFS digunakan sebagai penyimpanan file yang terdesentralisasi yang memungkinkan file tersebar kedalam beberapa node yang berada dalam jaringan IPFS.…”

Section: Perancangan Arsitektur Sistemunclassified

Desain dan Analisis Sistem CyberShare Menggunakan Four Node Interplanetary File System (IPFS)

Haryanto,

Ramli

2023

JPIT

View full text Add to dashboard Cite

Cybersecurity information sharing is a proactive and collaborative measure in enhancing organizational security by exchanging cybersecurity information using a centralized repository service. However, in practice, the use of centralized services poses a threat to distributed denial-of-service (DDoS) attacks which can result in system failure and cause single point of failure as well as man-in-the-middle (MITM) attacks which can result in modification of information and theft of exchanged information. This threat results in a lack of user confidence in the confidentiality, integrity, and availability of information. This study proposes the design of a secure cybersecurity information sharing (CyberShare) system using a private interplanetary file system (IPFS) network as a decentralized information storage. Unlike centralized storage which only has a single-node, CyberShare systems use four-node IPFS interconnected with swarm keys as authentication keys. This system allows users to store and share information from the sender to the recipient of information, avoiding dependence on a central server and reducing server load. The results of the analysis show that the proposed CyberShare system can guarantee the confidentiality, integrity, and availability of cyber security information. CyberShare systems can enhance the security of the information exchanged so that organizations can safely share and utilize cybersecurity information.

show abstract

“…It was measured as the end-to-end block generation time, which indicates how quickly new blocks are created and validated. Lower network latency signifies faster confirmation and validation of transactions, contributing to a more responsive and efficient blockchain system [23].…”

Section: A Performance Evaluation Metricsmentioning

confidence: 99%

Scalable Blockchain Architecture: Leveraging Hybrid Shard Generation and Data Partitioning

Dhulavvagol,

Kundur

et al. 2023

IJACSA

View full text Add to dashboard Cite

Blockchain technology has gained widespread recognition and adoption in various domains, but its implementation beyond crypto currencies faces a significant challenge -poor scalability. The serial execution of transactions in existing blockchain systems hampers transaction throughput and increases network latency, limiting overall system performance. In response to this limitation, this paper proposes a static analysis-driven data partitioning approach to enhance blockchain system scalability. By enabling parallel and distributed transaction execution through a simultaneous blocklevel transaction approach, the proposed technique substantially improves transaction throughput and reduces network latency. The study employs a hybrid shard generation algorithm within the Geth node of the blockchain network to create multiple shards or partitions. Experimental results indicate promising outcomes, with miners experiencing a remarkable speedup of 1.91x and validators achieving 1.90x, along with a substantial 35.34% reduction in network latency. These findings provide valuable insights and offer scalable solutions, empowering researchers and practitioners to address scalability concerns and promoting broader adoption of blockchain technology across various industries.

show abstract

Efficient Big Data Storage and Retrieval in Distributed Architecture using Blockchain and IPFS

Cited by 9 publications

References 6 publications

Efficient and Secure Distributed Data Storage and Retrieval Using Interplanetary File System and Blockchain

Efficient and Secure Distributed Data Storage and Retrieval Using Interplanetary File System and Blockchain

Desain dan Analisis Sistem CyberShare Menggunakan Four Node Interplanetary File System (IPFS)

Scalable Blockchain Architecture: Leveraging Hybrid Shard Generation and Data Partitioning

Contact Info

Product

Resources

About