Computer Architecture for a Surrogate File to a Very Large Data/Knowledge Base

Berra,; Chung, Sung‐Yoon; Hachem,

doi:10.1109/mc.1987.1663506

Cited by 29 publications

(7 citation statements)

References 9 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…The first is that under optimal design, half of the bits in the record signature should be set to "1" (maximizing the entropy of the signature). The second corollary is that the logarithm of Fa is asymptotically linear on the signature size F. Both of the above observations hold for any SC scheme studied up to now [2], [32], [10].…”

Section: Discussionmentioning

confidence: 79%

Signature files: An integrated access method for text and attributes, suitable for optical disk storage

Faloutsos

1988

BIT

View full text Add to dashboard Cite

Abstract.We design and analyze integrated ways of applying the signature file approach for text and attributes simultaneously. In traditional signature file methods, the records are stored sequentially in the "main file"; for every record, a hash-coded abstraction of it ("record signature") is created and stored in the signature file (usually, sequentially). To resolve a query, the signature file is scanned : the signatures retrieved correspond to all the qualifying records, plus some "false drops".Here, we extend some signature file methods, namely superimposed coding and disjoint coding, to handle text and attributes. We develop a mathematical model and derive formulas for the optimal choice of parameters. The proposed methods achieve significant performance improvements, because they can take advantage of the skewed distribution of the queries. Depending on the query frequencies, the false drop probability can be reduced 40-45 times (~ 97% savings), for the same overhead.

show abstract

Section: Discussionmentioning

confidence: 79%

Signature files: An integrated access method for text and attributes, suitable for optical disk storage

Faloutsos

1988

BIT

View full text Add to dashboard Cite

show abstract

“…When the database is static and most queries are based on few keys, an inverted index would be the best indexing scheme. On the other hand, when the database is to be frequently updated, and partial match queries based on a number of key values are common, surrogate files [BER87] and most dynamic multidimensional file structures can provide better performance in retrieval and update over other schemes.…”

Section: Text and Formatted Datamentioning

confidence: 99%

“…In our system development, the effect of changing the underlying database management system will be minimized so that various database management constructs can be exploited. We also plan to develop a high speed file access method based on surrogate files [BER87] for multimedia applications.…”

Section: Database Managementmentioning

confidence: 99%

Architecture for distributed multimedia database systems

Berra

Chen

Ghafoor

et al. 1990

Computer Communications

View full text Add to dashboard Cite

Abstract-In the past few years considerable demand for user oriented multimedia information systems has developed. These systems must provide a rich set of functionality so that new, complex, and interesting applications can be addressed. This places considerable importance on the management of diverse data types including text, images, audio and video. These requirements generate the need for a new generation of distributed heterogeneous multimedia database systems. In this paper we identify a set of functional requirements for a multimedia server considering database management, object synchronization and integration, and multimedia query processing. A generalization of the requirements to a distributed system is presented, and some of our current research and developing activities are discussed.

show abstract

“…Since a partition contains signatures of the same key, we use K,,,, to refer to the key of the partition Mj and 12 to denote the length of a key. More precisely, (2) Note that only Si is stored in the partition. The original signature can be constructed from Si and KMi.…”

Section: Signature File Partitioningmentioning

confidence: 99%

Partitioned signature files: design issues and performance evaluation

Lee

Leng

1989

ACM Trans. Inf. Syst.

View full text Add to dashboard Cite

A signature file acts as a filtering mechanism to reduce the amount of text that needs to be searched for a query. Unfortunately, the signature file itself must be exhaustively searched, resulting in degraded performance for a large file size. We propose to use a deterministic algorithm to divide a signature file into partitions, each of which contains signatures with the same "key." The signature keys in a partition can be extracted and represented as the partition's key. The search can then be confined to the subset of partitions whose keys match the query key. Our main concern here is to study methods for obtaining the keys and their performance in terms of their ability to reduce the search space.Owing to the reduction of search space, partitioning a signature file has a direct benefit in a sequential search (single-processor) environment. In a parallel environment, search can be conducted in parallel effectively by allocating one or more partitions to a processor. Partitioning the signature tile with a deterministic method (as opposed to a random partitioning scheme) provides intraquery parallelism as well as interquery parallelism.In this paper, we outline the criteria for evaluating partitioning schemes. Three algorithms are described and studied. An analytical study of the performance of the algorithms is provided and the results are verified with simulation.

show abstract

Computer Architecture for a Surrogate File to a Very Large Data/Knowledge Base

Cited by 29 publications

References 9 publications

Signature files: An integrated access method for text and attributes, suitable for optical disk storage

Signature files: An integrated access method for text and attributes, suitable for optical disk storage

Architecture for distributed multimedia database systems

Partitioned signature files: design issues and performance evaluation

Contact Info

Product

Resources

About