Automatic Keyword and Sentence-Based Text Summarization for Software Bug Reports

Abstract

Text Summarization is a process which efficiently retrieves the relevant information from documents. The objective of the proposed, unsupervised approach is to summarize bug reports (software artefacts) with complete content and diversified information. The proposed approach utilizes Rapid Automatic Keyword Extraction and term frequency-inverse document frequency method to extract meaningful keywords and key-phrases with a relevant score. For sentence extraction, fuzzy C-means clustering is used to extracts sentences having high degree of membership from each cluster above a set threshold value. A ruleengine is used for sentence selection. The rules are generated with the domain knowledge and based on the extracted information by the keywords and sentences selected by the clustering method. Cohesive and coherent summary is generated by the proposed method on apache bug reports. For redundancy removal and to re-rank generated summary, hierarchical clustering is presented to enrich the extracted summary. The proposed approach is evaluated on newly constructed Apache project Bug Report Corpus (APBRC) and existing Bug Report Corpus (BRC). The results are compared on the basis of performance metrics such as precision, recall, pyramid precision and F-score. The experimental results depict that our proposed approach attains significant improvement over other baseline approaches such as BRC and LRCA. It also attains significant improvement over existing state-of-art unsupervised approaches such as Hurried, centroid and others. It extracts significant keyword phrases and sentences from each cluster to achieve full coverage and coherent summary. The results evaluated on APBRC corpus attains an average value of 78.22%, 82.18%, 80.10% and 81.66% for precision, recall, f-score and pyramid precision respectively. INDEX TERMS Text summarization, rapid automatic keyword extraction, fuzzy c-means, hierarchical clustering, bug reports, rule engine.

Support Vector Machine Based Handwritten Hindi Character Recognition and Summarization

“…A multi-font system is considered when a collection of typefaces previously taught recognizes several types. Furthermore, any font may be identified in an Omni-font system, generally without learning [29,30]. However, this is almost difficult because hundreds of kinds exist, some of which are humanely unreadable.…”

“…In this phase, the different logical components of an image are extracted. From the recorded image, text and graphic blocks are separated first and removed from a text block from which words and letters are found [29].…”

“…A character recognition starts by analyzing its shape and extracting its distinctive characteristics, which are used to identify it. Feature types may be categorized into four major groups: structural characteristics, statistical features, global changes, overlaps, and correlations of the model [29,35].…”

Discovering and Validating AI Errors With Crowdsourced Failure Reports

“…While failure reports differ significantly from bug reports, we build on existing software engineering research on improving bug reporting. Bug summaries can be helpful for quickly triaging bugs and finding similar issues [28,50]. For example, one method for improving reports showed how using crowd-elicited attributes could improve bug summaries [27].…”

Improved Text Summarization of News Articles Using GA-HC and PSO-HC

“…In [16], the proposed ensemble model makes use of parallel ensemble approach with classification performed on voting system for text summarization. A bug report text summarization technique is presented in [17]. The model applied fuzzy c-mean clusters for similar sentences and fuzzy logic for making decision of adding or discarding sentences for final summary.…”