New Analysis Method Application in Metallographic Images through the Construction of Mosaics Via Speeded Up Robust Features and Scale Invariant Feature Transform

Abstract

In many applications in metallography and analysis, many regions need to be considered and not only the current region. In cases where there are analyses with multiple images, the specialist should also evaluate neighboring areas. For example, in metallurgy, welding technology is derived from conventional testing and metallographic analysis. In welding, these tests allow us to know the features of the metal, especially in the Heat-Affected Zone (HAZ); the region most likely for natural metallurgical problems to occur in welding. The expanse of the Heat-Affected Zone exceeds the size of the area observed through a microscope and typically requires multiple images to be mounted on a larger picture surface to allow for the study of the entire heat affected zone. This image stitching process is performed manually and is subject to all the inherent flaws of the human being due to results of fatigue and distraction. The analyzing of grain growth is also necessary in the examination of multiple regions, although not necessarily neighboring regions, but this analysis would be a useful tool to aid a specialist. In areas such as microscopic metallography, which study metallurgical products with the aid of a microscope, the assembly of mosaics is done manually, which consumes a lot of time and is also subject to failures due to human limitations. The mosaic technique is used in the construct of environment or scenes with corresponding characteristics between themselves. Through several small images, and with corresponding characteristics between themselves, a new model is generated in a larger size. This article proposes the use of Digital Image Processing for the automatization of the construction of these mosaics in metallographic images. The use of this proposed method is meant to significantly reduce the time required to build the mosaic and reduce the possibility of failures in assembling the final image; therefore increasing efficiency in obtaining results and expediting the decision making process. Two different methods are proposed: One using the transformed Scale Invariant Feature Transform (SIFT), and the second using features extractor Speeded Up Robust Features (SURF). Although slower, the SIFT method is more stable and has a better performance than the SURF method and can be applied to real applications. The best results were obtained using SIFT with Peak Signal-to-Noise Ratio = 61.38, Mean squared error = 0.048 and mean-structural-similarity = 0.999, and processing time of 4.91 seconds for mosaic building. The methodology proposed shows be more promissory in aiding specialists during analysis of metallographic images.

Embedded real-time speed limit sign recognition using image processing and machine learning techniques

“…The Canny algorithm was designed to have three main properties: minimum error detection, good border locations and minimal response time. Edge detection has been used in many applications for object segmentation [2,35,44,45], and the Canny detector has been commonly used to find objects, and Hough transform to recognize the right objects.…”

Motion‐blurred SIFT invariants based on sampling in image deformation space and univariate search

“…The SIFT operator has many advantages, including great expansibility, uniqueness, invariance in rotation, scale and brightness variations, stability in perspective transformation, affine transformation and noise. In addition, the SIFT operator has been used as a feature in many image applications, such as metallographic image analysis [9], remote‐sensing image matching [10] and facial recognition [11]. According to the deformation space of two matching images, we can divide matching methods into three types.…”

Framework of Specific Description Generation for Aluminum Alloy Metallographic Image Based on Visual and Language Information Fusion

“…In order to solve these problems, more and more scholars have begun to pay attention to research into intelligent metallographic image processing and analysis methods [12][13][14][15]. In recent years, many automatic metallographic image-processing and analysis methods have been proposed, which can greatly improve the efficiency of metallographic analysis tasks.…”