In our previous study, we presented a method of estimating the color of amber using the red, green, and blue (RGB) color space and the hue, saturation, and value (HSV) color space. In particular, the method estimates the color of amber on a target image consisting of four colors (yellow, brown, black, and amber with an outer cover [AOC]). However, because of the existence of amber with a partially exposed outer cover (APEOC), the estimated accuracy of AOCs was 57.1%. In addition, the size of the amber used in the study was approximately 1-2 cm, considering improvements in versatility. It is also necessary to estimate the color of amber with a size of approximately 3-5 mm, which is even smaller. However, because the color of brown amber is similar to yellow amber, the estimation accuracy of amber having a size of less than 1 cm, using conventional methods, was 62.1%. Therefore, in this paper, we propose a method that switches the estimation method in terms of color features and amber of sizes ranging between 1 and 2 cm and those of 1 cm or less. Based on the experimental results of the proposed method, estimation accuracies of 94.1% for 185 ambers with a size of 1-2 cm and 96.0% for 125 ambers with a less than 1 cm were achieved.