Panicle traits are among the most important agronomic characters which directly relate to yield in rice. Grain number (GN), panicle length (PL), primary branch number (PBN), and secondary branch number (SBN) are the major components of rice panicle structure, and are all controlled by quantitative trait loci (QTLs). In our research, four advanced backcross overlapping populations (BIL152, BIL196a, BIL196b, and BIL196b-156) carrying introgressed segments from chromosome 6 were derived from an indica/japonica cross that used the super-hybrid rice restorer line HR1128 and the international sequenced japonica cultivar ‘Nipponbare’ as the donor and recurrent parents, respectively. The four panicle traits, GN, PL, PBN, and SBN, were evaluated for QTL effects using the inclusive composite interval mapping (ICIM) method in populations over two years at two sites. Results showed that a total of twelve QTLs for GN, PL, PBN, and SBN were detected on chromosome 6. Based on marker loci physical positions, the QTLs were found to be tightly linked to three important chromosomal intervals described as RM7213 to RM19962, RM20000 to RM20210, and RM412 to RM20595. Three QTLs identified in this study, PL6-5, PBN6-1, and PBN6-2, were found to be novel compared with previous studies. A major QTL (PL6-5) for panicle length was detected in all four populations at two locations, and its position was narrowed down to a 1.3Mb region on chromosome 6. Near isogenic lines (NILs) carrying PL6-5 will be developed for fine mapping of the QTL, and our results will provide referable information for gene excavation of panicle components in rice.