In this note, we obtain the structure of short normal sequences over a finite abelian p-group or a finite abelian group of rank two, thus answering positively a conjecture of Gao and Zhuang for various groups. The results obtained here improve all known results on this conjecture.