Rice straw is an abundant material with the potential to be converted into a sustainable energy resource. Transition-metal catalysis activated the C–O bond in the hemicellulose of raw rice straw, cleaving it to form monosaccharides. The mechanism of rice straw catalytic conversion had a synergistic effect due to in situ acid catalysis and metal catalysis. The conditions for the hydrogenation of hemicellulose from rice straw were optimized: catalyst to rice straw solid/solid ratio of 3:10, stirring speed of 600 r/min, temperature of 160 °C, time of 3 h, solid/liquid ratio of 1:15, and H2 gas pressure of 1.5 MPa. An excellent hemicellulose conversion of 97.3% with the yields of xylose and arabinose at 53.0% and 17.3%, respectively, were obtained. The results from FTIR and SEM experiments also confirmed the destruction of the rigidity and reticulate structure of rice straw after the catalytic reaction.