Mechanical stress at the surfaces of GaAs and InAlAs, caused by adsorption of O or N on their group III surfaces, was calculated using small cluster models and first-principles calculations. These elements adsorb at the bridge sites and give strong compressive stress to the crystal. Assuming that only the O and N at the interface generate the stress, i.e., the insulator does not give any stress, mechanical stress at the insulator/semiconductor interface were calculated. N at the insulator/GaAs interface does not give a strong stress, but O does. Calculation results were compared with various experimental results. The results do not contradict any of the examined experimental findings, and these findings are reasonably understandable when one takes the mechanical stress as a cause of the interface degradation.