The non-holonomic constraints cross-domain robot (CDR) is unable to follow the desired trajectory when moving on the ground or water surface due to the lateral side-slipping. Thus, an adaptive positionattitude controller is proposed in this paper to re-plan the robot’s angular velocity and linear velocity. To achieve adaptive control of the robot on the water surface and ground, an adaptive finite-time convergence sliding mode observer (AFSMO) is proposed. This observer is used to obtain time-varying and unknown lumped disturbance which includes uncertain dynamics parameters and environmental disturbances. An adaptive law is designed to improve observer accuracy and reduce output chattering. FSMO is also used to obtain the performance parameter to prevent driver saturation when the robot moves on the water surface. The performance parameter limits the maximum angular velocity and linear velocity. Simulation results demonstrate the effectiveness of the proposed control methods.