The numerical hailstone sequences, or orbits, generated by the Collatzmap have been disclosed to present relevant features commonly associated with complex systems. It is so despite the extreme simplicity of the arithmetic dynamical system iteration rule. Indeed, for a positive integer n, the Collatz map f reads f(n) = n/2 ( f(n) = 3n + 1) for n even (odd). Seeking to elucidate this surprising fact, here we unveil distinct characteristics of stochastic-like behavior for collections of Collatz orbits by considering methods commonly employed to temporal series, as cryptography tests, power-spectrum, detrended fluctuation, auto-correlation and entropy measure. Besides confirming previous predictions that the Collatz orbits display some global properties of geometric Brownian motion, our results are likewise able to explain, at least heuristically, the reasons for so. In special, we show by means of comprehensive analysis that our findings cannot be ascribed to standard chaotic evolution. Moreover, we identify novel short- and mid-range correlations in the Collatz orbits. The Collatz map is hence a paradigmatic example of an arithmetic dynamical systemwhich could also be regarded as an arithmetic statistical physics system, explaining its dynamical richness.