Carbon-bearing molecules, particularly CO, have been widely used as tracers of molecular gas in the interstellar medium (ISM). In this work, we aim to study the properties of molecules in diffuse, cold environments, where CO tends to be under-abundant and/or sub-thermally excited. We performed one of the most sensitive (down to τ CO rms ∼ 0.002 and τ HCO + rms ∼ 0.0008) sub-millimeter molecular absorption line observations towards 13 continuum sources with the ALMA. CO absorption was detected in diffuse ISM down to A v < 0.32 mag and HCO + was down to A v < 0.2 mag, where atomic gas and dark molecular gas (DMG) starts to dominate. Multiple transitions measured in absorption toward 3C454.3 allow for a direct determination of excitation temperatures T ex of 4.1 K and 2.7 K, for CO and for HCO + , respectively, which are close to the cosmic microwave background (CMB) and provide explanation for their being undercounted in emission surveys. A stronger linear correlation was found between N HCO + and N H2 (Pearson correlation coefficient P ∼ 0.93) than that of N CO and N H2 (P ∼ 0.33), suggesting HCO + being a better tracer of H 2 than CO in diffuse gas. The derived CO-to-H 2 conversion factor (the CO X-factor) of (14 ± 3) × 10 20 cm −2 (K km s −1 ) −1 is approximately 6 times larger than the average value found in the Milky Way.