Rationale: Stable isotope analyses of environmental waters (δ 2 H, δ 18 O) are an important assay in hydrology and environmental research with rising interest in δ 17 O, which requires ultra-precise assays. We evaluated isotope analyses of six test water samples for 281 laboratory submissions measuring δ 2 H and δ 18 O along with a subset analyzing δ 17 O and Δ 17 O by laser spectrometry and isotope ratio mass spectrometry (IRMS).Methods: Six test waters were distributed to laboratories spanning a wide δ range of natural waters for δ 2 H, δ 18 O and δ 17 O and Δ 17 O. One sample was a blind duplicate to test reproducibility and claims of analytical precision.Results: Results showed that ca 83% of the submissions produced acceptable δ 18 O and δ 2 H results within 0.2‰ (mUr) and 1.6‰ of the benchmark values, respectively. However, 17% of the submissions gave questionable to unacceptable results. A blind duplicate revealed many laboratories reported overly optimistic precision, and many could not replicate within their claimed precision. For Δ 17 O, dual-inlet results for IRMS using quantitative O 2 conversion were accurate and highly precise, but the results for laser spectrometry ranged by ca 200 per meg (μUr) for each sample, with ca 70% unable to replicate the duplicate to their claimed Δ 17 O precision. One complicating factor is the lack of certified primary reference waters for δ 17 O.Conclusions: No single factor or combination of factors was identifiable for poor or good performance, and underperformance came from issues like data normalization including inadequate memory and drift corrections, compromised working reference materials and underperforming instrumentation. We recommend isotope laboratories include high and low δ value controls of known isotope composition in each run.Progress in Δ 17 O analyses by laser spectrometry requires extraordinary proof of performance claims and would benefit from the development of adoptable and systematic advanced data processing procedures to correct for memory and drift.