The ability to characterize the complete quantum state of light is essential for both fundamental and applied science. For single photons the quantum state is provided by the mode that it occupies. The spectral temporal mode structure of light has recently emerged as an essential means for quantum information science. Here we experimentally demonstrate a self-referencing technique to completely determine the pulse-mode structure of single photons by means of spectral shearing interferometry. We detail the calibration and resolution of the measurement and discuss challenges and critical requirements for future advances of this method.Quantum photonic technology research is increasingly focusing on ultrashort optical pulsed modes due to their high information content and their compatability with integrated optical platforms. The time-frequency (TF) degree of freedom constitutes an infinite Hilbert space [1], allowing an information content per photon limited only by the encoder and detector resolution. Accessing the information contained in both the spectral amplitude and phase domains of ultrafast pulsed modes of quantum light raises the possibility of surpassing the standard quantum limit in precision measurements such as pulse time-of-flight [2] and atmospheric characteristics [3]. Furthermore, the freedom to encode quantum information in multiple spectral-temporal modes, and then to recover that information, extends the usefulness of quantum secure information protocols such as quantum key distribution (QKD) [4]. However, for these advantages to be exploited, complete and reliable characterization techniques of quantum light pulses are required.Quantum optical technologies involve three experimental stages: state preparation, state evolution or active manipulation, and ultimately measurement. The ability to accurately characterize the quantum state of light is crucial for developing all three stages of optical quantum technologies. Firstly, the development of nonclassical light sources requires complete characterization of the optical field output to certify the output light matches the desired quantum state [5]. Secondly, verifying operations that manipulate the quantum state of light requires full characterization of a complete set of probe states [6]. This forms the basis of optical quantum process tomography. Finally, the development of new quantum optical detectors requires the ability to probe the detector response with a complete set of probe states, a technique known as quantum detector tomography. The set of probe states can be verified by first using a previously calibrated detector.The pulse envelope of ultrashort optical pulses varies on a time scale far shorter than the response time of the best photodetectors, making direct sampling of the temporal intensity of ultrashort optical pulses infeasible. Moreover, full reconstruction of an optical pulse train necessitates knowledge of its spectral or temporal phase even if the amplitude is known in both the time and frequency domains [7]. Although signi...