Optical coherence tomography (OCT) is the gold standard for quantitative ophthalmic imaging. The majority of commercial and research systems require patients to fixate and be imaged in a seated upright position, which limits the ability to perform ophthalmic imaging in bedridden or pediatric patients. Handheld OCT devices overcome this limitation, but image quality often suffers due to a lack of real-time aiming and patient eye and photographer motion. We describe a handheld spectrally encoded coherence tomography and reflectometry (SECTR) system that enables simultaneous en face reflectance and cross-sectional OCT imaging. The handheld probe utilizes a custom double-pass scan lens for fully telecentric OCT scanning with a compact optomechanical design and a rapid-prototyped enclosure to reduce the overall system size and weight. We also introduce a variable velocity scan waveform that allows for simultaneous acquisition of densely sampled OCT angiography (OCTA) volumes and widefield reflectance images, which enables highresolution vascular imaging with precision motion-tracking for volumetric motion correction and multivolumetric mosaicking. Finally, we demonstrate in vivo human retinal OCT and OCT angiography (OCTA) imaging using handheld SECTR on a healthy volunteer. Clinical translation of handheld SECTR will allow for high-speed, motion-corrected widefield OCT and OCTA imaging in bedridden and pediatric patients who may benefit ophthalmic disease diagnosis and monitoring.