The mechanical behavior of soft connective tissue is governed by a dense network of fibrillar proteins in the extracellular matrix. Characterization of this fibrous network requires the accurate extraction of descriptive structural parameters from imaging data, including fiber dispersion and mean fiber orientation. Common methods to quantify fiber parameters include fast Fourier transforms (FFT) and structure tensors, however, information is limited on the accuracy of these methods. In this study, we compared these two methods using test images of fiber networks with varying topology. The FFT method with a band-pass filter was the most accurate, with an error of 0.71 ± 0.43 degrees in measuring mean fiber orientation and an error of 7.4 ± 3.0% in measuring fiber dispersion in the test images. The accuracy of the structure tensor method was approximately 4 times worse than the FFT band-pass method when measuring fiber dispersion. A free software application, FiberFit, was then developed that utilizes an FFT band-pass filter to fit fiber orientations to a semicircular von Mises distribution. FiberFit was used to measure collagen fibril organization in confocal images of bovine ligament at magnifications of 63x and 20x. Grayscale conversion prior to FFT analysis gave the most accurate results, with errors of 3.3 ± 3.1 degrees for mean fiber orientation and 13.3 ± 8.2% for fiber dispersion when measuring confocal images at 63x. By developing and validating a software application that facilitates the automated analysis of fiber organization, this study can help advance a mechanistic understanding of collagen networks and help clarify the mechanobiology of soft tissue remodeling and repair.