In Nigeria, the rural population comprises 49% of the total population and has been reported to bear the brunt of ongoing water access challenges. For communities to have access to clean and safe water, an adequate water source should be ensured. In dissevering the definition of water access, this research identifies that distance to a water source, time spent to collect water, water availability, and water quality are determinants of water source choice. A survey with 404 randomly selected respondents was conducted in three local government areas in Kogi state alongside interviews with key participants (n = 12). The data collected were analysed using a Chi-square test to determine any significant relationship between water source choice and the predictor variables (age, education, occupation, religion, ethnic group, household size, income, and distance). Furthermore, multinomial logistic regression was adopted to investigate the relationship and effect between these variables. Findings indicated that the predictor factors such as age, level of education, ethnic group, and participants’ occupation have a statistically significant relationship with using a particular water source. Finally, more insights for policymakers are provided to bridge the gap surrounding water access in developing countries while focusing on an adequate water source.