We calculate the Hankel determinants of sequences of Bernoulli polynomials. This corresponding Hankel matrix comes from statistically estimating the variance in nonparametric regression. Besides its entries' natural and deep connection with Bernoulli polynomials, a special case of the matrix can be constructed from a corresponding Vandermonde matrix. As a result, instead of asymptotic analysis, we give a direct proof of calculating an entry of its inverse.