Directional Filter Banks (DFB) is a method for directional decomposition. It has been used in image enhancement procedure that involved image with many edges. The design of Decimation-Free Directional Filter Bank (DDFB) is made to give a better result for enhancement. However, the design cannot give an adaptive directional decomposition based on input image. In this paper, we proposed a Non-Uniform Decimation-Free Directional Filter Bank (NUDDFB) using Histogram Analysis for Image Enhancement. NUDDFB can build an adaptive directional filter depends on the input image. The result shows that NUDDFB can separate each directional image better than DDFB. The use of this method in image enhancement helps to retain the image from over enhancement.