We propose a polarization-controlled ultrasmall single-photon emitter that combines a single photon source and an elliptical split ring (SR) type metamaterial element. Simulations using the finite difference time domain method showed that in elliptical metamaterial elements, the annular mode is suppressed and axial electric field oscillations occur preferentially, resulting in upward light emission from the photon source with controlled polarization. We fabricated prototype devices by focused ion beam lithography and PbS QDs. Evaluation of the optical properties of the devices revealed that the emission spectrum width was narrower and the emission lifetime was shorter than those of QD ensemble, and that the polarization was controlled along the minor axis of ellipse. These suggested that the QD emission and the metamaterial element resonated as expected. The combination of a single QD and an elliptical SR-type metamaterial element was shown to operate as a polarization-controlled single-photon emitter.