Generating image captions through multimodal embedding

English to Hindi Multi-modal Neural Machine Translation and Hindi Image Captioning

“…The multi-modal translation is an emerging task of the MT community, where visual features of image combine with textual features of parallel source-target text to translate sentences (Shah et al, 2016). Interestingly, multi-modal concept improved the translation quality of generating the captions of the images (Dash et al, 2019) as well as significant improvement over text-only NMT system (Huang et al, 2016). In text-only NMT system, the encoder-decoder framework of NMT is a widely accepted technique used in the task of MT.…”