End to End Invoice Processing Application Based on Key Fields Extraction

Abstract

In this paper, an automatic invoice processing system, which is in great demand among private and public companies, was proposed. The proposed system supports all invoice file types that can be submitted by companies. Companies can easily submit invoices to the system via the web interface or email, and all invoices submitted to the system are queued and processed sequentially. If the invoice is a text file, the invoice information is extracted from the text by using template matching. If the invoice is an image, the text and table areas are detected and extracted. For table detection, we used both image processing based and YOLOv5-based deep learning method. Cell extraction was then performed from the extracted table images. As a result of these processes, all text and table cells were obtained as images and these images were converted into machine-readable text using the open-source software Tesseract OCR. Tesseract already provides trained models for English and Turkish. However, these models do not provide successful results for invoices submitted by companies in Turkish. Therefore, the new fine-tuned model trained with invoices in Turkish was used for OCR. The experimental results showed that the trained Turkish model was more accurate than the Turkish and English models provided by Tesseract. In addition, the YOLOv5-based table detection model was more accurate than the image-processing-based table detection method.

Augmented Reality and Ontology-based Approach for Enhancing Arabic Text Recognition and Visualization

“…Bisakh et al [14] proposed an approach that enables text identification, recognition, and text-to-speech conversion using EfficientDet and Faster R-CNN for obtaining bounding boxes. Hallil et al [15] employed YOLOv5 for detecting text in an automated system for processing invoices. Jingqun et al [16] presented Box Adjuster, a reinforcement learning-based method to modify the form of each text's bounding box to improve compatibility with text recognition models.…”

An Overview of Data Extraction From Invoices

“…By integrating with the company's existing systems, such as accounting and enterprise resource planning (ERP) systems, these systems streamline the invoice processing workflow into a global electronic document management system (EDMS) [63]. Recent advances have led to the development of other end-toend solutions for invoices [6].…”

“…One such paper is [52], which does not cover table extraction. In [6], a very interesting end-to-end system is proposed for processing invoices, including the different abovementioned steps. Choices are made to select relevant techniques and the resulting system focuses on key fields extraction.…”