A Software Service for the Garbage Type Recognition Based on the Mobile Computing Devices With Graphical Data Input

Abstract

The article describes problems of determining the type and automatic sorting of household waste using mobile computing devices. All of the required hardware and partially software, required for implementation of this service, are already present in modern smartphones. iOS and Apple products were selected as the base for the service, due to such advantages over competitors: dual or triple depth camera (TDCS), powerful GPU, Neural Engine coprocessor, high autonomy (2750mAh battery size), sensors that allow for user positioning and navigation in space (GPS, Glonass, Gyroscope) and most important feature is possibility of cross-platform designing, suitable for iOS and macOS (Project Catalina). The recognition process consists of several phases, including capturing of graphic image and detecting the object shape, shape analysis, computing the results, and saving new associations to the database. The analysis itself is implemented using a neural network that is able to learn during its operation. Initially, the algorithm is driven by the selection of photographs with a certain type for the base set of associations, each subsequent scan improves accuracy. Cross-platforming plays a very important role — it allows us to develop a single software service that is initially run on a macOS-based computer for faster learning and then can be easily used on an iOS mobile device. After identifying a particular type of garbage, the route to the nearest recycling point of such type of garbage will be proposed for user or user’s clarification will be requested. User can also manually browse categories and related items, manually search by name of item, and view locations for sorting and recycling in appropriate city. When a completely unknown object arrives, it is possible to refine the information in order to help further learning of the network.

Methods of Vehicle Recognition and Detecting Traffic Rules Violations on Motion Picture Based on OpenCV Framework

“…Chaku A. with co-authors presented a concept of software service for garbage type recognition using mobile devices and computer vision technology. It uses smartphone hardware (camera for capturing objects and then using neural network for determining the appropriate type of garbage) for navigating user to the nearest recycling plants for different types of household waste [1].…”

“…The software system consists of several main modules which are responsible for the various stages of processing the input data and subsequent actions. The system includes a module for processing device's camera data, analytics module [1], [2]. Vehicle detection and tracking flow are shown in Fig.…”