Instance Segmentation Method of User Interface Component of Games

Kang, Shin-Jin; Choi, Jong-In

doi:10.3390/app10186502

Cited by 2 publications

(2 citation statements)

References 43 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Through existing research on user interfaces, we could confirm the stable image-to-image translation performance of this network [56]. It was generally 2D to 2D translation.…”

Section: Datasetmentioning

confidence: 65%

Image Translation Method for Game Character Sprite Drawing

Choi¹,

Kim²,

Kang³

2022

Computer Modeling in Engineering &Amp; Sciences

Self Cite

View full text Add to dashboard Cite

Two-dimensional (2D) character animation is one of the most important visual elements on which users' interest is focused in the game field. However, 2D character animation works in the game field are mostly performed manually in two dimensions, thus generating high production costs. This study proposes a generative adversarial network based production tool that can easily and quickly generate the sprite images of 2D characters. First, we proposed a methodology to create a synthetic dataset for training using images from the real world in the game resource production field where machine learning datasets are insufficient. In addition, we have enabled effective sprite generation while minimizing user input in the process of using the tool. To this end, we proposed a mixed input method with a small number of segmentations and skeletal bone paintings. The proposed image-to-image translation network effectively generated sprite images from the user input images using the skeletal loss. We conducted an experiment regarding the number of images required and showed that 2D sprite resources can be generated even with a small number of segmentation inputs and one skeletal bone drawing.

show abstract

“…Through existing research on user interfaces, we could confirm the stable image-to-image translation performance of this network [56]. It was generally 2D to 2D translation.…”

Section: Datasetmentioning

confidence: 65%

Image Translation Method for Game Character Sprite Drawing

Choi¹,

Kim²,

Kang³

2022

Computer Modeling in Engineering &Amp; Sciences

Self Cite

View full text Add to dashboard Cite

show abstract

“…These become barriers to the development of deep learning research in game development. Recently, we developed a tool that connects the recent vision-based object segmentation technology to the app used in the data mining field, detects the main UI area in the general app screen and then distinguishes the UI image from it [6]. Since the developed technique can extract semantic information from game screenshots, further studies can be conducted using this knowledge.…”

Section: Introductionmentioning

confidence: 99%

Unsupervised Semantic Segmentation Method of User Interface Component of Games

Kang¹,

Choi²

2022

Intelligent Automation &Amp; Soft Computing

Self Cite

View full text Add to dashboard Cite

The game user interface (UI) provides a large volume of information necessary to analyze the game screen. The availability of such information can be functional in vision-based machine learning algorithms. With this, there will be an enhancement in the application power of vision deep learning neural networks. Therefore, this paper proposes a game UI segmentation technique based on unsupervised learning. We developed synthetic labeling created on the game engine, image-to-image translation and segmented UI components in the game. The network learned in this manner can segment the target UI area in the target game regardless of the location of the corresponding component. The proposed method can help interpret game screens without applying data augmentation. Also, as this scheme is an unsupervised technique, it has the advantage of not requiring paring data. Our methodology can help researchers who need to extract semantic information from game image data. It can also be used for UI prototyping in the game industry.

show abstract

Instance Segmentation Method of User Interface Component of Games

Cited by 2 publications

References 43 publications

Image Translation Method for Game Character Sprite Drawing

Image Translation Method for Game Character Sprite Drawing

Unsupervised Semantic Segmentation Method of User Interface Component of Games

Contact Info

Product

Resources

About