Integration of an actor-critic model and generative adversarial networks for a Chinese calligraphy robot

Ruiqi Wu, Changle Zhou, Fei Chao, Longzhi Yang, Chih-Min Lin, Changjing Shang

Allbwn ymchwil: Cyfraniad at gyfnodolynErthygladolygiad gan gymheiriaid

17 Dyfyniadau (Scopus)
164 Wedi eu Llwytho i Lawr (Pure)

Crynodeb

As a combination of robotic motion planning and Chinese calligraphy culture, robotic calligraphy plays a significant role in the inheritance and education of Chinese calligraphy culture. Most existing calligraphy robots focus on enabling the robots to learn writing through human participation, such as human–robot interactions and manually designed evaluation functions. However, because of the subjectivity of art aesthetics, these existing methods require a large amount of implementation work from human engineers. In addition, the written results cannot be accurately evaluated. To overcome these limitations, in this paper, we propose a robotic calligraphy model that combines a generative adversarial network (GAN) and deep reinforcement learning to enable a calligraphy robot to learn to write Chinese character strokes directly from images captured from Chinese calligraphic textbooks. In our proposed model, to automatically establish an aesthetic evaluation system for Chinese calligraphy, a GAN is first trained to understand and reconstruct stroke images. Then, the discriminator network is independently extracted from the trained GAN and embedded into a variant of the reinforcement learning method, the “actor-critic model”, as a reward function. Thus, a calligraphy robot adopts the improved actor-critic model to learn to write multiple character strokes. The experimental results demonstrate that the proposed model successfully allows a calligraphy robot to write Chinese character strokes based on input stroke images. The performance of our model, compared with the state-of-the-art deep reinforcement learning method, shows the efficacy of the combination approach. In addition, the key technology in this work shows promise as a solution for robotic autonomous assembly.
Iaith wreiddiolSaesneg
Tudalennau (o-i)12-23
Nifer y tudalennau12
CyfnodolynNeurocomputing
Cyfrol388
Dyddiad ar-lein cynnar16 Ion 2020
Dynodwyr Gwrthrych Digidol (DOIs)
StatwsCyhoeddwyd - 07 Mai 2020

Ôl bys

Gweld gwybodaeth am bynciau ymchwil 'Integration of an actor-critic model and generative adversarial networks for a Chinese calligraphy robot'. Gyda’i gilydd, maen nhw’n ffurfio ôl bys unigryw.

Dyfynnu hyn