An LSTM Based Generative Adversarial Architecture for Robotic Calligraphy Learning System

Fei Chao, Gan Lin, Ling Zheng*, Xiang Chang, Chih Min Lin, Longzhi Yang, Changjing Shang

*Awdur cyfatebol y gwaith hwn

Allbwn ymchwil: Cyfraniad at gyfnodolynErthygladolygiad gan gymheiriaid

55 Wedi eu Llwytho i Lawr (Pure)


Robotic calligraphy is a very challenging task for the robotic manipulators, which can sustain industrial manufacturing. The active mechanism of writing robots require a large sized training set including sequence information of the writing trajectory. However, manual labelling work on those training data may cause the time wasting for researchers. This paper proposes a machine calligraphy learning system using a Long Short-Term Memory (LSTM) network and a generative adversarial network (GAN), which enables the robots to learn and generate the sequences of Chinese character stroke (i.e., writing trajectory). In order to reduce the size of the training set, a generative adversarial architecture combining an LSTM network and a discrimination network is established for a robotic manipulator to learn the Chinese calligraphy regarding its strokes. In particular, this learning system converts Chinese character stroke image into the trajectory sequences in the absence of the stroke trajectory writing sequence information. Due to its powerful learning ability in handling motion sequences, the LSTM network is used to explore the trajectory point writing sequences. Each generation process of the generative adversarial architecture contains a number of loops of LSTM. In each loop, the robot continues to write by following a new trajectory point, which is generated by LSTM according to the previously written strokes. The written stroke in an image format is taken as input to the next loop of the LSTM network until the complete stroke is finally written. Then, the final output of the LSTM network is evaluated by the discriminative network. In addition, a policy gradient algorithm based on reinforcement learning is employed to aid the robot to find the best policy. The experimental results show that the proposed learning system can effectively produce a variety of high-quality Chinese stroke writing.

Iaith wreiddiolSaesneg
Rhif yr erthygl9092
Nifer y tudalennau11
CyfnodolynSustainability (Switzerland)
Rhif cyhoeddi21
Dynodwyr Gwrthrych Digidol (DOIs)
StatwsCyhoeddwyd - 31 Hyd 2020

Ôl bys

Gweld gwybodaeth am bynciau ymchwil 'An LSTM Based Generative Adversarial Architecture for Robotic Calligraphy Learning System'. Gyda’i gilydd, maen nhw’n ffurfio ôl bys unigryw.

Dyfynnu hyn