loading page

Multi‑lingual character handwriting framework based on an integrated deep learning based sequence‑to‑sequence attention model
  • +3
  • Besma Rabhi ,
  • Abdelkarim Elbaati ,
  • Houcine Boubaker ,
  • Yahia Hamdi ,
  • Amir Hussain ,
  • Adel Alimi
Besma Rabhi
aUniversity of Sfax, University of Sfax

Corresponding Author:[email protected]

Author Profile
Abdelkarim Elbaati
Author Profile
Houcine Boubaker
Author Profile
Yahia Hamdi
Author Profile
Amir Hussain
Author Profile
Adel Alimi
Author Profile

Abstract

Online signals are rich in dynamic features such as trajectory chronology, velocity, pressure and pen up/down movements. Their offline counterparts consist of a set of pixels. Thus, online handwriting recognition accuracy is generally better than offline. In this paper, we propose an original framework for recovering temporal order and pen velocity from offline multi-lingual handwriting. Our framework is based on an integrated sequence-to-sequence attention model. The proposed system involves extracting a hidden representation from an image using a Convolutional Neural Network (CNN) and a Bidirectional Gated Recurrent Unit (BGRU), and decoding the encoded vectors to generate dynamic information using a BGRU with temporal attention. We validate our framework using an online recognition system applied to a benchmark Latin, Arabic and Indian On/Off dual-handwriting character database. The performance of the proposed multi-lingual system is demonstrated through a low error rate of point coordinates and high accuracy system rate.
Dec 2021Published in Memetic Computing volume 13 issue 4 on pages 459-475. 10.1007/s12293-021-00345-6