Chinese Speech Processing via Chinese Character Feature

Abstract

This paper focuses on the basic structure of Chinese characters: semantic-phonetic compound characters. This paper takes advantage of this feature of Chinese characters and innovatively proposes a Chinese speech-processing method based on character shape. We use the association between the character shape and pronunciation of Chinese characters to construct a new character stroke-based dataset. We use two neural network structures, RNN and Transformer, to verify our proposed Chinese speech processing method.It is proved through experiments that the method improves the performance of Mandarin ASR(Automatic Speech Recognition) by about 2% and AEC(ASR Error Correction) by about 1%. Theoretically, this method applies to all Chinese speech-processing algorithms based on the attention mechanism.