loading page

Analysis, Design and Evaluation of a High-Performance Stochastic Multilayer Perceptron: from Mini-Batch Training to Inference
  • +2
  • Ziheng Wang ,
  • Farzad Niknia ,
  • Shanshan Liu ,
  • Pedro Reviriego ,
  • Fabrizio Lombardi
Ziheng Wang
Author Profile
Farzad Niknia
Author Profile
Shanshan Liu
New Mexico State University

Corresponding Author:[email protected]

Author Profile
Pedro Reviriego
Author Profile
Fabrizio Lombardi
Author Profile

Abstract

The mini-batch technique is widely used in neural network training with conventional arithmetic for its efficiency; however, its feasibility and performance in SC MLPs have rarely been studied. This paper analyzes by theory and simulation the performance of the mini-batch technique in SC MLPs; the results show that it potentially has a larger benefit in MLPs using SC than the conventional version. Moreover, a pipelined SC MLP implementation is also pursued in this paper for performing the inference process. All findings and designs provided in this paper leverage the advantages of the mini-batch technique and SC implementation to design high-performance MLPs.