TechRxiv
important_milestones_in_the_study_of_neural_networks_with_random_weights.pdf (98.64 kB)
Download file

Important Milestones in the Study of Neural Networks with Random Weights

Download (98.64 kB)
preprint
posted on 01.11.2021, 17:41 by Juergen BrauerJuergen Brauer
Neural networks with partially random weights are currently not really an independent field of research. However, the first works on random neural networks date back to the 1990s and in the last three decades there have been important new works in which random weights have been used and which are promising in that they give surprisingly good results when compared to approaches in which all weights are trained. These works, however, come from very different subareas of neural networks: Random Feedforward Neural Networks, Random Recurrent Neural Networks and Random ConvNets. In this paper, I analyze the most important works from these three areas and thereby follow a chronological order. I also work out the core result of each work. As a result, the reader can get a quick overview of this field of research.

History

Email Address of Submitting Author

juergen.brauer@hs-kempten.de

ORCID of Submitting Author

0000-0002-0985-9917

Submitting Author's Institution

University of Applied Sciences Kempten

Submitting Author's Country

Germany

Usage metrics

Licence

Exports