TechRxiv
IEEE_TechRxiv_Final_ver2.0.pdf (2.44 MB)
Download file

Investigation of weight initialization using Fibonacci Sequence on the performance of neural networks*

Download (2.44 MB)
preprint
posted on 2021-05-14, 01:37 authored by Dipanwita Sinha MukherjeeDipanwita Sinha Mukherjee, Naveen Yeri
Initializing weights are important for fast convergence and performance improvement of Artificial Neural Network models. This study proposes a heuristic method to initialize weights for Neural Network with Fibonacci sequence. Experiments have been carried out with different network structures and datasets and results have been compared with other initialization techniques such as Zero, Random, Xavier and He. It has been observed that for small sized datasets, Fibonacci initialization technique reports 94% of test accuracy which is better than Random (85%) and close to Xavier (93%) and He (96%) initialization methods. Also, for medium sized dataset, we have noted that performance of Fibonacci weight initialization method is comparable with the same for Random, Xavier and He initialization techniques.

Funding

Wells Fargo International Solutions Private Limited, Bangalore, India

History

Email Address of Submitting Author

dipanwitas@alum.iisc.ac.in

Submitting Author's Institution

Artificial Intelligence - Center of Excellence, Wells Fargo International Solutions Private Limited, Bangalore, India

Submitting Author's Country

  • India

Usage metrics

    Exports