Sparse neural network optimization by Simulated Annealing
The over-parameterization of neural networks and the local optimality of backpropagation algorithm have been two major problems associated with deep-learning.In order to reduce the redundancy of neural network parameters, the conventional approach has been to prune branches with small weights.However, this only Backup Camera Accessories solves the