Sentence examples for weight decay from inspiring English sources

Weight decay parameter (lambda = 0.0025)   5.

The weight decay is with the value of 0.0005.

A-NN; hidden nodes 72, learning rate 0.02, weight decay 0.001, training epochs 30,000.

B-NN; hidden nodes 76, learning rate 0.02, weight decay 0.001, training epochs 30,000.

G-NN; hidden nodes 68, learning rate 0.015, weight decay 0.0005, training epochs 28,000.

H-NN; hidden nodes 81, learning rate 0.02, weight decay 0.001, training epochs 33,000.

N-NN; hidden nodes 74, learning rate 0.02, weight decay 0.001, training epochs 32,000.

We set the weight decay and momentum to 0.005 and 0.9, respectively.

C-NN; hidden nodes 57, learning rate 0.01, no weight decay needed, training epochs 35,000.

In classification by softmax regression, following parameters are used: 1. Weight decay parameter (lambda = 0.001)   2.

M-NN; hidden nodes 68, learning rate 0.015, weight decay 0.005, training epochs 28,000.