학습율,learning_rate

기호: $\eta$ 또는 $\alpha$


a hyperparameter that determines the step size in adjusting the weights
(Kwak, Slide 3, p18)

$w_{t+1}=w_t - \alpha L'(w_t)$
$0<\alpha<1$
더 섬세하고 촘촘히 : small $\alpha$
더 빠르게 : large $\alpha$ [1]

갱신하는 정도/양을 결정. 함수 값이 낮아지는 곳으로 얼마나 이동할지 즉 보폭(step size)을 정하는 역할.
너무 크거나 작으면 곤란.

MKLINK
기울기하강,gradient_descent 식에 나옴.




Warning: fopen(./data/cache/backlinks/7/75/75c516a1cbe5e0379bbd78589d17d0c5) [function.fopen]: failed to open stream: No such file or directory in /home1/tomoyo/public_html/123/lib/cache.text.php on line 277

Warning: fopen(./data/cache/backlinks/8/86/86bab7f160418ea4f4d278c99847a3ca) [function.fopen]: failed to open stream: No such file or directory in /home1/tomoyo/public_html/123/lib/cache.text.php on line 277

Warning: fopen(./data/cache/backlinks/7/74/74e0a8e1e367a0420467a7cf08bf4c6c) [function.fopen]: failed to open stream: No such file or directory in /home1/tomoyo/public_html/123/lib/cache.text.php on line 277

Warning: fopen(./data/cache/backlinks/f/fb/fbe45970021fd6bdbefa1ffc29677196) [function.fopen]: failed to open stream: No such file or directory in /home1/tomoyo/public_html/123/lib/cache.text.php on line 277

Warning: fopen(./data/cache/backlinks/6/65/656a1520642c6e2336d011bec784f5aa) [function.fopen]: failed to open stream: No such file or directory in /home1/tomoyo/public_html/123/lib/cache.text.php on line 277

Warning: fopen(./data/cache/backlinks/e/e9/e9bc30cb8a545928437970ff5e09b02a) [function.fopen]: failed to open stream: No such file or directory in /home1/tomoyo/public_html/123/lib/cache.text.php on line 277