Skip to content

Commit

Permalink
Fix docstring of CosAnneal
Browse files Browse the repository at this point in the history
Fixes #67.
  • Loading branch information
dpaetzel committed Nov 8, 2024
1 parent 98d072d commit a445060
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion src/cyclic.jl
Original file line number Diff line number Diff line change
Expand Up @@ -186,7 +186,7 @@ A cosine annealing schedule
(see ["SGDR: Stochastic Gradient Descent with Warm Restarts"](https://arxiv.org/abs/1608.03983v5))
The output conforms to
```text
t̂ = restart ? (t - 1) : mod(t - 1, period)
t̂ = restart ? mod(t - 1, period) : (t - 1)
abs(l0 - l1) * (1 + cos(π * t̂ / period)) / 2 + min(l0, l1)
```
This schedule is also referred to as "cosine annealing (with warm restarts)"
Expand Down

0 comments on commit a445060

Please sign in to comment.