cosine_decay

Fields

Field	Default	Description	Type
name	???	The referenced name of the object to construct	str
total_steps	${task.max_steps}	Total number of steps to run	int
num_resets	0	Number of times to reset learning	int
phase	???	Number of steps in a phase	int
ramp_up_percent	0.05	Percent of phase to spend ramping up	float
ramp_up_steps	???	Number of steps to spend ramping up	int
eta_min	0.01	Minimum learning rate scale	float
eta_max	1.0	Maximum learning rate scale	float
min_decay	0.0001	Minimum learning rate decay	float