plugins.natgrad package

Submodules

plugins.natgrad.ekfac module

class plugins.natgrad.ekfac.EKFAC(net, eps, sua=False, ra=False, update_freq=1, alpha=0.75)

Bases: Optimizer

step(update_stats=True, update_params=True)

Performs one step of preconditioning.

plugins.natgrad.ekfac.grad_wrt_kernel(a, g, padding, stride, target_size=None)

plugins.natgrad.kfac module

class plugins.natgrad.kfac.KFAC(net, eps, sua=False, pi=False, update_freq=1, alpha=1.0, constraint_norm=False)

Bases: Optimizer

step(update_stats=True, update_params=True)

Performs one step of preconditioning.

Module contents