deel.lip.initializers module
- class deel.lip.initializers.SpectralInitializer(eps_spectral=0.001, eps_bjorck=0.001, beta_bjorck=0.5, k_coef_lip=1.0, base_initializer=<keras.initializers.initializers_v2.Orthogonal object>)
Bases:
Initializer
Initialize a kernel to be 1-lipschitz orthogonal using bjorck normalization.
- Parameters
eps_spectral – stopping criterion of iterative power method
eps_bjorck – float greater than 0, stopping criterion of bjorck algorithm, setting it to None disable orthogonalization
beta_bjorck – beta parameter of bjorck algorithm
base_initializer – method used to generate weights before applying the orthonormalization
- get_config()
Returns the configuration of the initializer as a JSON-serializable dict.
- Returns
A JSON-serializable Python dict.