LecunNormalInitialization Class Reference

This class is used to initialize weight matrix with the Lecun Normalization initialization rule. More...

Public Member Functions

 LecunNormalInitialization ()
 Initialize the LecunNormalInitialization object. More...

 
void Initialize (arma::mat &W, const size_t rows, const size_t cols)
 Initialize the elements of the weight matrix with the Lecun Normal initialization rule. More...

 
void Initialize (arma::cube &W, const size_t rows, const size_t cols, const size_t slices)
 Initialize the elements of the specified weight 3rd order tensor with Lecun Normal initialization rule. More...

 

Detailed Description

This class is used to initialize weight matrix with the Lecun Normalization initialization rule.

For more information, the following papers can be referred to:

@inproceedings{Klambauer2017,
itle = {Self-Normalizing Neural Networks.},
author = {Klambauer, G√ľnter and Unterthiner, Thomas
and Mayr, Andreas and Hochreiter, Sepp},
pages = {972-981},
year = {2017}
}
@inproceedings{LeCun1998,
title = {Efficient BackProp},
author = {LeCun, Yann and Bottou, L{\'e}on and Orr, Genevieve B.
and M\"{u}ller, Klaus-Robert},
year = {1998},
pages = {9--50}
}

Definition at line 49 of file lecun_normal_init.hpp.

Constructor & Destructor Documentation

◆ LecunNormalInitialization()

Initialize the LecunNormalInitialization object.

Definition at line 55 of file lecun_normal_init.hpp.

Member Function Documentation

◆ Initialize() [1/2]

void Initialize ( arma::mat &  W,
const size_t  rows,
const size_t  cols 
)
inline

Initialize the elements of the weight matrix with the Lecun Normal initialization rule.

Parameters
WWeight matrix to initialize.
rowsNumber of rows.
colsNumber of columns.

Definition at line 68 of file lecun_normal_init.hpp.

Referenced by LecunNormalInitialization::Initialize().

◆ Initialize() [2/2]

void Initialize ( arma::cube &  W,
const size_t  rows,
const size_t  cols,
const size_t  slices 
)
inline

Initialize the elements of the specified weight 3rd order tensor with Lecun Normal initialization rule.

Parameters
WWeight matrix to initialize.
rowsNumber of rows.
colsNumber of columns.
sliceNumbers of slices.

Definition at line 96 of file lecun_normal_init.hpp.

References LecunNormalInitialization::Initialize().


The documentation for this class was generated from the following file:
  • /home/jenkins-mlpack/mlpack.org/_src/mlpack-3.2.1/src/mlpack/methods/ann/init_rules/lecun_normal_init.hpp