HeInitialization Class Reference

This class is used to initialize weight matrix with the He initialization rule given by He et. More...

Public Member Functions
	HeInitialization ()
	Initialize the HeInitialization object. More...
void	Initialize (arma::mat &W, const size_t rows, const size_t cols)
	Initialize the elements of the weight matrix with the He initialization rule. More...
void	Initialize (arma::cube &W, const size_t rows, const size_t cols, const size_t slices)
	Initialize the elements of the specified weight 3rd order tensor with He initialization rule. More...

Detailed Description

This class is used to initialize weight matrix with the He initialization rule given by He et.

al. for neural networks. The He initialization initializes weights of the neural network to better suit the rectified activation units.

For more information, the following paper can be referred to:

@article{Delving2015,
  title   = {Delving Deep into Rectifiers: Surpassing Human-Level Performance
             on ImageNet Classification},
  author  = {Kaiming He and Xiangyu Zhang and Shaoqing Ren and Jian Sun},
  journal = {2015 IEEE International Conference on Computer Vision (ICCV)},
  year    = {2015},
  pages   = {1026-1034}
}

Definition at line 45 of file he_init.hpp.

Constructor & Destructor Documentation

HeInitialization()

HeInitialization ( )

inline

Initialize the HeInitialization object.

Definition at line 51 of file he_init.hpp.

Member Function Documentation

Initialize() [1/2]

void Initialize ( arma::mat &  W, const size_t  rows, const size_t  cols  )

inline

Initialize the elements of the weight matrix with the He initialization rule.

Parameters

W	Weight matrix to initialize.
rows	Number of rows.
cols	Number of columns.

Definition at line 64 of file he_init.hpp.

Referenced by HeInitialization::Initialize().

Initialize() [2/2]

void Initialize ( arma::cube &  W, const size_t  rows, const size_t  cols, const size_t  slices  )

inline

Initialize the elements of the specified weight 3rd order tensor with He initialization rule.

Parameters

W	Weight matrix to initialize.
rows	Number of rows.
cols	Number of columns.
slice	Numbers of slices.

Definition at line 90 of file he_init.hpp.

References HeInitialization::Initialize().

---

The documentation for this class was generated from the following file:

• /home/jenkins-mlpack/mlpack.org/_src/mlpack-3.2.1/src/mlpack/methods/ann/init_rules/he_init.hpp