HeInitialization Class Reference

This class is used to initialize weight matrix with the He initialization rule given by He et. More...

Public Member Functions

 HeInitialization ()
 Initialize the HeInitialization object. More...

 
void Initialize (arma::mat &W, const size_t rows, const size_t cols)
 Initialize the elements of the weight matrix with the He initialization rule. More...

 
void Initialize (arma::cube &W, const size_t rows, const size_t cols, const size_t slices)
 Initialize the elements of the specified weight 3rd order tensor with He initialization rule. More...

 

Detailed Description

This class is used to initialize weight matrix with the He initialization rule given by He et.

al. for neural networks. The He initialization initializes weights of the neural network to better suit the rectified activation units.

For more information, the following paper can be referred to:

@article{Delving2015,
title = {Delving Deep into Rectifiers: Surpassing Human-Level Performance
on ImageNet Classification},
author = {Kaiming He and Xiangyu Zhang and Shaoqing Ren and Jian Sun},
journal = {2015 IEEE International Conference on Computer Vision (ICCV)},
year = {2015},
pages = {1026-1034}
}

Definition at line 45 of file he_init.hpp.

Constructor & Destructor Documentation

◆ HeInitialization()

HeInitialization ( )
inline

Initialize the HeInitialization object.

Definition at line 51 of file he_init.hpp.

Member Function Documentation

◆ Initialize() [1/2]

void Initialize ( arma::mat &  W,
const size_t  rows,
const size_t  cols 
)
inline

Initialize the elements of the weight matrix with the He initialization rule.

Parameters
WWeight matrix to initialize.
rowsNumber of rows.
colsNumber of columns.

Definition at line 64 of file he_init.hpp.

Referenced by HeInitialization::Initialize().

◆ Initialize() [2/2]

void Initialize ( arma::cube &  W,
const size_t  rows,
const size_t  cols,
const size_t  slices 
)
inline

Initialize the elements of the specified weight 3rd order tensor with He initialization rule.

Parameters
WWeight matrix to initialize.
rowsNumber of rows.
colsNumber of columns.
sliceNumbers of slices.

Definition at line 90 of file he_init.hpp.

References HeInitialization::Initialize().


The documentation for this class was generated from the following file:
  • /home/jenkins-mlpack/mlpack.org/_src/mlpack-3.2.1/src/mlpack/methods/ann/init_rules/he_init.hpp