KathirvalavakumarSubavathiInitialization Class Reference

This class is used to initialize the weight matrix with the method proposed by T. More...

Public Member Functions

template
<
typename
eT
>
 KathirvalavakumarSubavathiInitialization (const arma::Mat< eT > &data, const double s)
 Initialize the random initialization rule with the given values. More...

 
template
<
typename
eT
>
void Initialize (arma::Mat< eT > &W, const size_t rows, const size_t cols)
 Initialize the elements of the specified weight matrix with the Kathirvalavakumar-Subavathi method. More...

 
template
<
typename
eT
>
void Initialize (arma::Cube< eT > &W, const size_t rows, const size_t cols, const size_t slices)
 Initialize the elements of the specified weight 3rd order tensor with the Kathirvalavakumar-Subavathi method. More...

 

Detailed Description

This class is used to initialize the weight matrix with the method proposed by T.

Kathirvalavakumar and S. Subavathi. The method is based on sensitivity analysis using using cauchy’s inequality. The method is defined by

\begin{eqnarray*} \overline{s} &=& f^{-1}(\overline{t}) \\ \Theta^{1}_{p} &\le& \overline{s} \sqrt{\frac{3}{I \sum_{i = 1}^{I} (x_{ip}^2)}} \\ \Theta^1 &=& min(\Theta_{p}^{1}); p=1,2,..,P \\ -\Theta^{1} \le w_{i}^{1} &\le& \Theta^{1} \end{eqnarray*}

where I is the number of inputs including the bias, p refers the pattern considered in training, f is the transfer function and \={s} is the active region in which the derivative of the activation function is greater than 4% of the maximum derivatives.

Definition at line 60 of file kathirvalavakumar_subavathi_init.hpp.

Constructor & Destructor Documentation

◆ KathirvalavakumarSubavathiInitialization()

KathirvalavakumarSubavathiInitialization ( const arma::Mat< eT > &  data,
const double  s 
)
inline

Initialize the random initialization rule with the given values.

Parameters
dataThe input patterns.
sParameter that defines the active region.

Definition at line 70 of file kathirvalavakumar_subavathi_init.hpp.

Member Function Documentation

◆ Initialize() [1/2]

void Initialize ( arma::Mat< eT > &  W,
const size_t  rows,
const size_t  cols 
)
inline

Initialize the elements of the specified weight matrix with the Kathirvalavakumar-Subavathi method.

Parameters
WWeight matrix to initialize.
rowsNumber of rows.
colsNumber of columns.

Definition at line 85 of file kathirvalavakumar_subavathi_init.hpp.

References RandomInitialization::Initialize().

Referenced by KathirvalavakumarSubavathiInitialization::Initialize().

◆ Initialize() [2/2]

void Initialize ( arma::Cube< eT > &  W,
const size_t  rows,
const size_t  cols,
const size_t  slices 
)
inline

Initialize the elements of the specified weight 3rd order tensor with the Kathirvalavakumar-Subavathi method.

Parameters
WWeight matrix to initialize.
rowsNumber of rows.
colsNumber of columns.

Definition at line 102 of file kathirvalavakumar_subavathi_init.hpp.

References KathirvalavakumarSubavathiInitialization::Initialize().


The documentation for this class was generated from the following file: