multihead_attention.hpp File Reference
Include dependency graph for multihead_attention.hpp:
This graph shows which files directly or indirectly include this file:

Go to the source code of this file.


class  MultiheadAttention< InputDataType, OutputDataType, RegularizerType >
 Multihead Attention allows the model to jointly attend to information from different representation subspaces at different positions. More...



Linear algebra utility functions, generally performed on matrices or vectors.
Artificial Neural Network.

Detailed Description

Mrityunjay Tripathi

Definition of the MultiheadAttention class.

author = {Ashish Vaswani, Llion Jones, Noam Shazeer, Niki Parmar,
Aidan N. Gomez, Jakob Uszkoreit, Ɓukasz Kaiser,
Illia Polosukhin},
title = {Attention Is All You Need},
year = {2017},
url = {}

mlpack is free software; you may redistribute it and/or modify it under the terms of the 3-clause BSD license. You should have received a copy of the 3-clause BSD license along with mlpack. If not, see for more information.

Definition in file multihead_attention.hpp.