Abstract: In this paper, energy saving based on transformers with LeakyReLU attention mechanisms is discussed. Softmax functions in attention mechanisms of transformers are replaced by LeakyReLU ...
Some results have been hidden because they may be inaccessible to you
Show inaccessible results