Skip to content

References

References

Activation Function GLU

Implements the Gated Linear Unit (GLU) activation function

Paper: Language Modeling with Gated Convolutional Networks

BSConv

BSConv1d implements the BSConv concept

Paper: Rethinking Depthwise Separable Convolutions: How Intra-Kernel Correlations Lead to Improved MobileNets

Conv1d

Implements Depthwise 1D convolution. This module will apply a spatial convolution over inputs independently over each input channel in the style of depthwise convolutions.

Conv1dGLU

It's based on the Deep Voice 3 project

Paper: Deep Voice 3: Scaling Text-to-Speech with Convolutional Sequence Learning

  • ConvTransposed - ConvTransposed applies a 1D convolution operation, with the main difference that it transposes the last two dimensions of the input tensor before and after applying the BSConv1d convolution operation.

CoordConv1d

Paper: An Intriguing Failing of Convolutional Neural Networks and the CoordConv Solution