• Containers
• Convolution Layers
• Pooling layers
• Padding Layers
• Non-linear Activations (weighted sum, nonlinearity)
• Non-linear Activations (other)
• Normalization Layers
• Recurrent Layers
• Transformer Layers
• Linear Layers
• Dropout Layers
• Sparse Layers
• Distance Functions
• Loss Functions
• Vision Layers
• DataParallel Layers (multi-GPU, distributed)
• Utilities
• Quantized Functions