Introduction

Tutorials

Developer guide

API Reference

private resmixerblockfunction

resmixerblock(planes, npatches; dropout = 0., drop_path_rate = 0., mlp_ratio = 4.0,
              activation = gelu, λ = 1e-4)

Creates a block for the ResMixer architecture. (reference).

Arguments

  • planes: the number of planes in the block
  • npatches: the number of patches of the input
  • mlp_ratio: ratio of the number of hidden channels in the channel mixing MLP to the number of planes in the block
  • mlp_layer: the MLP block to use
  • dropout: the dropout rate to use in the MLP blocks
  • drop_path_rate: Stochastic depth rate
  • activation: the activation function to use in the MLP blocks
  • λ: initialisation constant for the LayerScale