private
resmixerblock
— function
resmixerblock(planes, npatches; dropout = 0., drop_path_rate = 0., mlp_ratio = 4.0,
activation = gelu, λ = 1e-4)
Creates a block for the ResMixer architecture. (reference).
Arguments
planes
: the number of planes in the blocknpatches
: the number of patches of the inputmlp_ratio
: ratio of the number of hidden channels in the channel mixing MLP to the number of planes in the blockmlp_layer
: the MLP block to usedropout
: the dropout rate to use in the MLP blocksdrop_path_rate
: Stochastic depth rateactivation
: the activation function to use in the MLP blocksλ
: initialisation constant for the LayerScale