private resmixerblock — function
resmixerblock(planes, npatches; dropout = 0., drop_path_rate = 0., mlp_ratio = 4.0,
activation = gelu, λ = 1e-4)
Creates a block for the ResMixer architecture. (reference).
Arguments
planes: the number of planes in the blocknpatches: the number of patches of the inputmlp_ratio: ratio of the number of hidden channels in the channel mixing MLP to the number of planes in the blockmlp_layer: the MLP block to usedropout: the dropout rate to use in the MLP blocksdrop_path_rate: Stochastic depth rateactivation: the activation function to use in the MLP blocksλ: initialisation constant for the LayerScale