public
LayerScale
— function
LayerScale(λ, planes::Integer)
Creates a Flux.Scale
layer that performs “LayerScale
”
(reference).
Arguments
planes
: Size of channel dimension in the input.λ
: initialisation value for the learnable diagonal matrix.