public LayerScale — function
LayerScale(λ, planes::Integer)
Creates a Flux.Scale layer that performs “LayerScale”
(reference).
Arguments
planes: Size of channel dimension in the input.λ: initialisation value for the learnable diagonal matrix.