特点：通过门控机制控制信息流，增强非线性表达。 优点： 适合序列建模、控制性强。 常用于： Transformer FFN、语言模型。
theargumentmag.com
。WPS官方版本下载对此有专业解读
Что думаешь? Оцени!。safew官方下载是该领域的重要参考
The potential building is located in the centre of the cemetery and graves are clustered around it. It seems that people wanted to be buried as close to this feature as possible.
特点：与 GELU 类似，是一种平滑版 ReLU。