技术分享·
Transformer(6) - LayerNorm
拿一个四维向量手算 LayerNorm：按哪一维统计，减均值、除标准差各在做什么，γ 和 β 怎么用，以及它在 Transformer 里的位置。
Loading...
Xi'an → Beijing → Hangzhou
Ren Hanquan
Senior Frontend Engineer — Frontend Performance, Low-Code Platforms, and Gardening
Frontend PerfLow-CodeCore Web VitalsGardening
AboutA developer who
A developer who
grows things.
— code, plants, and everything in between
RH
Senior frontend engineer specializing in large-scale application architecture and full-lifecycle performance optimization. From Xi'an, Shaanxi. Career spans collaborative tools, Web3, and low-code platforms. Avid gardener.
Xi'an → Beijing → Hangzhou
B.Eng. Software Engineering
Frontend Architecture & Complexity Management
ML fundamentals — built neural nets from scratch
WritingRecent
Recent
harvest
Thoughts & tutorials from the field