NeuralScope
GLOBAL LEARNING FLOW
전체 학습 경로17 Self Attention · 셀프 어텐션
전체 학습률
81%
AI FOUNDATION0104
NEURAL BASICS0509
LEARNING1014
TRANSFORMER & LLM1518
MODERN AI1921
STEP 14 · TRANSFORMER

Self Attention

각 Token이 다른 Token을 얼마나 참고하는가

PLANNED
SELF ATTENTION VISUAL PREVIEWSCHEMATIC
The
capital
of
Korea
is
Attention Strength