Embedding

Embedding converts discrete tokens or words into dense, continuous vector representations in a high-dimensional space, capturing semantic and syntactic relationships. These vectors enable models to perform mathematical operations on language, forming the basis for downstream processing.