Embeddings

An embedding is a mapping from discrete objects, such as words, to vectors of real numbers. For example, a 300-dimensional embedding for English words could include: blue: (0.01359, 0.00075997, 0.24608, …, -0.2524, 1.0048, 0.06259) blues: (0.01396, 0.11887, -0.48963, …, 0.033483, -0.10007, 0.1158) orange: (-0.24776, -0.12359, 0.20986, …, 0.079717, 0.23865, -0.014213) oranges: (-0.35609, 0.21854, 0.080944, …,…