Token graphs | Elastic Docs
When a tokenizer converts a text into a stream of tokens, it also records the following: The position of each token in the stream, The positionLength,...