Tokenizer

The parser component that turns raw text into atoms via (regex, constructor) pairs — e.g. matching a number and wrapping it as a Grounded atom.

← Back to the Glossary