University of Michigan - Ann Arbor

In a Pygments lexer, distinct subsets of lexical terms—such as core keywords, alphabetic operators, extra keywords, constructors, and block delimiters—can be categorized into separate multiline strings and then combined into a single master keyword list:

```python
keywords += operators + extra_keywords + constructors + block_open + block_close
keywords = keywords.split()
```

Invoking `.split()` converts the concatenated strings into a unified list of words, which can then be compiled into regex patterns or matched using Pygments' token classification rules.

Learn Before

Related