Regexes, tokens, rules

In PGE,

• a ''regex'' is a backtrackable pattern

• a ''token'' is a regex that doesn't backtrack by default

• a ''rule'' is a regex that doesn't backtrack but also handles intertoken separators (e.g., whitespace and comments)