Algorithms

It is helpful to know the algorithms, which the TextTransformer uses for text analysis, to develop efficient programs and for better understanding possible errors and conflicts. As explained already in the introduction this analysis is done in two steps:

For the lexical analysis an algorithm to extract the next token by a scanner is needed

For the syntactical analysis an algorithm for the choice of the next branch in the system of rules (grammar) by the parser is needed

This page belongs to the TextTransformer Documentation