Chapter 3. Grammar and Syntax

Table of Contents
Lexical conventions

Lexical conventions

How the sourcecode is parsed

The sourcecode is scanned for certain tokens that are the atomic units the language is made out of. First of all comments are stripped from the inputdata before any further processing takes place. Whitespace is used to set the single tokens apart. A consecutive sequence of more than whitespace character is equivalent to a single whitespace character. This means that you can add whitespace to your expressions and statements freely and thus keep them in a readable way in your sourcecodes. In summary; all extra whitespace is ignored and treated like a single whitespace.