Parses the next token just like peek_next_token and also removes it from the input stream.
The token data is placed in the token, value, line, and position fields of the
Scanner structure.
| this |
a Scanner |
|
the type of the token |