tokenizer.AST : dylan.NET.Tokenizer.AST.Tokens Namespace

Token Class

This is the Token class which is the basis for all of the dylan.NET AST.

Syntax

public class Token

Remarks

All Tokens must directly or indirectly inherit from this class.

Requirements

Namespace: dylan.NET.Tokenizer.AST.Tokens
Assembly: tokenizer.AST (in tokenizer.AST.dll)
Assembly Versions: 11.2.7.2, 11.2.7.3, 11.2.7.4

Members

See Also: Inherited members from object.

Public Constructors

Token ()
Constructs a Token.
Constructs a Token given its Value.

Public Fields

Line int . The Line where this Token was found.
Value string . The textual value of the Token.

Member Details

Token Constructor

Constructs a Token.

Syntax

public Token ()

Remarks

To just initialise a new Token with a particular value use the other construuctor.

Requirements

Namespace: dylan.NET.Tokenizer.AST.Tokens
Assembly: tokenizer.AST (in tokenizer.AST.dll)
Assembly Versions: 11.2.7.2, 11.2.7.3, 11.2.7.4

Token Constructor

Constructs a Token given its Value.

Syntax

public Token (string value)

Parameters

value
The textual value of the Token to initialise.

Remarks

If the Value is not known at construct time please use the above cosntructor and set the Value field manually.

Requirements

Namespace: dylan.NET.Tokenizer.AST.Tokens
Assembly: tokenizer.AST (in tokenizer.AST.dll)
Assembly Versions: 11.2.7.2, 11.2.7.3, 11.2.7.4

Line Field

The Line where this Token was found.

Syntax

public int Line

Remarks

This is important for debug info emission.

Requirements

Namespace: dylan.NET.Tokenizer.AST.Tokens
Assembly: tokenizer.AST (in tokenizer.AST.dll)
Assembly Versions: 11.2.7.2, 11.2.7.3, 11.2.7.4

Value Field

The textual value of the Token.

Syntax

public string Value

Remarks

From this the Parser module can further optimize the Token into other subclasses.

Requirements

Namespace: dylan.NET.Tokenizer.AST.Tokens
Assembly: tokenizer.AST (in tokenizer.AST.dll)
Assembly Versions: 11.2.7.2, 11.2.7.3, 11.2.7.4