qbit/go
1
0
Fork 0
mirror of https://github.com/golang/go synced 2024-11-22 02:44:39 -07:00
Code Releases Activity

Clarify section on tokens.

Browse Source 
Fixes #457.

R=r
CC=golang-dev
https://golang.org/cl/181083
This commit is contained in:
Robert Griesemer 2009-12-28 14:40:42 -08:00
parent 33311a7945
commit eb109a765d
1 changed files with 4 additions and 3 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

7
doc/go_spec.html
View File

@ -151,12 +151,13 @@ Comments do not nest.
<p> <p>
Tokens form the vocabulary of the Go language. Tokens form the vocabulary of the Go language.
There are four classes: identifiers, keywords, operators There are four classes: <i>identifiers</i>, <i>keywords</i>, <i>operators
and delimiters, and literals. <i>White space</i>, formed from and delimiters</i>, and <i>literals</i>. <i>White space</i>, formed from
spaces (U+0020), horizontal tabs (U+0009), spaces (U+0020), horizontal tabs (U+0009),
carriage returns (U+000D), and newlines (U+000A), carriage returns (U+000D), and newlines (U+000A),
is ignored except as it separates tokens is ignored except as it separates tokens
that would otherwise combine into a single token. that would otherwise combine into a single token. Also, a newline
may trigger the insertion of a <a href="#Semicolons">semicolon</a>.
While breaking the input into tokens, While breaking the input into tokens,
the next token is the longest sequence of characters that form a the next token is the longest sequence of characters that form a
valid token. valid token.