qbit/go
1
0
Fork 0
mirror of https://github.com/golang/go synced 2024-10-05 02:21:22 -06:00
Code Releases Activity
4,970 Commits 58 Branches 402 Tags 522 MiB
36ea8bb7bf
Commit Graph

2 Commits

Author SHA1 Message Date
Robert Griesemer
22e960547f scanner: match go/scanner and disallow NUL character; 
also check for illegal UTF-8 sequences

R=rsc
CC=golang-dev
https://golang.org/cl/218061
 2010-02-22 14:21:59 -08:00
Robert Griesemer
abda9e6f89 Light-weight scanner for general use. 
Emphasis on minimal interface and fast scanning.
Recognizes all Go literals by default. Easily
configurable to recognize different whitespace
characters and tokens.

Provides detailed position information for each
token.

R=rsc, r
CC=golang-dev
https://golang.org/cl/181160
 2010-01-12 17:04:45 -08:00