8 Commits

Author	SHA1	Message	Date
Robert Griesemer	1161d19024	scanner: error handler must be provided to Init ... Init may report an error on the first character and thus one needs an ability to set the error handler for Init. Was a design bug. Added corresponding test cases and better documentation. Also: Fixed a subtle infinite loop exposed by one of the new test cases. Fixes #1380. R=rsc, gri CC=golang-dev https://golang.org/cl/4094041	2011-01-24 14:12:20 -08:00
Kyle Consalus	f8a67d79d1	Fix incorrect reporting of error in Scanner.next() when Read reads > 0 bytes but returns os.EOF. ... R=golang-dev, gri1, gri CC=golang-dev https://golang.org/cl/2083042	2010-09-01 15:15:37 -07:00
Rob Pike	d7736413a6	scanner: change package comment to be clearer about its functionality. ... No semantic changes. R=gri, rsc1 CC=golang-dev https://golang.org/cl/1998045	2010-08-25 13:07:08 +10:00
Robert Griesemer	bc0a1c61f7	scanner: better comment ... R=rsc CC=golang-dev https://golang.org/cl/1900044	2010-07-29 13:02:27 -07:00
Robert Griesemer	0fd00c8bb7	scanner: implement Peek() to look at the next char w/o advancing ... R=rsc CC=golang-dev https://golang.org/cl/840045	2010-04-14 21:33:34 -07:00
Robert Griesemer	f44fa9b4c7	gofmt: experiment: align values in map composites where possible ... - gofmt -w src misc - looking for feedback R=rsc, r CC=golang-dev https://golang.org/cl/223076	2010-03-02 13:46:51 -08:00
Robert Griesemer	22e960547f	scanner: match go/scanner and disallow NUL character; ... also check for illegal UTF-8 sequences R=rsc CC=golang-dev https://golang.org/cl/218061	2010-02-22 14:21:59 -08:00
Robert Griesemer	abda9e6f89	Light-weight scanner for general use. ... Emphasis on minimal interface and fast scanning. Recognizes all Go literals by default. Easily configurable to recognize different whitespace characters and tokens. Provides detailed position information for each token. R=rsc, r CC=golang-dev https://golang.org/cl/181160	2010-01-12 17:04:45 -08:00