Rob Pike
a82465103f
use the new routine regexp.MustCompile to clean up some code that uses global regexps.
...
R=rsc, gri
CC=go-dev
http://go/go-review/1016025
2009-11-02 11:37:52 -08:00
Rob Pike
d80a177a9e
make ToUpper, ToLower etc. handle unicode properly.
...
Change their names too.
R=rsc
DELTA=206 (123 added, 2 deleted, 81 changed)
OCL=34170
CL=34194
2009-09-01 11:06:28 -07:00
Rob Pike
fe3838489f
submitter's regret. rename Props to Properties
...
R=rsc
DELTA=9 (0 added, 0 deleted, 9 changed)
OCL=34148
CL=34151
2009-08-31 16:48:56 -07:00
Rob Pike
1e55e4a3e6
add property tables
...
R=rsc
DELTA=1087 (1001 added, 78 deleted, 8 changed)
OCL=34137
CL=34147
2009-08-31 16:43:17 -07:00
Rob Pike
427a0adb39
further simplification of the case fold calculation.
...
hard to beat at this point, i think.
R=rsc
DELTA=38 (8 added, 21 deleted, 9 changed)
OCL=34092
CL=34096
2009-08-30 18:17:52 -07:00
Rob Pike
3c098e2789
add the Upper/Lower sequence optimization.
...
tables shrink 900 lines.
mapping code gets a little slower
R=rsc
DELTA=1124 (105 added, 952 deleted, 67 changed)
OCL=34079
CL=34089
2009-08-30 14:02:42 -07:00
Rob Pike
22c2b476a8
first cut at case mapping tables and library.
...
next cut will do the optimization for alternating sequences.
R=rsc
DELTA=1658 (1620 added, 9 deleted, 29 changed)
OCL=34072
CL=34075
2009-08-28 23:05:16 -07:00
Rob Pike
f59ae064ba
fix ", First" ", Last" ranges from UnicodeData.txt
...
R=rsc
DELTA=54 (38 added, 2 deleted, 14 changed)
OCL=34032
CL=34040
2009-08-28 11:57:38 -07:00
Rob Pike
25caf18a8e
improve generated code for godocability
...
R=rsc
DELTA=459 (168 added, 279 deleted, 12 changed)
OCL=34005
CL=34007
2009-08-27 18:38:02 -07:00
Rob Pike
8b6274eb9f
add scripts tables to the unicode package
...
R=rsc
DELTA=1479 (1422 added, 1 deleted, 56 changed)
OCL=33993
CL=33997
2009-08-27 17:04:23 -07:00
Russ Cox
4b409289f6
remove Line in bufio.ReadLine(Bytes|Slice|String)
...
also drop bool arg from ReadString
R=r
DELTA=45 (13 added, 1 deleted, 31 changed)
OCL=33923
CL=33960
2009-08-27 11:20:15 -07:00
Rob Pike
2156961bb7
fix build. changing var to const, which it should be anyway,
...
implicitly works around 6g bug.
R=rsc
OCL=33953
CL=33953
2009-08-27 09:58:43 -07:00
Rob Pike
94e691552f
unicode tables for all categories
...
maketables now has a --test option to verify the data.
R=rsc
DELTA=3087 (1982 added, 1001 deleted, 104 changed)
OCL=33947
CL=33950
2009-08-27 09:14:32 -07:00
Rob Pike
24dfb749c4
change IsDecimalDigit to IsDigit because Decimal is redundant
...
R=rsc
DELTA=792 (398 added, 383 deleted, 11 changed)
OCL=33919
CL=33921
2009-08-26 16:53:07 -07:00
Rob Pike
396b47bbbd
generate the unicode tables directly from web database
...
after this CL, two more to come:
1) add an exhaustive test, probably as a variant of maketables
2) add ToUpper, ToLower, ToTitle and associated tests
R=rsc
DELTA=1578 (1007 added, 559 deleted, 12 changed)
OCL=33902
CL=33907
2009-08-26 16:01:31 -07:00
