illumos gate

Yuri Pankov reported that some characters, such as れ (Unicode 0x308c) are not handled properly in the terminal, with the fix for 2408 applied. Turns out that every even numbered unicode point between 3080 and 308c is also wrong. (And probably very many others besides!)

Analysis shows that my changes for 2408 had a bug in the yacc grammar, which led certain characters to be stripped from consideration. Its quite amazing, since all of my trial characters were handled properly; perhaps I unknowingly only tested characters on odd lines. (I chose a fairly random sampling, but by no means exhaustive.)

The fix is fortunately very trivial (took a while to figure out though!)

As a bonus, this fix (which I'll post momentarily) shrinks the file size from about 250K per locale to about 94 K, because we get much more use of overlapping ctype data. This should also result in faster lookups for ctype data for extended characters, as well, as the binary search only needs to consider less than half the original data size (so about 1-2 fewer search tries in the binary search, on average.)