[polyml] Apparent bug in String.tokenize

Hi all,

I've been doing some get-out-the-vote work in California's famous democratic election, still scheduled for October 7th. As part of this work I have been using using PolyML to tokenize voter record strings. I thought that we could not only surpass Florida, but even Canada's overnight hand counted vote. However, I am beginning to have my doubts.

To my shock, some tokenizations from repeated token separators dropped fields which I believe should have resulted in empty strings. Are my expectations reasonable, or have I subtly misinterpreted the use of String.tokenize?

Thanks, Byron Hale

Sample input/output follows, with data altered to protect the voter.