I'm trying to reduce a string down to the following tokens: singlequote, right paren, lparen, integer, whitespace and ID. ID being anything that isn't any of the others. My tokenizer isn't finding IDs.I'm trying to reduce a string down to the follo
I'm trying to reduce a string down to the following tokens: singlequote, right paren, lparen, integer, whitespace and ID. ID being anything that isn't any of the others. My tokenizer isn't finding IDs.I'm trying to reduce a string down to the follo