add iterator over tokens in Tokenizer#2184

askalt wants to merge 1 commit intoapache:mainapache/datafusion-sqlparser-rs:mainfrom

askalt:askalt/tokenizer-iteratoraskalt/datafusion-sqlparser-rs:askalt/tokenizer-iteratorCopy head branch name to clipboard