$ python3.11 t.py
Traceback (most recent call last):
File "/home/asottile/workspace/switch-microcontroller/t.py", line 4, in <module>
list(tokenize.generate_tokens(io.StringIO('"""').readline))
File "/usr/lib/python3.11/tokenize.py", line 465, in _tokenize
raise TokenError("EOF in multi-line string", strstart)
tokenize.TokenError: ('EOF in multi-line string', (1, 0))
# python3.13 t.py
Traceback (most recent call last):
File "/y/pyupgrade/t.py", line 4, in <module>
list(tokenize.generate_tokens(io.StringIO('"""').readline))
File "/usr/lib/python3.13/tokenize.py", line 526, in _generate_tokens_from_c_tokenizer
for info in it:
File "<string>", line 1
"""
^
SyntaxError: unterminated triple-quoted string literal (detected at line 1)
Bug report
the document exception type for the
tokenize.*functions isTokenError-- however it appears it now raisesSyntaxError: https://docs.python.org/3.12/library/tokenize.html#tokenize.TokenErrorand
Your environment
Linked PRs