mirror/cpython
1
0
Fork 0
mirror of https://github.com/python/cpython.git synced 2026-01-27 05:05:50 +00:00
Code Issues Packages Projects Releases Wiki Activity

[3.13] gh-140576: Fixed crash produced by lexer in case of dedented zero byte (GH-140583) (#140762)

Browse Source
This commit is contained in:
Mikhail Efimov 2025-10-29 17:33:55 +03:00 committed by GitHub
parent 62a3b6b0d9
commit 08cacb2a14
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
3 changed files with 6 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

1
Lib/test/test_tokenize.py
View File

@ -3097,6 +3097,7 @@ async def f():
f'__{
x:d
}__'""",
" a\n\x00",
]:
with self.subTest(case=case):
self.assertRaises(tokenize.TokenError, get_tokens, case)

2
Misc/NEWS.d/next/Core and Builtins/2025-10-25-17-36-46.gh-issue-140576.kj0SCY.rst Normal file
View File

@ -0,0 +1,2 @@
Fixed crash in :func:`tokenize.generate_tokens` in case of
specific incorrect input. Patch by Mikhail Efimov.

3
Parser/lexer/lexer.c
View File

@ -481,6 +481,9 @@ tok_get_normal_mode(struct tok_state *tok, tokenizer_mode* current_tok, struct t
return MAKE_TOKEN(ERRORTOKEN);
}
}
else if (c == EOF && PyErr_Occurred()) {
return MAKE_TOKEN(ERRORTOKEN);
}
else {
break;
}