[MERGE] Factor out Perl_yylex() into a bunch of smaller functions

This factors lots of code out of Perl_yylex(), which started at 4166
lines. It's now split into multiple functions; the largest remaining one
is 2159 lines. There's still plenty of work that could be done here, but
I hope this makes it easier to understand the lexer without having to
understand the whole thing simultaneously.
This commit is contained in:
Aaron Crane 2019-10-21 12:11:30 +02:00 committed by Dagfinn Ilmari Mannsåker
commit 5015bd0bb5

4595
toke.c

File diff suppressed because it is too large Load Diff