Fix tokenization bug introduced in aac1d76
authorLukáš Jiřiště <jiriste@icpf.cas.cz>
Mon, 26 Aug 2024 10:08:16 +0000 (12:08 +0200)
committerLukáš Jiřiště <jiriste@icpf.cas.cz>
Mon, 26 Aug 2024 11:25:06 +0000 (13:25 +0200)
commit75a808eb49fd78d33e21ea23d16f994b7c976f30
treefb513187e22d0531dd7cc2b0262e134f24f9df24
parent218cdd52ec7567997066abfa665ce5de4d6c7964
Fix tokenization bug introduced in aac1d76

In commit aac1d76 the tokenization was changed to set ASSIGNMENT_WORDs
to WORDs when the ASSIGNMENT_WORD is not in a proper place.
The filter however didn't check whether current token is ASSIGNMENT_WORD
hence other tokens could be changed to WORD also.
src/tokenization.c