Bump tokenize-rt from 5.0.0 to 5.2.0 (#2129)

* Bump tokenize-rt from 5.0.0 to 5.2.0

Bumps [tokenize-rt](https://github.com/asottile/tokenize-rt) from 5.0.0 to 5.2.0.
- [Commits](https://github.com/asottile/tokenize-rt/compare/v5.0.0...v5.2.0)

---
updated-dependencies:
- dependency-name: tokenize-rt
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

* Update tokenize-rt==5.2.0

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: JonnyWong16 <9099342+JonnyWong16@users.noreply.github.com>

[skip ci]
This commit is contained in:
dependabot[bot] 2023-08-24 12:09:28 -07:00 committed by GitHub
parent 4033114175
commit 371d35433c
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
2 changed files with 5 additions and 2 deletions

View file

@ -18,7 +18,7 @@ if ( # pragma: no branch
callable(getattr(tokenize, '_compile', None))
): # pragma: <3.10 cover
from functools import lru_cache
tokenize._compile = lru_cache()(tokenize._compile)
tokenize._compile = lru_cache(tokenize._compile)
ESCAPED_NL = 'ESCAPED_NL'
UNIMPORTANT_WS = 'UNIMPORTANT_WS'
@ -40,6 +40,9 @@ class Token(NamedTuple):
def offset(self) -> Offset:
return Offset(self.line, self.utf8_byte_offset)
def matches(self, *, name: str, src: str) -> bool:
return self.name == name and self.src == src
_string_re = re.compile('^([^\'"]*)(.*)$', re.DOTALL)
_escaped_nl_re = re.compile(r'\\(\n|\r\n|\r)')