Skip to content

Error in tokenize with specific combination of keytokens #5

@jorgecarleitao

Description

@jorgecarleitao

The following test fails:

def test_error(self):
        tokenize('Decretos-Lei n.os 29/2000', {'Decretos-Leis', ' ',
                                               'n.os', 'Decreto', 'Lei',
                                               'Lei Orgânica'})

with an error coming from the C++ code.

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions