Not identifying keywords with hyphens or numbers

[mbach138]

The extract keyword method is not identifying terms with hyphens or numbers. For example the terms COVID-19 and SARS-CoV-2 are ignored when processing.

The abstract for the paper "Mechanisms of SARS-CoV-2 Transmission and Pathogenesis" (https://pubmed.ncbi.nlm.nih.gov/33132005/) provides a good test to try.

With the default processing this yields
severe acute respiratory 0.0113
acute respiratory syndrome 0.0113
respiratory syndrome coronavirus 0.0356
human population 0.0374
emergence of severe 0.0486
severe acute 0.0486
acute respiratory 0.0486
respiratory syndrome 0.0486
highly pathogenic coronavirus 0.0647
highly pathogenic 0.0819
Pathogenesis 0.1135
syndrome coronavirus 0.1433
pathogenic coronavirus 0.1433
tissue tropism 0.1460
Mechanisms 0.1677
marks 0.1677
population 0.1677
highly 0.1760
Transmission 0.1773
coronavirus 0.1942

[rncampos]

Thanks for your interest in playing with yake!
Also thanks for your contribution in pointing out this. Actually, we have a tagsToDiscard parameter on the DataCore class (datapresentation.py file) which is set to discard "d" (digits or numbers). This is done by default. We should have given this option to the users at first instance upon calling the public method - yake.KeywordExtractor - (but we didn't). We are looking for students interested in improving some limitations of yake. In the meantime, you can fork the code and adapt it for your own purposes.