Skip to content

Enabled Language detection with FastText

Luka Jovanovic requested to merge language-apriori into development

This patch makes the following features possible:

  • Language detection can now be inserted in the beginning of the pipeline (it loads a 125 mb large model)
  • First tests of the language Detection

The patch makes the following changes:

  • Exclusion of all spacy pipeline parts that are not relevant for spacy fastlang (in span specific language detection)
  • addition of fasttext in requirements.txt

Merge request reports