719 B
719 B
RLTK
An attempt to manually port some of nltk to rust.
from https://www.nltk.org/api/nltk.lm.html:
So as to avoid re-creating the text in memory, both train and vocab are lazy iterators. They are evaluated on demand at training time.
rltk has the same philosophy: everything is done using iterators (on iterators) on string slices.
Currently in it's infancy (but growing):
- rltk::lm::preprocessing::pad_both_ends
- rltk::lm::preprocessing::padded_everygrams
- rltk::util::pad_sequence
- rltk::util::pad_sequence_left
- rltk::util::pad_sequence_right
- rltk::util::ngrams
- rltk::util::bigrams
- rltk::util::trigrams
- rltk::util::everygrams
- rltk::util::flatten
- rltk::metrics::distance::edit_distance