Skip to content

v1.1.9 MASK tokens & bugfixes

Compare
Choose a tag to compare
@Natooz Natooz released this 16 Feb 09:08
· 429 commits to main since this release

Changes

  • d2a3404 22c15f2 When tokenizing, files not found can now be logged
  • 1f74e3a MASK tokens now available, use your_tokenizer.vocab.add_mask() to add in in your vocabulary.
  • 1f74e3a fix to a possible bug when using custom vocabulary indexes, then non custom. Now checking indexes before registering tokens.
  • 2f87765 merge_tracks() now also merges sustain pedal, control change and pitch bend messages with the effects arg, and now handles List[Instrument] as well as MidiFile objects.
  • 2e77eec MIDI-Like token_types_errors() now looks for Note-Off for each Note-On tokens.

Compatibility

All good !