Skip to content

Latest commit

 

History

History
24 lines (19 loc) · 905 Bytes

CHANGELOG.md

File metadata and controls

24 lines (19 loc) · 905 Bytes
Raw

Changelog

All notable changes to fairseq2 are documented in this file.

The format is based on Keep a Changelog.

[0.2.1] - TBD

  • Introduced kv_dim option to StandardMultiheadAttention (for different sizes of encoder and decoder)
  • Added the CheckpointManager.get_model_checkpoint_path method
  • Added the target_twoway mode in the NLLB tokenizer for formatting target sequences in NLLB or SONAR-like models

[0.2.0] - 2023-11-29

  • Introduced LLaMA and LLaMA 2
  • Introduced Mistral 7B
  • Introduced LoRA fine-tuning
  • Revised the sequence generator API
  • Introduced support for lazy padding and attention masks
  • Many smaller improvements to existing APIs

[0.1.1] - 2023-09-07

  • Improvements to the build system and CI pipelines
  • Improvements to the installation instructions and contribution guidelines

[0.1.0] - 2023-08-23

  • Initial release