Skip to content

v1.8.0

Latest

Choose a tag to compare

@wesselb wesselb released this 17 Oct 16:25
· 3 commits to main since this release
fac03c7
  • Fix attention batching issue (thanks @leonardledy!).
  • Add support for XPU devices (thanks @rwood-97!).
  • Check model checkpoint hashes (thanks @isaaccorley!).
  • Remove unused modulation heads in the decoder (thanks @leonardledy!)
  • Make activation checkpointing configurable.
  • Remove bf16_mode due to severe numerical issues and bring back autocast.
  • Fix dropout bug.