Skip to main content
Version: 1.1

Release notes

v1.1.0

  • increase peak performance by more than 40% through improved request scheduling
  • increased performance by about 6% through vLLM upgrade to v0.6.1