[MEDIUM] BatchQuantizedKVCache.extend() uses used length not capacity (#109) #119
Loading…
Reference in a new issue
No description provided.
Delete branch "fix/109-batchquant-extend-padding"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Fixes #109
View command line instructions
Checkout
From your project repository, check out a new branch and test the changes.Merge
Merge the changes and update on Forgejo.Warning: The "Autodetect manual merge" setting is not enabled for this repository, you will have to mark this pull request as manually merged afterwards.