Skip to content

Pull requests: kvcache-ai/ktransformers

New pull request New
14 Open 136 Closed
14 Open 136 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

feat:implementation of chat routing for Ollama
#691 opened Feb 26, 2025 by swu-hyk Loading…
Fix RuntimeError on Windows caused by integer overflow in np.prod
#670 opened Feb 25, 2025 by akemimadoka Loading…
1
MUSA: Conditionally remove torch and numpy from dependencies
#654 opened Feb 25, 2025 by yeahdongcn Loading…
2 tasks done
[Hardware] Enable XPU Device on Intel GPU
#651 opened Feb 25, 2025 by liangan1 Loading…
feat: basic api key support
#650 opened Feb 25, 2025 by ceerRep Loading…
Allow temperature and top_p from requests
#644 opened Feb 24, 2025 by wtdcode Loading…
Feat: Clear cache during weight loading to prevent OOM on GPUs with <=8GB VRAM
#626 opened Feb 24, 2025 by cyhasuka Loading…
Fix missing macro definition for KTRANSFORMERS_USE_CUDA and <chrono> includes on MSVC
#622 opened Feb 23, 2025 by akemimadoka Loading…
1
MUSA: Use Monkey Patching to Automatically Convert CUDA Backend to MUSA
#583 opened Feb 21, 2025 by yeahdongcn Loading…
3 tasks done
5
fix: fix SSE formatting
#532 opened Feb 20, 2025 by xv44586 Loading…
@BITcyman
Reword and reformat README for idiomaticity and clarity
#341 opened Feb 15, 2025 by walking-octopus Loading…
2
Update:Solve torch.backends.cuda.sdp_kernel() is deprecated.
#313 opened Feb 15, 2025 by MuWinds Loading…
Add flash_attn as dependency
#284 opened Feb 14, 2025 by wtdcode Loading…
1
[WIP] Port to ROCm/HIP
#178 opened Feb 12, 2025 by fxzjshm Loading…
11
ProTip! What’s not been updated in a month: updated:<2025-01-26.