-
Notifications
You must be signed in to change notification settings - Fork 78
Issues
is:issue state:open
is:issue state:open
Issue creation is restricted in this repository
Search results
[Question]: How do you manage MInference's budget within SCBench?
questionFurther information is requestedFurther information is requestedStatus: Open.#212 In microsoft/MInference;- Status: Open.#211 In microsoft/MInference;
- Status: Open.#210 In microsoft/MInference;
[Bug]: AttributeError: 'DynamicCacheWithRepeat' object has no attribute 'key_cache'
bugSomething isn't workingSomething isn't workingStatus: Open.#207 In microsoft/MInference;[Question]: Scbench, mulit turn, input=last turn true answers + now turn prompt, but cache is only the 1st turn prompt?????
questionFurther information is requestedFurther information is requestedStatus: Open.#202 In microsoft/MInference;[Question]: Feasibility of evaluating complex KV compression methods via single-turn or batch-input modes
questionFurther information is requestedFurther information is requestedStatus: Open.#200 In microsoft/MInference;[Question]: Out of memory for MInference in e2e benchmark test & NIAH with long context_window
questionFurther information is requestedFurther information is requestedStatus: Open.#199 In microsoft/MInference;[Question]: Broken link in
Leank: booksum.jsonl.zst dataset URL is inaccessiblequestionFurther information is requestedFurther information is requestedStatus: Open.#197 In microsoft/MInference;[Bug]: _triton_mixed_sparse_attention in pit_sparse_flash_attention_v2.py doesn't work with triton 3.2.0
bugSomething isn't workingSomething isn't workingStatus: Open.#196 In microsoft/MInference;[Bug]: Can't run run_infinitebench.py
bugSomething isn't workingSomething isn't workingStatus: Open.#195 In microsoft/MInference;[Question]: can TriMix be used in large models, such as deepseek, qwen3-235b?
questionFurther information is requestedFurther information is requestedStatus: Open.#194 In microsoft/MInference;[Bug]: Unrecognized configuration class when running TriMix example code on Qwen-2.5-VL model
bugSomething isn't workingSomething isn't workingStatus: Open.#191 In microsoft/MInference;