Skip to content

Add micro batching and enpoints for v1 list_models and get_model#41

Merged
baixiac merged 3 commits into
mainfrom
llm-gen2
Mar 13, 2026
Merged

Add micro batching and enpoints for v1 list_models and get_model#41
baixiac merged 3 commits into
mainfrom
llm-gen2

chore: upgrade uv and tidy up the docker folder

184832d
Select commit
Loading
Failed to load commit list.