REPO //Trendshift
human-agent-society/reef_
Continual learning infra for self-improving agents
★ 2.6K⑂ 186Python
Sep 16, 2026[45]
https://github.com/human-agent-society/reef#inference
7 items tagged “inference” across every source.
REPO //Trendshift
nibor1896/crow_
CROW - Your AI Agent. MCPs, OpenRouter, Any Model or local. It's your choice.
★ 30⑂ 2Python
Sep 16, 2026[100]
https://github.com/nibor1896/crowREPO //Trendshift
vllm-project/vllm_
A high-throughput and memory-efficient inference and serving engine for LLMs
★ 91.4K⑂ 22KPython
Sep 11, 2026[40]
https://github.com/vllm-project/vllmREPO //Trendshift
sgl-project/sglang_
SGLang is a high-performance serving framework for large language models and multimodal models.
★ 35.8K⑂ 8.8KPython
Sep 11, 2026[40]
https://github.com/sgl-project/sglangREPO //Trendshift
liuzl/qwen38-dgx-spark-lab_
Reproducible Qwen3.8-27B serving and native rank-1 LoRA experiments on NVIDIA DGX Spark
★ 2⑂ 0Python
Sep 9, 2026[40]
https://github.com/liuzl/qwen38-dgx-spark-labREPO //Trendshift
enntity/sparkglm_
GLM-5.3-Flash on two DGX Sparks: opinionated vLLM/EXL3 serving, tinyGLM gates, and reproducible inference research.
★ 11⑂ 1Python
Sep 7, 2026[40]
https://github.com/enntity/sparkglmREPO //Trendshift
zhongkaifu/tensorsharp_
A native .NET LLM inference engine for GGUF models. TensorSharp provides a console application, a web-based chatbot interface, and Ollama/OpenAI-compatible HTTP APIs for programmatic access. It supports Windows/MacOS/Linux with full GPU capability
★ 410⑂ 40C#
Sep 5, 2026[40]
https://github.com/zhongkaifu/tensorsharp