nibor1896/crow_
CROW - Your AI Agent. MCPs, OpenRouter, Any Model or local. It's your choice.
4 items tagged “gguf” across every source.
CROW - Your AI Agent. MCPs, OpenRouter, Any Model or local. It's your choice.
A tiered-memory system design for workloads that don't fit in RAM: measure the working set, pin the hot tier, stream the cold tier from flash. Ships the residency calculator, measurement harnesses, and the build recipes behind it. Predictions validated against public benchmarks.
Apple-native self-hosting CLI: OCI containers via Apple's container runtime + Metal-backed llama.cpp serving, with honest unified-memory reporting
A native .NET LLM inference engine for GGUF models. TensorSharp provides a console application, a web-based chatbot interface, and Ollama/OpenAI-compatible HTTP APIs for programmatic access. It supports Windows/MacOS/Linux with full GPU capability