JPaulDuncan/SharpInfer

View on GitHub ↗

A pure C# LLM inference engine built from scratch — no Python, no llama.cpp bindings, no ONNX Runtime. SharpInfer loads GGUF and Safetensors models directly, dequantizes weights in managed code, and runs the full transformer forward pass natively on .NET 8.

5 ★2 forksC#Updated 6mo ago

Topics

aiinferenceinference-apiinference-enginemcpmodel-context-protocolopenai
Stars
5★
Forks
2
Language
C#
License
MIT
Created
2026-03-05
Last push
2026-03-06