alibaba/MNN · GitHub
MNN is a blazing fast, lightweight deep learning framework, battle-tested by business-critical use cases in Alibaba. Full multimodal LLM Android App:[MNN-LLM-Android](./apps/Android/MnnLlmChat/READ...
AMD-AIG-AIMA/Instella: Fully Open Language Models with Stellar Performance
Fully Open Language Models with Stellar Performance - AMD-AIG-AIMA/Instella
microsoft/semantic-kernel: Integrate cutting-edge LLM technology quickly and easily into your apps
Integrate cutting-edge LLM technology quickly and easily into your apps - microsoft/semantic-kernel
BentoML: Build, Ship, Scale AI Applications
Source-code: https://github.com/bentoml/OpenLLM
Memori – The memory fabric for enterprise AI
Memori keeps context alive, helping your AI applications deliver smarter, faster answers without wasting tokens.
OpenRouter
The unified interface for LLMs. Find the best models & prices for your prompts
sgl-project/sglang: SGLang is a fast serving framework for large language models and vision language models.
SGLang is a fast serving framework for large language models and vision language models. - sgl-project/sglang
vllm-project/vllm: A high-throughput and memory-efficient inference and serving engine for LLMs
A high-throughput and memory-efficient inference and serving engine for LLMs - vllm-project/vllm