lyogavin/airllm: AirLLM 70B inference with single 4GB GPU · GitHub
AirLLM 70B inference with single 4GB GPU
Llama.cpp - Run LLM Inference in C/C++
Source-code: https://github.com/ggml-org/llama.cpp
alibaba/MNN · GitHub
MNN is a blazing fast, lightweight deep learning framework, battle-tested by business-critical use cases in Alibaba. Full multimodal LLM Android App:[MNN-LLM-Android](./apps/Android/MnnLlmChat/READ...
microsoft/semantic-kernel: Integrate cutting-edge LLM technology quickly and easily into your apps
Integrate cutting-edge LLM technology quickly and easily into your apps - microsoft/semantic-kernel