Skip to content
@ggml-org

ggml

AI inference at the edge
README.md

Overview

The ggml-org organization on Github develops and supports the ggml machine learning library and related projects.

graph TD;
ggml --> whisper.cpp
ggml --> llama.cpp
llama.cpp --> coding
llama.cpp --> providers

subgraph coding[Coding]
    llama.vim
    llama.vscode
    llama.qtcreator
end

subgraph providers[Providers]
    llama
    LlamaBarn
end

ggml[ggml            
Machine learning library];
whisper.cpp[whisper.cpp     
speech-to-text];
llama.cpp[llama.cpp       
LLM inference];
llama.vim[llama.vim       
Vim/Neovim plugin];
llama.vscode[llama.vscode    
VSCode plugin];
llama.qtcreator[llama.qtcreator 
Qt Creator plugin];
llama[llama           
CLI app];
LlamaBarn[Llama-macOS     
macOS app];
Loading

News

News 2025

Use cases

Chat STT Mobile Infra Cloud Code
LM Studio MacWhisper PocketPal AI RamaLama Hugging Face llama.vim
KoboldCpp VLC media player LLMFarm paddler Google Vertex AI llama.vscode
LocalAI wchess ChatterUI llama-swap VSCode
Jan superwhisper SmolChat Docker Model Runner
text-generation-webui hyprnote LlamaBarn
Handy

Partners

Pinned Loading

  1. ggml ggml Public

    Tensor library for machine learning

    C++ 15.5k 1.9k

  2. llama.cpp llama.cpp Public

    LLM inference in C/C++

    C++ 131k 24.2k

  3. llama.vim llama.vim Public

    Vim plugin for LLM-assisted code/text completion

    Vim Script 2.2k 126

  4. llama.vscode llama.vscode Public

    VS Code extension for LLM-assisted code/text completion

    TypeScript 1.5k 156

  5. llama.qtcreator llama.qtcreator Public

    Forked from cristianadam/llama.qtcreator

    Local LLM-assisted text completion for Qt Creator.

    C++ 68 11

Repositories

Showing 10 of 26 repositories
View all repositories