All pull requests

Pull requests

• ggml-quants : weighted rounding algorithms with cumulative search

  generation qualityggmlLess than 4 bitsresearch 🔬Review Complexity : MediumTensor Encoding Scheme
  #12557·compilade opened Mar 25, 2025Collaborator·

  ·
  21

• Add support for Phi-3.5-vision-instruct

  examplesReview Complexity : Medium
  #9209·abetlen opened Aug 27, 2024Collaborator·

  ·
  5

• Quantize: specify each major tensor quant in CLI for common LLMs

  demoexamplesReview Complexity : Medium
  #8917·Nexesenex opened Aug 7, 2024Contributor·2 of 4 tasks·

  ·
  13

• lookup: Use tree of sequences instead of single sequence

  examplesReview Complexity : Medium
  #8648·JohannesGaessler opened Jul 23, 2024Contributor·

  ·

• llama : tokenizer unicode codepoint categories

  pythonReview Complexity : Mediumscripttesting
  #8606·jaime-m-p opened Jul 20, 2024Collaborator·2 of 4 tasks·

  ·
  8

• build example/main.cpp as shared library and intercept token printing using FFI

  demoexamplesReview Complexity : Medium
  #8339·mtasic85 opened Jul 6, 2024Contributor·

  ·
  3

• json: $ref + object overhaul (https & recursive $refs, mix properties & allOf)

  breaking changeexamplespythonReview Complexity : Mediumservertesting
  #8199·ochafik opened Jun 28, 2024Collaborator·

  ·
  1

• json: unified properties order across optional & required

  examplespythonReview Complexity : Mediumservertesting
  #8133·ochafik opened Jun 26, 2024Collaborator·1 of 4 tasks·

  ·
  3

• rpc : copy tensors across servers

  Review Complexity : Medium
  #8032·rgerganov opened Jun 20, 2024Member·2 of 4 tasks·

  ·
  11

• WIP: Use DirectStorage with CUDA interop to more efficient load tensors

  buildggmlNvidia GPUReview Complexity : Medium
  #7796·mtavenrath opened Jun 6, 2024Contributor·

  ·
  18

• feat: add changes to handle jina v2 chinese code

  pythonReview Complexity : Medium
  #7795·JoanFM opened Jun 6, 2024Contributor·

  ·
  24

• batched : make n_threads and n_threads_batch configurable in batched & batched-bench

  examplesReview Complexity : Medium
  #7581·msy-kato opened May 28, 2024Contributor·

  ·
  3

• ggml-threading.cpp

  buildggmlReview Complexity : Medium
  #7576·kunnis opened May 27, 2024Contributor·

  ·
  4

• Rebalancing Metal threads workload in dot product kernel kernel_mul_mv_f16_f32_l4

  Apple MetalReview Complexity : Medium
  #7522·izard opened May 24, 2024·

  ·
  14

• Introduce ggml_syncthreads()

  performanceReview Complexity : Medium
  #7455·jart opened May 22, 2024Contributor·

  ·
  4

• Check for llama_get_logits_ith() errors

  androidexamplesReview Complexity : Mediumserver
  #7448·jart opened May 21, 2024Contributor·

  ·
  18

• Direct I/O and Transparent HugePages

  demoexamplespythonReview Complexity : Mediumscriptserver
  #7420·pavelfatin opened May 20, 2024·

  ·
  29

• Add minimal python client example for the server, streaming callback

  examplespythonReview Complexity : Mediumserver
  #7373·chrismrutherford opened May 18, 2024·

  ·
  3

• sched : support async weight copy

  performanceReview Complexity : Medium
  #7315·slaren opened May 15, 2024Member·

  ·
  4

• ggml, ngram-cache, log: added const and const ref for function params

  refactoringReview Complexity : Medium
  #7269·GermanAizek opened May 14, 2024·

  ·
  1

• tokenization: no double BOS tokens

  refactoringReview Complexity : Medium
  #7107·JohannesGaessler opened May 6, 2024Contributor·

  ·
  16

• Script to convert Grok-1 weights from raw JAX pickle files.

  enhancementpythonReview Complexity : Medium
  #7058·heiner opened May 3, 2024·

  ·
  29

• Clamp out of range values in K quantizer

  bugfixmodelReview Complexity : Medium
  #6888·jart opened Apr 25, 2024Contributor·

  ·

• llamafile : improve moe prompt eval speed on cpu

  enhancementggmlReview Complexity : Medium
  #6840·jart opened Apr 23, 2024Contributor·

  ·
  22

• Generic Chat templating code with text/json file based config; main chat updated to drive its in-prefix, in-suffix and reverse-prompt from same; chat-apply-template equivalent c-api to allow use by other codes also

  enhancementReview Complexity : Medium
  #6834·hanishkvc opened Apr 22, 2024Contributor·

  ·
  45