KawrakowandGitHub 6d30fa2fe6 Fused indexer top_k (CPU only) (#2098) ...

* Indexer topk op - CPU only

We do save memory, but it is somehow much slower than what we have on
main.

* Make it a command line option

2026-07-09 18:04:41 +03:00

..

graphs

Fused indexer top_k (CPU only) (#2098)

2026-07-09 18:04:41 +03:00

CMakeLists.txt

on-demand tensor reload (#1989)

2026-06-22 16:36:34 +02:00

llama-arch.cpp

DFlash: support MiMo-V2.5-Pro draft conversion and runtime (#2048)

2026-06-29 13:26:29 +02:00

llama-arch.h

DFlash: support MiMo-V2.5-Pro draft conversion and runtime (#2048)

2026-06-29 13:26:29 +02:00

llama-build-context.cpp

deepseek2 : GLM-DSA sparse attention (lightning indexer), --dsa off by default (#2045)

2026-07-02 09:36:49 +02:00

llama-build-context.h

GLM-DSA: improve TG performance even more (#2068)

2026-07-06 11:15:54 +02:00

llama-context.h

deepseek2 : GLM-DSA sparse attention (lightning indexer), --dsa off by default (#2045)

2026-07-02 09:36:49 +02:00

llama-cparams.h

Fused indexer top_k (CPU only) (#2098)

2026-07-09 18:04:41 +03:00

llama-delta-net.cpp

MTP: faster recurrent state restore (#1791)

2026-05-13 11:00:24 +03:00

llama-delta-net.h

MTP: faster recurrent state restore (#1791)

2026-05-13 11:00:24 +03:00

llama-dflash.cpp

DFlash: support gpt-oss drafts with attention bias (#2061)

2026-06-30 09:02:18 +02:00

llama-dflash.h

DFlash: use persistent FA-ready K/V cache (#1997)

2026-06-22 16:49:35 +02:00

llama-expert-io.h

Add --defer-experts flag to defer expert mmap residency on Linux (#1634)

2026-04-16 08:54:44 +02:00

llama-grammar.cpp

Bug fixes (#1940)

2026-06-10 07:45:49 +02:00

llama-grammar.h

llama : add token matching support to llama-grammar (#1220)

2026-02-03 07:57:17 +02:00

llama-hparams.cpp

deepseek2 : GLM-DSA sparse attention (lightning indexer), --dsa off by default (#2045)

2026-07-02 09:36:49 +02:00

llama-hparams.h

deepseek2 : GLM-DSA sparse attention (lightning indexer), --dsa off by default (#2045)

2026-07-02 09:36:49 +02:00

llama-impl.h

Split mode graph for dense Gemma4 assistant (#2022)

2026-06-24 18:29:32 +02:00

llama-load-tensors.cpp

deepseek2 : GLM-DSA sparse attention (lightning indexer), --dsa off by default (#2045)

2026-07-02 09:36:49 +02:00

llama-mmap.cpp

Parallelize weight loading for weights targeted at anonymous host ram and also GPU (#2057)

2026-07-07 09:52:19 +02:00

llama-mmap.h

Parallelize weight loading for weights targeted at anonymous host ram and also GPU (#2057)

2026-07-07 09:52:19 +02:00

llama-model-loader.cpp

Remove deprecated Kompute (Vulkan compute) backend (#2097)

2026-07-08 10:01:01 +02:00

llama-model-loader.h

Split mode graph for dense Gemma4 assistant (#2022)

2026-06-24 18:29:32 +02:00

llama-model.cpp

DFlash: support MiMo-V2.5-Pro draft conversion and runtime (#2048)

2026-06-29 13:26:29 +02:00

llama-model.h

on-demand tensor reload (#1989)

2026-06-22 16:36:34 +02:00

llama-quantize.cpp

Merge remote-tracking branch 'origin/main' into feat/dflash-implementation

2026-06-13 17:27:52 -03:00

llama-quantize.h

Allow using -rtr and -muge together (#1444)

2026-03-16 18:26:26 +01:00

llama-reload-info.h

on-demand tensor reload (#1989)

2026-06-22 16:36:34 +02:00

llama-reload.cpp

Split mode graph for dense Gemma4 assistant (#2022)

2026-06-24 18:29:32 +02:00

llama-sampling.cpp

Bug fixes (#1940)

2026-06-10 07:45:49 +02:00

llama-sampling.h

Add adaptive sampling clone and free functions to manage memory (#1851)

2026-05-21 08:11:17 +03:00

llama-spec-features-dflash.cpp

DFlash: use persistent FA-ready K/V cache (#1997)

2026-06-22 16:49:35 +02:00

llama-spec-features-dflash.h

clean redudance in dflash graph and small logics (#1994)

2026-06-19 09:04:54 +02:00

llama-spec-features.cpp

remove duplicated code and unnecesary refactor

2026-06-14 16:02:02 -03:00

llama-spec-features.h

move dflash for it own file

2026-06-02 10:22:13 -03:00

llama-vocab.cpp

model: add Cohere2-MoE North Mini Code support (#1945)

2026-06-10 15:28:27 +02:00

llama-vocab.h

Add Mellum2 architecture support (#1919)

2026-06-04 14:28:02 +02:00

llama.cpp

Fused indexer top_k (CPU only) (#2098)

2026-07-09 18:04:41 +03:00

unicode-data.cpp

Merge mainline llama.cpp (#3)

2024-07-27 07:55:01 +02:00

unicode-data.h

Merge mainline llama.cpp (#3)

2024-07-27 07:55:01 +02:00

unicode-script-data.cpp

Add Unicode allowlist (#1597)

2026-04-10 18:22:57 +02:00

unicode.cpp

Gemma4 tokenizer fixes (#1603)

2026-04-09 15:33:28 +02:00

unicode.h

Add Unicode allowlist (#1597)

2026-04-10 18:22:57 +02:00