dmaivelandGitHub 6a909f4ff6 Add --prefetch-experts to stream mmap'd MoE experts into page cache (#2101) ...

* Add --prefetch-experts to stream mmap'd MoE experts into page cache

* Drop fds, fault experts in with MADV_POPULATE_READ instead of pread

* Remove stale note about pread workers

* Move MoE prefetch behind ggml_backend_prefetch_* wrappers

* Cleanup stale comments

* Add --prefetch-experts-threads, drop GGML_MOE_PREFETCH_THREADS env var

2026-07-11 10:43:42 +03:00

..

cmake

Merge mainline llama.cpp (#3)

2024-07-27 07:55:01 +02:00

include

Add --prefetch-experts to stream mmap'd MoE experts into page cache (#2101)

2026-07-11 10:43:42 +03:00

src

Add --prefetch-experts to stream mmap'd MoE experts into page cache (#2101)

2026-07-11 10:43:42 +03:00

.gitignore

Merge mainline llama.cpp (#3)

2024-07-27 07:55:01 +02:00

CMakeLists.txt

Remove deprecated Kompute (Vulkan compute) backend (#2097)

2026-07-08 10:01:01 +02:00