furyhawk/ik_llama.cpp
1
0
Fork 0
mirror of https://github.com/ikawrakow/ik_llama.cpp.git synced 2026-07-21 02:05:35 +00:00
Code Issues Packages Projects Releases Wiki Activity
4,735 Commits 952 Branches 1 Tag
main
Commit Graph
15 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Marian M.andGitHub 5d766f536a Update docker (#2123) 
* llama-swap latest version

- Sample config still works

* llama-swap latest version ik_llama-cuda.Containerfile

- Sample config still works

* Update README.md

- The prebuilt docker images are fully working, move their instructions to the front
 2026-07-13 13:27:47 +03:00
Marian M.andGitHub 70ea15226f Update docs (#2104) 
* Update README.md

- models
- dsa
- tensor reload

* Update parameters.md

- typos
- recent parameters, dsa and dflash
- env var and build argument
 2026-07-10 09:27:44 +03:00
Marian M.andGitHub 5fb707d19b Update docs (#1956) 
* Update README.md

Models, MTP, fit

* Update parameters.md

Disclaimer, terms, new flags, graph split list.
 2026-06-12 08:24:22 +02:00
Marian M.andGitHub b2e7f7f6cd Update docs (#1800) 
* Update README.md

- New model
- New features

* Update parameters.md

- Recent new parameters
 2026-05-14 08:44:58 +03:00
Marian M.andGitHub 0f10567aac Update docker readme and local build (#1710) 
* Update docker README.md

* Update docker-bake.override.hcl

- support cuda manual builds
 2026-04-30 08:16:12 +02:00
mcm007andGitHub 5720a4131a Update docs (#1606) 
* Update parameters.md

- list sm graph architectures
- gpu tips
- build options and parameters

* Update README.md

- Gemma4
 2026-04-10 18:20:28 +02:00
mcm007andGitHub d557d6c098 Update docs (#1574) 
* Update README.md

- Model support
- KV cache improvements

* Update parameters.md

- KV Q4_0 improvements
- wgt, with notice
- mtmd-kq-type
 2026-04-03 08:30:29 +02:00
mcm007andGitHub 028fc79710 Update README.md and parameters docs (#1550) 
* Update parameters.md withe recent changes

* Update README.md with recent changes

- Hadamard for V cache
- AVX-VNNI optimizations
- Auto-fit
 2026-03-29 18:52:08 +02:00
mcm007andGitHub bbc07002f7 Update docker and it's configs (#1497) 
* Update ik_llama-cuda.Containerfile

- DGGML_NATIVE=ON, as most users are building images locally

- Latest llama-swap version

* Update ik_llama-cpu.Containerfile

- DGGML_NATIVE=ON, as most users are building images locally

- Latest llama-swap version

* Update README.md

- DGGML_NATIVE=ON is now default

* Update ik_llama-cuda-swap.config.yaml

- Adapt to the latest version

* Update ik_llama-cpu-swap.config.yaml

- Adapt to the latest version

* Update ik_llama-cuda-swap.config.yaml

- Add model with aliases

* Update ik_llama-cpu-swap.config.yaml

- Add model with aliases
 2026-03-24 07:52:54 +01:00
mcm007andGitHub bfef07d10b Update README.md and parameters.md with recent improvements (#1423) 
* Improve text formatting

* Update README.md with recent models and features

* Update parameters.md with recent additions

* Remove deprecated from parameters.md
 2026-03-14 18:14:20 +01:00
mcm007andGitHub a6a1da9a28 Fix Issue 1382 (#1424) 
* Use cuda 86 instead of default

"default" fails to build

* Update docker README.md

- Use 86 architecture
- Examples for mix of architectures
- Where to identify Cuda version
- Hint to clean unused images
- How to build without llama-swap
 2026-03-14 12:27:29 +01:00
mcm007andGitHub b2cb4512c5 Create parameters overview (#1269) 
* raw parameters.md

* fix small typos in common.cpp

* Update build args in parameters.md

* Update parameters.md

- format as table
- sections

* Update README.md

- quickstart
- build and run

* Update parameters.md

other tools examples

* add PR links

* multiple updates to parameters.md

- description
- add jargon section
- add suggestions from feedbacks

* don't imply that only linux is supported in README.md

* add alias to parameters.md

* Update README.md with recent models and features

* Update parameters.md with latest features

* address suggestions

- no-ooae
- placeholder for common commands
- no-kv-offload
- llama-sweep-bench
- placeholder for unique parameters

* specify Linux distro in README.md
 2026-02-20 07:20:56 +01:00
mcm007andGitHub f5fe33b7a9 Update README.md (#1263) 
* Update README.md

Add new models and few of the features, quants and improvements

* Update README.md

ministral3 and split mode "graph"
 2026-02-14 09:02:33 +01:00
mcm007andGitHub f80505911d Improve README.md (#1260) 2026-02-14 09:01:52 +01:00
mcm007andGitHub dbcbfdb0ef Ik llama swap in container step by step guide (#1249) 
* Create README.md

* Add container files and llama-swap configs

* Update main README.md

* Build without GGML_IQK_FA_ALL_QUANTS

Otherwise fails with CUDA_DOCKER_ARCH=default

* Mention GGML_IQK_FA_ALL_QUANTS usage

* First step more explicit
 2026-02-07 18:30:19 +02:00