4 Commits
Author SHA1 Message Date
furyhawk 23e798bb7c Refactor model loading script and add Ollama notebook
- Updated the Modelfile path in `pull-deepseek-model.sh` to use an absolute path for model files.
- Simplified the model loading process by removing unnecessary directory changes and directly referencing the mounted Modelfile.
- Added a new Jupyter notebook `ollama.ipynb` that demonstrates the usage of the Ollama API with a sample query and error handling for unsupported tools.
2025-06-16 15:41:55 +08:00
furyhawk 3cfd66a31b fix: Update container commands from Docker to Podman in pull-deepseek-model.sh 2025-06-16 13:17:47 +08:00
furyhawk a8dad3debe fix: Update model file references and enhance Dockerfile for LlamaCPP setup 2025-06-15 08:29:42 +08:00
furyhawk e9dc288cef Add Ollama Docker setup and model management scripts
- Created README.md for Ollama Docker setup with instructions for running and using models.
- Added docker-compose.yml for Ollama service configuration.
- Introduced scripts for model setup, including pulling models from Hugging Face and loading them into Ollama.
- Implemented AI launcher script to choose between Ollama and LlamaCPP backends.
- Added GPU support scripts for LlamaCPP with detailed logging and error handling.
- Included simple model pull script for easier model management.
- Established a structured approach for model management and integration with Ollama API.
2025-06-14 21:31:16 +08:00