- Added a new script `generate-ollama-client-simple.sh` for generating a simple TypeScript client using the existing OpenAPI tools.
- Created a comprehensive `generate-ollama-client.sh` script to generate a FastAPI client from the Ollama OpenAPI specification with support for axios.
- Introduced `generate_fastapi_client.py` to support generating FastAPI clients from OpenAPI specifications in multiple languages, including TypeScript and Python.
- Generated TypeScript types for the Ollama API endpoints in `types.gen.ts`.
- Included example usage files for both Python and TypeScript clients to demonstrate how to interact with the Ollama API.
- Updated the Modelfile path in `pull-deepseek-model.sh` to use an absolute path for model files.
- Simplified the model loading process by removing unnecessary directory changes and directly referencing the mounted Modelfile.
- Added a new Jupyter notebook `ollama.ipynb` that demonstrates the usage of the Ollama API with a sample query and error handling for unsupported tools.
- Created README.md for Ollama Docker setup with instructions for running and using models.
- Added docker-compose.yml for Ollama service configuration.
- Introduced scripts for model setup, including pulling models from Hugging Face and loading them into Ollama.
- Implemented AI launcher script to choose between Ollama and LlamaCPP backends.
- Added GPU support scripts for LlamaCPP with detailed logging and error handling.
- Included simple model pull script for easier model management.
- Established a structured approach for model management and integration with Ollama API.
This script allows users to easily enable or disable NVIDIA persistence mode and adjust the performance state of the GPU. It includes options to set the clock speeds and reload the NVIDIA Unified Memory kernel module. Usage instructions are provided for clarity.
* 🔧 Update scripts and configs
* 🔧 Add shebang to script
* 🔥 Remove test and dev configs, pass inline
* ✨ Add local development dev-link set up
* 📝 Update generated docs with refactor
* 📝 Add Contributing guide
furyhawk
