- Updated .gitignore to include new model directories.
- Removed version specification from existing docker-compose.yml for llama-cpp-server.
- Created new docker-compose.yml for ai_stack/llamacpp.server with GPU support and environment configurations.
- Added Gemma4_(E2B)_Vision.ipynb notebook for data preparation, training, and inference of the Gemma 4 model.
This script allows users to easily enable or disable NVIDIA persistence mode and adjust the performance state of the GPU. It includes options to set the clock speeds and reload the NVIDIA Unified Memory kernel module. Usage instructions are provided for clarity.
- Introduced a new Jupyter notebook `unsloth_nb.ipynb` for utilizing the Unsloth library.
- Implemented code to load and patch FastLanguageModel and FastQwen2Model for improved training speed.
- Configured models to support 4-bit quantization for reduced memory usage.
- Included detailed logging for model loading and system specifications.
* 🔧 Add first Copier config
* 🔧 Add custom copier answers file
* 🔨 Add Copier script to update .env after generating/copying
* 🙈 Update .gitignores from Copier updates
* 🔧 Update .env, restructure in order of relevance
* 🔧 Remove Copier config for SMTP port, if necessary, it can be overwritten in .env
* ♻️ Refactor Copier files, make them less visible
* 🔧 Update Copier config
* 🔥 Remove Cookiecutter files
* 🔧 Update scripts and configs
* 🔧 Add shebang to script
* 🔥 Remove test and dev configs, pass inline
* ✨ Add local development dev-link set up
* 📝 Update generated docs with refactor
* 📝 Add Contributing guide
furyhawk
