Add initial project with simple chat using openchat-3.5-0106.Q4_K_M.gguf model

This commit is contained in:
2025-06-27 08:16:41 +02:00
commit 2aad09df7d
13 changed files with 630 additions and 0 deletions

1
models/README.md Normal file
View File

@@ -0,0 +1 @@
Download model from: https://huggingface.co/TheBloke/openchat-3.5-0106-GGUF/resolve/main/openchat-3.5-0106.Q4_K_M.gguf?download=true