~> App
Version
~> LocalAI
Description
Install (execute in workspace terminal)
wrk install localai==1.21.0Remarks and hints
# Download model
cd /tmp
wget https://gpt4all.io/models/ggml-gpt4all-j.bin -O models/ggml-gpt4all-j
# List models
curl http://localhost:8080/v1/models
# Use
curl http://localhost:8080/v1/completions -H "Content-Type: application/json" -d '{
"model": "ggml-gpt4all-j",
"prompt": "A long time ago in a galaxy far, far away",
"temperature": 0.9
}'
cd /tmp
wget https://gpt4all.io/models/ggml-gpt4all-j.bin -O models/ggml-gpt4all-j
# List models
curl http://localhost:8080/v1/models
# Use
curl http://localhost:8080/v1/completions -H "Content-Type: application/json" -d '{
"model": "ggml-gpt4all-j",
"prompt": "A long time ago in a galaxy far, far away",
"temperature": 0.9
}'
Scripts
# Istall script # Start script!= Workspace compatibility
alnoda-workspace
compatible versions
2.*
!= App compatibility
no compatibility requirements