~> App

Added by: re@pex
Jul 29, 2023
Version

~> Vicuna.ggml

Description
Quantized ggml version of Vicuna - Open-Source Large Language Model for Chatbots. To be run with llama.cpp
Tags
vicuna.ggml llama.cpp models
Links
Install (execute in workspace terminal)
wrk install vicuna-ggml==7B
Remarks and hints
# Use

vicuna -p "Building a website can be done in 10 simple steps:" -n 512

# Interactive

vicuna --color --interactive-first -r "Me:" -f ./prompts/alpaca.txt --ctx_size 2048 -n -1 -ins -b 256 --top_k 10000 --temp 0.2 --repeat_penalty 1.1 -t 7
Scripts
# Istall script # Start script

!= Workspace compatibility

alnoda-workspace

compatible versions

2.*

!= App compatibility

LLaMA.cpp
(app code: llama-cpp)

requires

any version