Alnoda workspaces

Added by: re@pex
Jul 29, 2023

Version

~> OpenLLaMA.ggml

Description

An Open Reproduction of LLaMA model. Quantized to 4 bits to run on CPU with LLaMA.cpp

Install (execute in workspace terminal)

wrk install openllama-ggml==7B

Remarks and hints

# In workspace terminal:

openlama -p "Building a website can be done in 10 simple steps:" -n 512

# Interactive:

openlama --repeat_penalty 1.0 --color --interactive-first -r "Me:" --in-prefix "> " --in-suffix "OpenLLaMA:"

Scripts

# Istall script

cd /home/abc/apps/llama.cpp
wget -P ./models/open_llama_7b_v2_easylm-tmp/ https://huggingface.co/openlm-research/open_llama_7b/resolve/main/config.json 
wget -P ./models/open_llama_7b_v2_easylm-tmp/ https://huggingface.co/openlm-research/open_llama_7b/blob/main/generation_config.json
wget -P ./models/open_llama_7b_v2_easylm-tmp/ https://huggingface.co/openlm-research/open_llama_7b/resolve/main/pytorch_model-00001-of-00002.bin
wget -P ./models/open_llama_7b_v2_easylm-tmp/ https://huggingface.co/openlm-research/open_llama_7b/resolve/main/pytorch_model-00002-of-00002.bin
wget -P ./models/open_llama_7b_v2_easylm-tmp/ https://huggingface.co/openlm-research/open_llama_7b/resolve/main/pytorch_model.bin.index.json
wget -P ./models/open_llama_7b_v2_easylm-tmp/ https://huggingface.co/openlm-research/open_llama_7b/resolve/main/special_tokens_map.json
wget -P ./models/open_llama_7b_v2_easylm-tmp/ https://huggingface.co/openlm-research/open_llama_7b/resolve/main/tokenizer.model
wget -P ./models/open_llama_7b_v2_easylm-tmp/ https://huggingface.co/openlm-research/open_llama_7b/resolve/main/tokenizer_config.json

pipenv run python convert.py ./models/open_llama_7b_v2_easylm-tmp/

mkdir ./models/open_llama_7b_v2_easylm
mv ./models/open_llama_7b_v2_easylm-tmp/ggml-model-f16.bin ./models/open_llama_7b_v2_easylm
rm -rf ./models/open_llama_7b_v2_easylm-tmp/

wrk alias openlama "cd /home/abc/apps/llama.cpp && ./main -m ./models/open_llama_7b_v2_easylm/ggml-model-f16.bin"

# Start script

~> App

~> OpenLLaMA.ggml

Description

Tags

Links

Install (execute in workspace terminal)

Remarks and hints

Scripts

!= Workspace compatibility

alnoda-workspace

!= App compatibility

LLaMA.cpp