Keine Beschreibung

Eric Wang df2a5dc4be cleanup notebooks		vor 3 Jahren
.gitignore	26f64780ad initial commit	vor 3 Jahren
DATA_LICENSE	63121244c8 Licenses and whatnot	vor 3 Jahren
LICENSE	63121244c8 Licenses and whatnot	vor 3 Jahren
README.md	357ec81a17 decapoda	vor 3 Jahren
alpaca_data.json	26f64780ad initial commit	vor 3 Jahren
conversion.py	26f64780ad initial commit	vor 3 Jahren
finetune.py	df2a5dc4be cleanup notebooks	vor 3 Jahren
generate.py	357ec81a17 decapoda	vor 3 Jahren
lengths.ipynb	26f64780ad initial commit	vor 3 Jahren
loss.ipynb	357ec81a17 decapoda	vor 3 Jahren

alpaca-lora (WIP)

This repository contains code for reproducing the Stanford Alpaca results. Users will need to be ready to fork transformers.

Setup

Install dependencies (install zphang's transformers fork)

pip install -q datasets accelerate loralib sentencepiece

pip install -q git+https://github.com/zphang/transformers@llama_push
pip install -q git+https://github.com/huggingface/peft.git

Install bitsandbytes from source

Inference

See generate.py.

Training

Under construction.

README.md

alpaca-lora (WIP)

Setup

Inference

Training