Няма описание

Eric Wang df2a5dc4be cleanup notebooks		преди 3 години
.gitignore	26f64780ad initial commit	преди 3 години
DATA_LICENSE	63121244c8 Licenses and whatnot	преди 3 години
LICENSE	63121244c8 Licenses and whatnot	преди 3 години
README.md	357ec81a17 decapoda	преди 3 години
alpaca_data.json	26f64780ad initial commit	преди 3 години
conversion.py	26f64780ad initial commit	преди 3 години
finetune.py	df2a5dc4be cleanup notebooks	преди 3 години
generate.py	357ec81a17 decapoda	преди 3 години
lengths.ipynb	26f64780ad initial commit	преди 3 години
loss.ipynb	357ec81a17 decapoda	преди 3 години

alpaca-lora (WIP)

This repository contains code for reproducing the Stanford Alpaca results. Users will need to be ready to fork transformers.

Setup

Install dependencies (install zphang's transformers fork)

pip install -q datasets accelerate loralib sentencepiece

pip install -q git+https://github.com/zphang/transformers@llama_push
pip install -q git+https://github.com/huggingface/peft.git

Install bitsandbytes from source

Inference

See generate.py.

Training

Under construction.

README.md

alpaca-lora (WIP)

Setup

Inference

Training