Sākums Izpētīt Palīdzība
Pierakstīties
dongzenan
/
alpaca-lora
1
0
Atdalīts 0
Faili Problēmas 0 Izmaiņu pieprasījumi 0 Vikivietne

Nav apraksta

Koks: df2a5dc4be
Atzari Tagi
alpaca-lora
Eric Wang df2a5dc4be cleanup notebooks 3 gadi atpakaļ
.gitignore 26f64780ad initial commit 3 gadi atpakaļ
DATA_LICENSE 63121244c8 Licenses and whatnot 3 gadi atpakaļ
LICENSE 63121244c8 Licenses and whatnot 3 gadi atpakaļ
README.md 357ec81a17 decapoda 3 gadi atpakaļ
alpaca_data.json 26f64780ad initial commit 3 gadi atpakaļ
conversion.py 26f64780ad initial commit 3 gadi atpakaļ
finetune.py df2a5dc4be cleanup notebooks 3 gadi atpakaļ
generate.py 357ec81a17 decapoda 3 gadi atpakaļ
lengths.ipynb 26f64780ad initial commit 3 gadi atpakaļ
loss.ipynb 357ec81a17 decapoda 3 gadi atpakaļ

README.md

alpaca-lora (WIP)

This repository contains code for reproducing the Stanford Alpaca results. Users will need to be ready to fork transformers.

Setup

  1. Install dependencies (install zphang's transformers fork)

    pip install -q datasets accelerate loralib sentencepiece

pip install -q git+https://github.com/zphang/transformers@llama_push
pip install -q git+https://github.com/huggingface/peft.git

  2. Install bitsandbytes from source

Inference

See generate.py.

Training

Under construction.