Code

Add prototype of QLoRA#1800

Code

Open

wanghaoshuang wants to merge 4 commits intoPaddlePaddle:developPaddlePaddle/PaddleSlim:developfrom wanghaoshuang:lcwanghaoshuang/PaddleSlim:lcCopy head branch name to clipboard

+578

Commits

Commits on Oct 27, 2023

• Add prototype of QLoRA

  wanghaoshuang

  committed
  d970e20

  Copy full SHA for d970e20

Commits on Nov 2, 2023

• Add NF4 quantizae kernel

  wanghaoshuang

  committed
  3ce762b

  Copy full SHA for 3ce762b

• Add block_size attribute for nf4 operator

  wanghaoshuang

  committed
  a6f7404

  Copy full SHA for a6f7404

Commits on Nov 3, 2023

• Add NF4 dequant cuda kernel

  wanghaoshuang

  committed
  4e2f8d7

  Copy full SHA for 4e2f8d7