Show HN: Train LoRA directly on the GGUF you have, then merge the adapter

  • Posted 2 hours ago by JoakimPalm-Zen
  • 1 points
https://www.reddit.com/r/LocalLLaMA/comments/1x5j48s/train_lora_directly_on_quantized_ggufs_no_pytorch/
Use the same GGUF you serve, merge the adapter back into it and then use the same engine to run the model, all in all a "LLM Toolbox"

0 comments