A lot of the huggingface, accelerate and bitsandbytes are exceptionally brittle and newer models somehow get stuck in dependecy hell.
Ask HN: Why is so many packages in LLM dev brittle?
- Posted 2 weeks ago by Exorust
- 1 points
1 comments
Loading..
A lot of the huggingface, accelerate and bitsandbytes are exceptionally brittle and newer models somehow get stuck in dependecy hell.