- cross-posted to:
- bootstrappable@slrpnk.net
- technews@radiation.party
- cross-posted to:
- bootstrappable@slrpnk.net
- technews@radiation.party
There is a discussion on Hacker News, but feel free to comment here as well.
There is a discussion on Hacker News, but feel free to comment here as well.
I cloned and compiled the alpaca.cpp on my Android Oneplus 9, I can get it started but dies due to not enough RAM. I have 8 GB total, but cant get the required 4 GB free to run the trimmed Llama (alpaca) model.
I might splash out on the orange pi for some fun.