Orca 2 released by Microsoft!
Full weights here:
https://huggingface.co/microsoft/Orca-2-7b
https://huggingface.co/microsoft/Orca-2-13b
My own exllamav2 quants here:
https://huggingface.co/bartowski/Orca-2-7b-exl2
https://huggingface.co/bartowski/Orca-2-13b-exl2
GGUF from TheBloke (links to GPTQ/AWQ inside it):
I’ll wait a little then I guess. I need 16k for what I’m doing. Thanks for the heads up 🙂
Btw there’s a 16k tune available now:
https://huggingface.co/bartowski/Orca-2-13B-16k-exl2
Nice, will give it a try. Thank you 😊