minus-squaresp3ctre@feddit.orgOPtoLocalLLaMA@sh.itjust.works•Your best local LLM for low-VRAM (6GB)?linkfedilinkEnglisharrow-up1·4 months agoDoesn’t necessarily need to be very fast, but I don’t plan to wait a minute for one simple sentence as well :) Is that possible without tinkering too much? linkfedilink
sp3ctre@feddit.org to LocalLLaMA@sh.itjust.worksEnglish · 4 months agoYour best local LLM for low-VRAM (6GB)?plus-squaremessage-squaremessage-square8fedilinkarrow-up11
arrow-up11message-squareYour best local LLM for low-VRAM (6GB)?plus-squaresp3ctre@feddit.org to LocalLLaMA@sh.itjust.worksEnglish · 4 months agomessage-square8fedilink
Doesn’t necessarily need to be very fast, but I don’t plan to wait a minute for one simple sentence as well :)
Is that possible without tinkering too much?