nayminlwin@lemmy.ml to Linux@lemmy.ml · 9 months agoAny experience with teaching kids Linux?message-squaremessage-square137fedilinkarrow-up1155arrow-down14file-text
arrow-up1151arrow-down1message-squareAny experience with teaching kids Linux?nayminlwin@lemmy.ml to Linux@lemmy.ml · 9 months agomessage-square137fedilinkfile-text
minus-squareProperlyProperTea@lemmy.mllinkfedilinkarrow-up1·9 months agoI have an RX6800XT and I use KoboldCPP to run models I download off of Huggingface. I’m not sure how many tokens per second it generates, probably about 10? If you want to try it yourself here’s a link to the Github page: https://github.com/LostRuins/koboldcpp
I have an RX6800XT and I use KoboldCPP to run models I download off of Huggingface.
I’m not sure how many tokens per second it generates, probably about 10?
If you want to try it yourself here’s a link to the Github page: https://github.com/LostRuins/koboldcpp