• Zeon@lemmy.worldOP
    link
    fedilink
    English
    arrow-up
    2
    arrow-down
    1
    ·
    edit-2
    8 months ago

    Oh I’m already using AUTOMATIC1111 on this computer with my RTX 2080 SUPER (using Debian GNU/Linux). It runs really good on it actually, I’m only using 8GB of VRAM too, It takes like 5-7 seconds to generate images, truly amazing stuff. I may be able to push out a video today or tomorrow, the computer can run just fine even with this current RAM issue.

    I was just playing GTA V like 10 minutes ago and it ran well like 50-70FPS (sometimes drops to 40-45FPS depening on the area) on max settings 1440p, barely any stutters. I can run basically everything I need on it with Libreboot now. I’m selling off my main motherboard right now.

    The only thing I can’t seem to get running is local LLMs because my Xeon processor is AVX-only and not AVX2. I was trying to use GPT4All, I was able to use the UI and try to download a model, but aftering it finished downloading it crashes and I can’t open it again. As far as I looked into it, its just the current limitation with my processor.

    In the future I may start looking into using Dasharo firmware with the MSI Z690-A DDR5 since I want to use new models like Mixtral 8x7B, I heard it was really good. The older motherboard I’m using here is the Dell Precision T1650 motherboard from 2012, its only 32GB of RAM max, and newer models like Mixtral need up to 64GB of RAM.

    I couldn’t check the exact score of how much open-source code there is on here, I did have to inject blobs / vendor firmware into the libreboot.rom file. It should probably be more open than newer motherboards, considering its older, along with Libreboots blob reduction policy.

    The only small problem I’m facing right now is for some reason I have to leave this computer on for like an hour to make my games run better. I open Steam and I guess just let the Vulkan shaders process in the background.

    Also, I tried running NVIDIAs open source drivers and it didn’t work for me. I couldn’t passthrough my GPU to my VM (using KVM hypervisor) either. Maybe, this is just due to me using NVIDIAs full proprietary drivers or maybe I just suck lol I would like more people to try this out though.

    Hopefully one day we can achieve even more freedom with better hardware, maybe with hardware like RISC-V =)