I completely forgot about the Linux Upskill Challenge! I should have mentioned I’ve been running Linux as my desktop operating system for almost 3 years, and I’ve been tinkering with it quite a lot throughout so I’m quite familiar and very comfortable with the command line. I shoukd go through the Linux upskill challenge so I can fill in any knowledge gaps though. Thanks for reminding me!
I second that. Even my lower-midrange laptop from 3 years ago (8GB RAM, Integrated AMD GPU) can run a few of the smaller LLMs, and it’s true that you don’t even need a GPU as they can run in RAM. And depending on how much RAM you have and what GPU, you might find models performing better in RAM instead of on the GPU. Just keep in mind that when a model says, for example, 8GB Memory required, if you have 8GB RAM, you can’t run it cuz you also have your operating system and other applications running. If you have 8GB video memory on your GPU though, you should be golden (I think).