I started playing around with GPT4All, it's a free local version of GPT4 that can run multiple different LLMs. On their website they only have binaries for Ubuntu based distros but I got it from the AUR. It's MIT licensed.
Your chats are private and never leave your device
GPT4All is built with privacy and security first. Use LLMs with your sensitive local data without it ever leaving your device.
Run language models on consumer hardware
GPT4All allows you to run LLMs on CPUs and GPUs. It fully supports Mac M Series chips, AMD, and NVIDIA GPUs.
Chat with your local files
Grant your local LLM access to your private, sensitive information with LocalDocs. It works without internet and no data leaves your device.
Explore over 1000 open-source language models
GPT4All supports popular models like LLaMa, Mistral, Nous-Hermes, and hundreds more.
I wouldn't have the slightest clue about what I would actually want to use that for.
One use I'd like to see for this kind of AI is in RPG games. It could open up a lot more dialog choices (including custom ones) and generally reflect choices better in the game state.
Yeah I was thinking the same - can't wait until this starts getting integrated into games.
A lot of people use it to create complex shell scripts, or to help them in programming. Another use is in image creation, someone could use it to create designs for a t-shirt business, or to create new art based only on their own existing designs (cartoonists for one example).
I sure like some of the AI art, like that cake I sprung when Jan came. I've seen lots of really cool stuff like that, I don't care how it was made or what trained it, I like it. It's worth more to me than some valuable vincent van fugly painting or something.
