Smorty [she/her]
I’m a person who tends to program stuff in Godot and also likes to look at clouds. Sometimes they look really spicy outside.
- 0 Posts
- 1 Comment
Joined 1 year ago
Cake day: July 5th, 2023
You are not logged in. If you use a Fediverse account that is able to follow users, you can follow this user.
Please try the 4 bit quantisations of the models. They work a bunch faster while eating less RAM.
Generally you want to use 7B or 8B models on the CPU, since everything above will be hellishly slugish.