So instead of asking it to build a game like x, we ask it to write design documents of x, and then we ask it to implement those?

It wasn’t a scarce resource before. Why is it more scarce now if we’re just offloading into the cloud which makes it, supposedly, significantly more efficient? People had RAM before. Now they can’t get any [for similar price].

It wasn’t even scarce before them.

I assume NIM only works with nvidia cards not AMD?

Please don’t meat-proxy.

What is meat-proxying?

A meat proxy is a human who forwards questions to an AI and forwards the answers back — adding nothing but latency.

• https://meatproxy.me/

Firefox includes/supports translation models, IIRC on mobile as well. They’re pretty small and probably good.

Another place I would check is f-droid - serving OSS apps so can be inspected. I thought I had a translator app installed like that, but it doesn’t seem to use models. I probably mixed it up with a different app that uses models for voice to text.