Is there an alternative to ollama? The point was to run something locally.
- 1 Post
- 163 Comments
I recently gave it a try with qwen3.5 and deepseek coder v2. I have a RTX3090 and these are the largest models that can run comfortably on it.
Conclusion, they are both fucking useless. Free tier claude runs circles.
Steve@startrek.websiteto
World News@lemmy.world•Palestine Action activists sentenced as terroristsEnglish
181·16 days agoShameful
Steve@startrek.websiteto
World News@lemmy.world•Trump says U.S. will seize Iran’s Kharg Island and other ‘oil infrastructure points’English
5·17 days agoNot at all. Their lives will delay any consequences Trump may face for raping all those children.
Steve@startrek.websiteto
World News@lemmy.world•Top African referee Omar Artan refused access to US and will miss World CupEnglish
2·19 days agoLiterally his first mistake smh
Steve@startrek.websiteto
World News@lemmy.world•Top African referee Omar Artan refused access to US and will miss World CupEnglish
15·19 days agoNot white
Steve@startrek.websiteto
Not The Onion@lemmy.world•Corporations Can Vote in Some Delaware Elections, Judge SaysEnglish
10·1 month agoEach employee can represent 3/5 of a vote!
Steve@startrek.websiteto
Technology@beehaw.org•Aggressive AI scrapers are making it kinda suck to run wikis
2·1 month agoThey spoof their ip now
Steve@startrek.websiteto
Technology@beehaw.org•Aggressive AI scrapers are making it kinda suck to run wikis
1·1 month agoI didnt see this mentioned- for all the old non-cashed stuff, would it help to throttle it by like 5-10 seconds per request? Maybe also serve a cached “loading” page during the wait.
Steve@startrek.websiteto
World News@lemmy.world•Pope Leo decries 'dizzying' profits earned by companies that polluteEnglish
44·1 month agoDid he give this speech from his solid gold throne?
Steve@startrek.websiteto
Selfhosted@lemmy.world•People who are staying on Plex, have you tried Jellyfin? What about it do you not prefer? (real question)English
21·1 month agoI only use my library with jellyfin and only locally. I left plex a few years ago. What I really want to set up next is a UI that uses a simply remote control and ditch the Roku interface so I can be seamlessly offline.
Steve@startrek.websiteto
World News@lemmy.world•China quietly turns off supply of world's most used industrial chemicalEnglish
20·1 month agoThats no mystery. They offered it at a lower cost, and worldwide free trade was expected to continue.
Steve@startrek.websiteto
World News@lemmy.world•Single-sex toilets must exclude transgender people, says Equality and Human Rights CommissionEnglish
11·1 month agoNot saying anything about humans, but animals meant for breeding would be… removed if they were like that
Without rewatching the video, I think it was an esp32 dev board with some naughty code running.
Steve@startrek.websiteto
Not The Onion@lemmy.world•South Florida officers sue Ben Affleck and Matt Damon, claiming details in 'The Rip' are too realEnglish
12·2 months agoSo dumb it has to be a publicity stunt
Please note that it would be illegal to use the $5 killswitch device against a robot that you don’t own….
Steve@startrek.websiteto
World News@lemmy.world•LinkedIn Is Illegally Searching Your ComputerEnglish
2·2 months agoCorrection- the first test was the browser inside the lemmy voyager app, not sure what its based on. This one is out of the DDG app;

Steve@startrek.websiteto
World News@lemmy.world•LinkedIn Is Illegally Searching Your ComputerEnglish
2·2 months agoI made no effort to do that, im using the duckduckgo browser on my phone.

I will check it later. I loaded whichever one cluade suggested lol