I read that the guy is a legend and genius (I believe that because rsync is fantastic. He invented that). I trust in him knowing what he’s doing. We should give him a hand if we want it to be better.
- 1 Post
- 9 Comments
somegeek@programming.devto
Selfhosted@lemmy.world•Another reason to self host your own AIEnglish
1·4 days agoThanks. I will look into it.
somegeek@programming.devto
Selfhosted@lemmy.world•Ideon 0.9 — from watching to actingEnglish
2·4 days agoSeems cool! I’ve been looking for something like this. Especially if it can be used as a collaborative knowledge management tool for team knowledge bases.
Holy crap I thought rsync is a super serious and professional program. Didn’t thought they ruin it with vibecodeing.
A lot of important infra depends rsync.
somegeek@programming.devto
Selfhosted@lemmy.world•Another reason to self host your own AIEnglish
1·5 days agoQwen 3.5 24B is way too large for my specs. I’m barely running qwen2.5 7B
somegeek@programming.devto
Selfhosted@lemmy.world•Another reason to self host your own AIEnglish
31·5 days agoI started working toward self hosting LLM for my small company using ollama and opencode as agent But I realized a good model like GLM 5 requures 250GB of RAM and 24GB vram with a 4080?? I dont know, this is what the LLM told me itself.
I ended up using qwen-code2.7-7b-16k.
Currently the best thing I have is my laptop, 16GB ram, i7 9750H gtx1650
How do you guys selfhost? What models do you use that are actually good?
Just making pasta water coffee itself is a waste. Doesnt matter if she drank it all.
Shes literally wasting coffee



What the actual fuck is this timeline that we are living in?