1190
A “QuitGPT” campaign is urging people to cancel their ChatGPT subscriptions— Backlash against ICE is fueling a broader movement against AI companies’ ties to President Trump. (quitgpt.org)
submitted 6 months ago by to c/technology@lemmy.world
143 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] 54 points 6 months ago (5 children)

Off with their heads! GO self-hosted, go local... toss the rest in the trash can before this crap gets a foothold and fully enshitifies

  • permalink
  • fedilink
  • source
  • hideshow 10 child comments
    •
  • [–] 20 points 6 months ago (2 children)

    LLMs are already shit. Going local is still burning the world just to run a glorified text production machine

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 4 child comments
    •
  • [+] -15 points 6 months ago (3 children)

    Having just finished getting an entire front end for my website, I disagree. A few years ago I would offshore this job to some third-world country devs. Now, AI can do the same thing, for cents, without having to wait for a few days for the initial results and another day or two for each revision needed

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 6 child comments
    •
  • [–] 33 points 6 months ago (1 child)

    The fact you see nothing wrong with anything you said really speaks volumes to the inhumanity inherent with using "AI".

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [+] -14 points 6 months ago* (last edited 6 months ago) (3 children)

    Please enlighten me. I am working on systems solving real-world issues, and now I can ship my solutions faster, with lower costs. Sounds like a win-win for everyone involved except for the offshore employees that have to look for new gigs now

    Edit: I would actually rather read a reply than just see you downvoting. The point is, what you call a “glorified text generating machine”, has actual use cases

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 6 child comments
    •
  • [–] 18 points 6 months ago

    I don’t know if it’s your fault honestly. It’s the system that makes you want to offshore your work to developing countries and not hire local employees. I get it. It’s cheaper. But when even independent developers start doing this we have reached post-late stage capitalism at this point

  • permalink
  • fedilink
  • source
  • parent
  • [–] 15 points 6 months ago (1 child)

    you missed the plot a little.

    it's not that it doesn't have use cases. It burning the world down with it.

    how much more water went down the drain cooling the requests you made? how about the electricity not going to local consumers but AI data centers.

    all the computer components shortages...

    that's still before the fact you admitted you would have hired a human, and given them food on the table instead of a corporate giant to buy another mega yacht.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] -4 points 6 months ago (1 child)

    Regarding the electricity not going to local customers: it’s not my fault that your country does not have appropriate regulations. None of the data centers are located where I live anyways.

    Regarding hiring a human: I 100% would hire a human if there was no AI, you’re right, I’m not trying to hide it. Sucks for them I guess but I don’t see a reason why should I keep using their services if I can get a cheaper and arguably better alternative now - I’m trying to make money, not run a charity supporting development of 3rd world countries with authoritarian regimes.

    However, I am pretty sure that the companies which I’m paying are currently operating on a loss with my $3/month and free coding plans. They want to grow the customer base and I’ll just switch once they will start wanting to make a profit, like the Chinese ZAI just did this week, hiking up their prices by over 3x. They are operating on a loss with my <3$/month contribution and not buying another mega yacht yet getting further away from one.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 3 points 6 months ago (1 child)

    "well it doesn't effect me directly other than my bottom line, so sucks for everyone else"

    if all you have to say is that, have the day you deserve.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 2 points 6 months ago (1 child)

    What do you expect me to do? Spend more money when I can get better results with less money? I don’t understand your point, what am I supposed to be doing, according to you?

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 3 points 6 months ago

    yes, because hording money got us into this mess.

    Why should you Proffitt so much off what used to be other people's labour, and now plagiarism machine.

    why do you expect me to sympathize with you.

    I make good money on my own, and I do my best to NOT find the cheapest solution out there for my problems, and look for more ethical ways to spend my money. Because I care about my impact on others over my money. it's having humanity.

  • permalink
  • fedilink
  • source
  • parent
  • [–] 5 points 6 months ago (1 child)

    Looks like others have come along and made my point for me while I slept. Except for calling out the dehumanizing language against the developers. They missed that one.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] -1 points 6 months ago (1 child)

    They weren’t my full time employees but one time gigs. I’ve worked with tons of freelancers over the years, I don’t have any special relationship with them. It’s was just a matter of whoever would offer the lowest price for the gig each time

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 5 points 6 months ago (2 children)

    link to the website please, lets see this glorious beast

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 4 child comments
    •
  • [–] 6 points 6 months ago (1 child)

    Yeah and I wonder what are those real world products solving real world issues he talks about.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 1 point 6 months ago

    Yeah. It's not hard to say a sentence about the problem space. Heck, in good faith I'll say what I've been working on to start. I'm currently developing tools to help small communities teach their native language to younger generations as existing programs have stopped support for them.

  • permalink
  • fedilink
  • source
  • parent
  • [–] 1 point 6 months ago

    It’s behind a login page so I’m afraid you wouldn’t see much. Also, it was never supposed to be glorious (it was not before the LLMs neither), it’s a matter of just having some form of UI as a necessity. I would be hiring actual designers if it was supposed to be a landing page or sth where the looks matter, not stick with the AI

  • permalink
  • fedilink
  • source
  • parent
  • [–] 5 points 6 months ago (3 children)

    GO self-hosted,

    So yours and another comment I saw today got me to dust off an old docker container I was playing with a few months ago to run deepseek-r1:8b on my server's Intel A750 GPU with 8gb of VRAM. Not exactly top-of-the-line, but not bad.

    I knew it would be slow and not as good as ChatGPT or whatever which I guess I can live with. I did ask it to write some example Rust code today which I hadn't even thought to try and it worked.

    But I also asked it to describe the characters in a popular TV show, and it got a ton of details wrong.

    8b is the highest number of parameters I can run on my card. How do you propose someone in my situation run an LLM locally? Can you suggest some better models?

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 6 child comments
    •
  • [–] 9 points 6 months ago (2 children)

    You are playing with ancient stuff that wasn’t even good at release. Try these:

    A 4b model performing like a 30b model: https://huggingface.co/Nanbeige/Nanbeige4.1-3B

    Google open source version of Gemini: https://huggingface.co/google/gemma-3-4b-it

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 4 child comments
    •
  • [–] 1 point 6 months ago (1 child)

    Well, not off to a great start.

    To be clear, I think getting an LLM to run locally at all is super cool, but saying "go self hosted" sort of gloms over the fact that getting a local LLM to do anything close to what ChatGPT can do is a very expensive hobby.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 1 point 6 months ago (1 child)

    I agree, it is a very expensive hobby, and it gets decent in the range 30-80b. However, the model you are using should not perform that bad, it seems that you might be hitting a config issue. Would you mind sharing the cli command you use to run it?

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 1 point 6 months ago (1 child)

    Thanks for taking the time.

    So I'm not using a CLI. I've got the intelanalytics/ipex-llm-inference-cpp-xpu image running and hosting LLMs to be used by a separate open-webui container. I originally set it up with Deepseek-R1:latest per the tutorial to get the results above. This was straight out of the box with no tweaks.

    The interface offers some controls settings (below screenshot). Is that what you're talking about?

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 1 point 6 months ago (1 child)

    Those values are most of what I was looking for. An LLM is just predicting the next token (for simplicity, a word). It does so by generating every possible word with a probability associated with it, and then picking a random word from this list, influenced by its probability. So for the sentence “a cat sat” it might generate “on: 0.6”, “down: 0.2”, and so on. 0.6 just means 60%, and all the values add up to 1 (100%). Now, the number of tokens generated can be as big as the context, so you might want to pick randomly from the top 10, you control this with the parameter top_k, or you might want to discard all the words below 20%, you control this with min_p. And finally, in cases where you have a token with a big probability followed by tokens with very low probability, you might want to squash these probabilities to be closer together, by decreasing the higher tokens and increasing the lower tokens. You control this with the temperature parameter where 0.1 is very little squashing, and 1 a lot of it. In layman terms this is the amount of creativity of your model. 0 is none, 1 is a lot, 2 is mentally insane.

    Now, without knowing your hardware or why you need docker, it is hard to suggest a tool to run LLMs. I am not familiar with what you are using, but it seems to not be maintained, and likely lacks the features needed for a modern LLM to work properly. For consumer grade hardware and personal use, the best tool these days is llamacpp, usually through a newbie friendly wrapper like LMStudio which support other backends as well and provide so much more than just a UI to download and run models. My advice is to download it and start there (it will download the right backend for you, so no need to install anything else manually).

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 1 point 6 months ago

    I'll give that a shot.

    I'm running it in docker because it's running on a headless server with a boatload of other services. Ideally whatever I use will be accessible over the network.

    I think at the time I started, not everything supported Intel cards, but it looks like llama-cli has support form Intel GPUs. I'll give it a shot. Thanks!

  • permalink
  • fedilink
  • source
  • parent
  • [–] 2 points 6 months ago

    It goes down to number of vram / unified ram you have. There is no magic to make 8b perform like top tier subscription based LLMs (likely in 500b+ range, wouldn't be surprised if trillions).

    If you can get to 32b / 80b models, that's where magic starts to happen.

  • permalink
  • fedilink
  • source
  • parent
  • [–] 0 points 6 months ago

    Honestly you pretty much don't. Llama are insanely expensive to run as most of the model improvements will come from simply growing the model. It's not realistic to run LLMs locally and compete with the hosted ones, it pretty much requires the economics of scale. Even if you invest in a 5090 you're going to be behind the purpose made GPUs with 80GB VRAM.

    Maybe it could work for some use cases but I rather just don't use AI.

  • permalink
  • fedilink
  • source
  • parent
  • [–] 4 points 6 months ago (2 children)

    Going local is taxing on your hardware that is extremely expensive to replace. Hell, it could soon become almost impossible to replace. I genuinely don‘t recommend it.

    Even if you HAVE to use LLMs for some reason, there are free alternatives right now that let Silicon Valley bleed money and they‘re quickly running out of it.

    Cancelling any paid subscription probably hurts them more than anything else.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 4 child comments
    •
  • [–] 5 points 6 months ago*

    If LLM is tied to making you productive, going local is about owning and controlling the means of production.

    You aren't supposed to run it on machine you work on anyway, do a server and send requests.

  • permalink
  • fedilink
  • source
  • parent
  • [–] 2 points 6 months ago*

    GO self-hosted, go local

    Last I checked it costed ~$6000 to run a high end LLM at terrible speeds and that was before the RAM price hike. And at the rate things are changing it might be obsolete in a few year. And I don't have that much money either.

    I'm going to stick with the free OpenCode Zen models for now and maybe switch to OpenCode Black or Synthetic or whatever when they stop being available and use the open weight models there for now.

  • permalink
  • fedilink
  • source
  • parent
  • [–] -2 points 6 months ago (1 child)

    I would, if I found even a remotely good usecase for LLMs. Would be useful for contextual search on a bunch of API documentation and books on algorithms, but I don't want a sychophantic "copilot" or "assistant", that does job so bad I would be fired for, all while being called ableist slurs and getting blacklisted from the industry.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 1 point 6 months ago

    I only have a need for RAG and it works well, wouldn't say I need w copilot either. Everyone probably has some use case for this stuff but it's gonna be different for everyone, the basic llm conversation model it's really just a stepped up interactive Google

  • permalink
  • fedilink
  • source
  • parent