• 2 Posts
  • 18 Comments
Joined 1 year ago
cake
Cake day: June 6th, 2023

help-circle







  • So, there’s a fundamental issue here. A lot of the systems that Amanda is talking about aren’t actually AI.

    Chat-GPT, contrary to the blogosphere, is not actually AI. It does not have the capability for thought. It doesn’t have the capacity to understand truth or fiction as concepts, let alone tell them apart.

    Chat-GPT and similar systems are probabilistic language models. Essentially, I start it off with sentences (a list of tokens, if you want to get technical). Then it responds by essentially looking at the training data it’s been supplied with and picking out the sequence of tokens that most likely is the answer the user is expecting, given the input. Notice that bolded text? The user is expecting. Not anything else. These language models are trained to spit out what users expect, nothing more, nothing less. If a user doesn’t like the response, they give a thumbs down and the model recalibrates, introducing more noise and randomness into the result.

    These language models are actually really great at reducing manual labor at certain tasks (writing cover letters, delivering predictable essays, I’ve personally used Chat-GPT for Shadowrun world-building) but they need to have a knowledgeable person using them because they absolutely will not reliably say true things. They will say whatever their training data says is the most likely thing the user is asking for.












  • I hear you man. I went from active contributor to mostly lurking on Reddit, and it wasn’t even a conscious choice. Gradually, everything became very mechanistic. I knew what the top few comments would be before going to the comments. The churn became cyclic in nature.

    After just a few days here, it was actually a little disconcerting how antagonistic and hostile people there are in the comments section. That’s just how people communicate, on a hair-trigger from flamewar.

    I recognize your username, I saw what you wrote about SQL scaling. Can you imagine recognizing a username in a major subreddit in the reddit of today?

    The dichotomy between the big communities which people subscribe to from all over Lemmy and the small meta/announcement/server issue communities for each individual instance is gonna be interesting to see develop as the userbase increases. Kinda like the difference between seeing people from your street everyday, then many more less familiar people in the city center.