• 0 Posts
  • 10 Comments
Joined 1 year ago
cake
Cake day: June 11th, 2023

help-circle
  • I don’t trust ChatGPT/GPT-4 for much to begin with, but this study is not great. From Ars Technica’s article on the same topic (with emphasis added by me):

    While this new study may appear like a smoking gun to prove the hunches of the GPT-4 critics, others say not so fast. Princeton computer science professor Arvind Narayanan thinks that its findings don’t conclusively prove a decline in GPT-4’s performance and are potentially consistent with fine-tuning adjustments made by OpenAI. For example, in terms of measuring code generation capabilities, he criticized the study for evaluating the immediacy of the code’s ability to be executed rather than its correctness.

    “The change they report is that the newer GPT-4 adds non-code text to its output. They don’t evaluate the correctness of the code (strange),” he tweeted. “They merely check if the code is directly executable. So the newer model’s attempt to be more helpful counted against it.”

    AI researcher Simon Willison also challenges the paper’s conclusions. “I don’t find it very convincing,” he told Ars. “A decent portion of their criticism involves whether or not code output is wrapped in Markdown backticks or not.” He also finds other problems with the paper’s methodology. “It looks to me like they ran temperature 0.1 for everything,” he said. “It makes the results slightly more deterministic, but very few real-world prompts are run at that temperature, so I don’t think it tells us much about real-world use cases for the models.”




  • I have a Targus cooling pad that works pretty well for that. It’s like a thin plastic tray thing with vents and a USB-powered fan to provide extra cooling, but I mostly use it without the fan to elevate my laptop off my lap and allow for extra airflow. Something similar might work well for your use case.

    That said, I’ve noticed my laptop’s fan will start to make an obnoxious rattling noise if I use it on my lap for too long. Fan rattle is a known issue with my laptop and it goes away once it’s sat on my desk for a while, but it can be annoying so YMMV.






  • The framing of “Go back to normal” or “Only sexy pictures of John Oliver” was clever. Lots of people are going to pick the funny option over the boring one in basically any low stakes poll, so even people who don’t care much about the protest probably still voted for it.

    There’s also a lot more motivation for the people who are pissed about Reddit’s changes vs. the people who just want their infinite feed of content back to its former state.

    I bet similar scenarios play out with spez’s whole “moderator democracy” idea.