• 0 Posts
  • 21 Comments
Joined 2 months ago
cake
Cake day: July 10th, 2024

help-circle

  • The level of your argumentation:
    Are you a firefighter or a medical doctor? If not, you’re obviously in favour of fires, death and disease.
    Why aren’t you donating all of your stuff to homeless people? Or are you happy all those people don’t have a home?
    Why aren’t you saving the world already???

    You know, demanding change and maybe showing some sort of protest does not mean you need to do those things exactly as you would like to see them, especially if those efforts wouldn’t change anything on the larger scale and rather lead to a bunch of problems in your life.






  • If we’re speaking of transformer models like ChatGPT, BERT or whatever: They don’t have memory at all.

    The closest thing that resembles memory is the accepted length of the input sequence combined with the attention mechanism. (If left unmodified though, this will lead to a quadratic increase in computation time the longer that sequence becomes.) And since the attention weights are a learned property, it is in practise probable that earlier tokens of the input sequence get basically ignored the further they lie “in the past”, as they usually do not contribute much to the current context.

    “In the past”: Transformers technically “see” the whole input sequence at once. But they are equipped with positional encoding which incorporates spatial and/or temporal ordering into the input sequence (e.g., position of words in a sentence). That way they can model sequential relationships as those found in natural language (sentences), videos, movement trajectories and other kinds of contextually coherent sequences.




  • Zacryon@feddit.orgto196@lemmy.blahaj.zoneRule
    link
    fedilink
    arrow-up
    26
    ·
    30 days ago

    One of the most ironic things is if you willingly download the app version of a website, hoping it would speed things up and reduce internet data usage, just for the app to be using WebView or some other micro-browser engine which will essentially be the same as if you were visiting the website using your browser as before.

    Thanks for nothing.





  • Zacryon@feddit.orgtoMemes@lemmy.mlFirefox + Ublock = 👑
    link
    fedilink
    arrow-up
    6
    arrow-down
    3
    ·
    1 month ago

    I’ve read the announcement. Sounds reasonable and sufficiently private to me. So saying “Mozilla wants your data” sounds misleading and like an overreaction to me. Also might help to mitigate the arms race in privacy protection versus tracking for ads and worse stuff.

    Mozilla is definitely going to try more scummy crap like this in the future.

    How do you know that?

    Even if, there will still be alternatives. But right now, Firefox is the best browser with regards to privacy and security. It even passed minmum ratings by the german IT security authority, contrary to other widely used browsers.





  • You got a degree in semi conductor physics? Lol

    Man, that “lol” really annoys me and comes accross condescending. If you’ve got no arguments, there is no need for an academic dick measuring contest. You can just leave it. To answer your question:
    In parts, yes. Not my specialisation though, but enough to be able to distinguish electromigration from whiskering.

    being pedantic. Engineers will call all these things whiskers.

    Being pedantic is part of the job of an engineer. I’m an engineer working in research. I don’t call electromigration “metal whiskering” or vice versa.
    Besides, as I’ve mentioned, it wouldn’t even be pedantic to distinguish them that way as the differences are not miniscule. They are formed differently and look differently.

    I’m not saying the photo in the thumbnail is an example of electromigration.

    Yes, to the post which is titled “TIL computers can sometimes grow crystals” you said:

    This can happen inside ICs […] It’s called electromigration.

    Which is still wrong. We can observe electromigration in ICs, or in metallic conductors in general, but this is a different phenomenon than whiskering, which can look like those crystals while conductors affected by electromigration form voids and protrusions out of material build-ups which usually can’t even be seen by the bare eye.
    But maybe that was a misleading expression and you didn’t mean to equate those two.


  • If you understand “car” as “hardware degradation” there is something to it, despite calling it “electromigration”.

    You said it (= whiskers) can be simulated and that it’s called electromigration. From what I understood, this statement is wrong, since they are both different in both cause and effect. Metal whiskering can be simulated to a certain extent, yes. But that’s vastly different to what electromigration is and how it works.