• Blaster M@lemmy.world
    link
    fedilink
    English
    arrow-up
    10
    ·
    edit-2
    5 months ago

    Well, actually, what if I want AI “crap” capability with my Linux ARM laptop?

    The TOPS on those systems are no joke. Consider that it’s 1/2 the performance of an RTX 2060 in a slim laptop form factor.

    Edit: The performance variance is still the same. 2060 can do almost 13 TFLOPS fp16 or about 102 TOPS measured (this figure is on other sites too, this is what I can find atm). SD Elite X can do 45 TOPS. Not bad, considering existing x86_64 CPUs with an NPU do 10-16 TOPS.

    • wewbull
      link
      fedilink
      English
      arrow-up
      5
      ·
      5 months ago

      Don’t confuse TFLOPs and TOPs. Especially when the latter is 4-bit integer operations.