Silver's Home
  • Communities
  • Create Post
  • heart
    Support Lemmy
  • search
    Search
  • Login
  • Sign Up
Lee Duna to Technology@lemmy.worldEnglish • 1 year ago

Apple Develops Breakthrough Method for Running LLMs on iPhones

www.macrumors.com

external-link
message-square
36
fedilink
58
external-link

Apple Develops Breakthrough Method for Running LLMs on iPhones

www.macrumors.com

Lee Duna to Technology@lemmy.worldEnglish • 1 year ago
message-square
36
fedilink
Apple GPT in your pocket? It could be a reality sooner than you think. Apple AI researchers say they have made a key breakthrough in deploying large...
alert-triangle
You must log in or register to comment.
  • Ace! _SL/S
    link
    fedilink
    English
    56•
    edit-2
    1 year ago

    This comment sums it up pretty nicely:

    LOL innovative invention of swapping memory to storage…… maybe they can call it something cool like “cache”.

    Apple being “innovative” my ass, lmao

    • @cheese_greater@lemmy.world
      link
      fedilink
      English
      17•1 year ago

      Cache u inside

      • @jcg@halubilo.social
        link
        fedilink
        English
        2•1 year ago

        How bow dat?

    • @lemmylommy@lemmy.world
      link
      fedilink
      English
      12•1 year ago

      Well, if that commenter had more than just a vague idea of caching and/or swapping, they would know that the right algorithm can make or break performance.

      That paper is not “we invented caching”, but “this is how we make some certain models work well despite constraints imposed by RAM and flash storage.”

      It’s a worthy job for an engineer or researcher. Not quite as innovative as the invention of the wheel, but still enough to write a paper on (and read it, if you can manage to understand it).

    • Hegar
      link
      fedilink
      10•1 year ago

      The easiest way to tell that something’s not really innovative is if the person describing it uses the word innovative.

      • HeartyBeast
        link
        fedilink
        4•1 year ago

        Can you give an example of something that actually was innovative, that no-one called innovative?

        • Hegar
          link
          fedilink
          4•1 year ago

          The spoked wheel.

          • HeartyBeast
            link
            fedilink
            0•1 year ago

            Interestingly, it looks as if nothing was really called innovative before 1960, with usage peaking in 2000, and its now in decline

            https://www.etymonline.com/word/innovative

            • Hegar
              link
              fedilink
              1•1 year ago

              Peaking in 2000 seems odd - I see or hear that word daily and that definitely wasn’t the case back in 2000. Interesting!

        • @GluWu@lemm.ee
          link
          fedilink
          English
          0•1 year ago

          Corndogs

    • @4am@lemm.ee
      link
      fedilink
      English
      -2•1 year ago

      35 upvotes in the technology community…man you guys really are just all knee-jerk reactionaries and it really knowledgeable tech at all. git gud

  • @guitarsarereal@sh.itjust.works
    link
    fedilink
    English
    26•
    edit-2
    1 year ago

    deleted by creator

    • @cybersandwich@lemmy.world
      link
      fedilink
      English
      10•1 year ago

      deleted by creator

  • @cheese_greater@lemmy.world
    link
    fedilink
    English
    15•1 year ago

    Make Siri Great For Once

    • LazaroFilm
      link
      fedilink
      English
      19•1 year ago

      Huhum…?

      Still working on that…

      I’m sorry, try again later.

      • @cheese_greater@lemmy.world
        link
        fedilink
        English
        3•1 year ago

        You’re triggering me lol

        • @coolmojo@lemmy.world
          link
          fedilink
          English
          6•1 year ago

          Found the following websites about you’re triggering me lol.

          • @cheese_greater@lemmy.world
            link
            fedilink
            English
            4•1 year ago

            Sigh! [unzips] Go ahead…

    • @Xatolos@reddthat.com
      link
      fedilink
      English
      4•1 year ago

      deleted by creator

  • @fruitycoder@sh.itjust.works
    link
    fedilink
    English
    3•1 year ago

    Tbh I’m more excited to see someone do use webnn, webgpu and petals together. Building smaller tighter models is good too.

  • @wizzor@sopuli.xyz
    link
    fedilink
    English
    1•1 year ago

    I don’t understand the innovation, I already run LLMs and stable diffusion on a laptop from 2011.

    I have no doubt it could be run on my Android phone.

  • @Lophostemon@aussie.zone
    link
    fedilink
    English
    -13•1 year ago

    Why the hell do we want to encourage people running MLMS on our phones?!! I don’t want to be part of some stupid pyramid scheme nonsense.

    • LazaroFilm
      link
      fedilink
      English
      10•
      edit-2
      1 year ago

      dōTERRA Phone

      • @Tronn4@lemmy.world
        link
        fedilink
        English
        7•1 year ago

        HerbaLife Galaxy S30

    • @flooppoolf@lemmy.world
      link
      fedilink
      English
      7•1 year ago

      Haha

    • Josh
      link
      fedilink
      English
      4•1 year ago

      😭

    • /home/pineapplelover
      link
      fedilink
      English
      4•
      edit-2
      1 year ago

      LLM≠MLM

      • @Lophostemon@aussie.zone
        link
        fedilink
        English
        1•1 year ago

        https://youtu.be/8N_tupPBtWQ?si=bDNpaip3U5tDk0h5

    • @4am@lemm.ee
      link
      fedilink
      English
      3•1 year ago

      Siri could suck an order of magnetize less and work offline, for starters

    • @Tja@programming.dev
      link
      fedilink
      English
      3•1 year ago

      Here, you dropped this: /s

      • @Lophostemon@aussie.zone
        link
        fedilink
        English
        2•1 year ago

        /s is for weaklings.

        HEAR ME ROAR.

Technology@lemmy.world

!technology@lemmy.world

Subscribe from Remote Instance

Create a post
You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !technology@lemmy.world

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


  • @L4s@lemmy.world
  • @autotldr@lemmings.world
  • @PipedLinkBot@feddit.rocks
  • @wikibot@lemmy.world
  • 3.7K users / day
  • 8.81K users / week
  • 17.7K users / month
  • 37.6K users / 6 months
  • 69.9K subscribers
  • 14.8K Posts
  • 649K Comments
  • Modlog
  • mods:
  • @L3s@lemmy.world
  • enu
  • Technopagan
  • L4sBot
  • L3s
  • @L4s@hackingne.ws
  • BE: 0.19.3
  • Modlog
  • Instances
  • Docs
  • Code
  • join-lemmy.org