For OpenAI, o1 represents a step toward its broader goal of human-like artificial intelligence. More practically, it does a better job at writing code and solving multistep problems than previous models. But it’s also more expensive and slower to use than GPT-4o. OpenAI is calling this release of o1 a “preview” to emphasize how nascent it is.

The training behind o1 is fundamentally different from its predecessors, OpenAI’s research lead, Jerry Tworek, tells me, though the company is being vague about the exact details. He says o1 “has been trained using a completely new optimization algorithm and a new training dataset specifically tailored for it.”

OpenAI taught previous GPT models to mimic patterns from its training data. With o1, it trained the model to solve problems on its own using a technique known as reinforcement learning, which teaches the system through rewards and penalties. It then uses a “chain of thought” to process queries, similarly to how humans process problems by going through them step-by-step.

At the same time, o1 is not as capable as GPT-4o in a lot of areas. It doesn’t do as well on factual knowledge about the world. It also doesn’t have the ability to browse the web or process files and images. Still, the company believes it represents a brand-new class of capabilities. It was named o1 to indicate “resetting the counter back to 1.”

I think this is the most important part (emphasis mine):

As a result of this new training methodology, OpenAI says the model should be more accurate. “We have noticed that this model hallucinates less,” Tworek says. But the problem still persists. “We can’t say we solved hallucinations.”

  • oakey66@lemmy.world
    link
    fedilink
    English
    arrow-up
    140
    arrow-down
    18
    ·
    25 days ago

    It’s a better prediction model. There’s no reasoning because it’s not understanding anything you’re typing. We’re not closer to general ai.

    • Defaced@lemmy.world
      link
      fedilink
      English
      arrow-up
      29
      arrow-down
      6
      ·
      25 days ago

      OpenAI doesn’t want you to know that though, they want their work to show progress so they get more investor money. It’s pretty fucking disgusting and dangerous to call this tech any form of artificial intelligence. The homogeneous naming conventions to make this tech sound human is also dangerous and irresponsible.

      • ContrarianTrail@lemm.ee
        link
        fedilink
        English
        arrow-up
        13
        arrow-down
        2
        ·
        24 days ago

        It is literally artificial intelligence though. Just because chatGPT doesn’t perform as a layperson imagined it would, it doesn’t mean it’s not AI. They just have an unrealistic expectation of what counts as AI along with the common misconception of AI and AGI being the same thing.

        A chess playing robot uses artificial intelligence as well. It’s a narrow AI, meaning it can do one thing really well but that doesn’t translate to other things. AGI on the other hand stands for Artificial General Intelligence. Humans are an example of general intelligence meaning that we have the cognitive ability to perform well on several unrelated tasks.

          • ContrarianTrail@lemm.ee
            link
            fedilink
            English
            arrow-up
            6
            arrow-down
            1
            ·
            edit-2
            24 days ago

            I don’t see the need to be such a dick about it. The term AGI was coined in the 90’s.

            • Cryophilia@lemmy.world
              link
              fedilink
              English
              arrow-up
              4
              arrow-down
              9
              ·
              24 days ago

              It offends me when hype chasers do this to try and legitimize their snake oil. I don’t care what like 5 random researchers mentioned one time in the 90s, it does not justify calling a language prediction model “AI”. That’s not what the term has ever meant.

              • ContrarianTrail@lemm.ee
                link
                fedilink
                English
                arrow-up
                6
                arrow-down
                1
                ·
                edit-2
                24 days ago

                That’s a bit like taking issue with the terms jig, spinner, spoon, and fly, and saying you don’t care what some random fishermen call them; to the rest of us, they’re just lures.

                AGI is a subcategory of AI. We’ve had AGI systems in science fiction for decades, but we’ve just been calling them AI, which isn’t wrong, but it’s an unspecific term. AI is broad and encompasses everything from predictive text input to AGI and beyond. Every AGI system is also AI, but not everything AI is generally intelligent. ASI (Artificial Super Intelligence) would be an even more specific term, referring to something that is not only artificial and generally intelligent but exceeds human intelligence.

                Artificial intelligence

                The ability of a computer or other machine to perform those activities that are normally thought to require intelligence.

      • tee9000@lemmy.world
        link
        fedilink
        English
        arrow-up
        8
        arrow-down
        4
        ·
        24 days ago

        Their work is making progress. What is irresponsible or dangerous? Im not understanding what you mean.

        • Defaced@lemmy.world
          link
          fedilink
          English
          arrow-up
          9
          arrow-down
          4
          ·
          edit-2
          24 days ago

          It’s irresponsible because making it sound like it’s true AI when it’s not is going to make it difficult to pull the plug when things go wrong and you’ll have the debate of whether it’s sentient or not and if it’s humane to kill it like a pet or a criminal. It’s more akin to using rainbow tables to help crack passwords and claiming your software is super powerful when in reality it’s nothing without the tables. (Very very rudimentary example that’s not supposed to be taken at face value).

          It’s dangerous because talking about AI like it’s a reasoning/thinking thing is just not true, and we’re already seeing the big AI overlords try to justify how they created it with copyrighted material, which means the arguments over copyrighted material are being made and we’ll soon see those companies claim that it’s no different than a child looking up something on Google. It’s irresponsible because it screws over creative people and copyright holders that genuinely made a product or piece of art or book or something in their own free time and now it’s been ripped away to be used to create something else that will eventually push those copyright holders out.

          The AI market is moving faster than the world is capable of keeping up with it, and that is a dangerous precedent to set for the future of this market. And for the record I don’t think we’re dealing with early generations of skynet or anything like that, we’re dealing with tools that have the capability to create economical collapse on a scale we’ve never seen, and if we don’t lay the ground rules now, then we will be in trouble.

          Edit: A great example of this is https://v0.dev/chat it has the potential to put front end developers out of work and jobless. It’s simple now but give it time and it has the potential to create a frontend that rivals the best UX designs if the prompt is right.

          • tee9000@lemmy.world
            link
            fedilink
            English
            arrow-up
            3
            ·
            edit-2
            24 days ago

            I appreciate the effortful response but i dont think regulators would get caught up on colloquial names when weighing benefit versus harm and deciding to do something like ban a model.

            We just arent close enough to the same perspective to discuss it further. Thanks again for the good faith clarification.

            • jimmy90@lemmy.world
              link
              fedilink
              English
              arrow-up
              2
              arrow-down
              1
              ·
              24 days ago

              I think over-selling the “AI” with “reasoning/thinking” language becomes fraudulent and encourages inappropriate/dangerous applications.

                • jimmy90@lemmy.world
                  link
                  fedilink
                  English
                  arrow-up
                  2
                  arrow-down
                  1
                  ·
                  24 days ago

                  assuming that “AI” has “reasoning” and using it in applications that require that is dangerous

                • msage@programming.dev
                  link
                  fedilink
                  English
                  arrow-up
                  1
                  ·
                  23 days ago

                  It will be used to take control over peoples lives.

                  In any simple way it may be - denying job/insurance/care/etc, it will be hailed as using ‘reason’, while it just repeats patterns from the training sets.

                  It does not ‘reason’, because it can’t. Trying to sell it as such is very dangerous as it will be used against people, and it’s dishonest for the investors as well, as they will jump on it even though it’s not ‘true’ and it never will be for this model.

                  https://softwarecrisis.dev/letters/llmentalist/

    • ContrarianTrail@lemm.ee
      link
      fedilink
      English
      arrow-up
      26
      arrow-down
      8
      ·
      25 days ago

      It may not be capable of truly understanding anything, but it sure seems to do a better job of it than the vast majority of people I talk to online. I might spend 45 minutes carefully typing out a message explaining my view, only for the other person to completely miss every point I made. With ChatGPT, though, I can speak in broken English, and it’ll repeat back the point I was trying to make much more clearly than I could ever have done myself.

      • Voroxpete@sh.itjust.works
        link
        fedilink
        English
        arrow-up
        14
        arrow-down
        9
        ·
        25 days ago

        I hate to say it bud, but the fact that you feel like you have more productive conversations with highly advanced autocomplete than you do with actual humans probably says more about you than it does about the current state of generative AI.

      • Eximius@lemmy.world
        link
        fedilink
        English
        arrow-up
        9
        arrow-down
        6
        ·
        25 days ago

        It’s a (large) language model. It’s good at language tasks. Helps to have hundreds of Gigs of written “knowledge” in ram. Differing success rates on how that knowledge is connected.

        It’s autocorrect so turbocharged, it can write math, and a full essay without constantly clicking the buttons on top of the iphone keyboard.

        You want to keep a pizza together? Ah yes my amazing concepts of sticking stuff together tells me you should add 1/2 spoons of glue (preferably something strong like gorilla glue).

        How to find enjoyment with rock? Ah, you can try making it as a pet, and having a pet rock. Having a pet brings many enjoyments such as walking it.

        • Echo Dot@feddit.uk
          link
          fedilink
          English
          arrow-up
          6
          arrow-down
          1
          ·
          25 days ago

          You want to keep a pizza together? Ah yes my amazing concepts of sticking stuff together tells me you should add 1/2 spoons of glue

          That would be a good test to ask it that question and see if it comes up with a more coherent answer.

    • Drunemeton@lemmy.world
      link
      fedilink
      English
      arrow-up
      23
      arrow-down
      13
      ·
      25 days ago

      I wish more people would realize this! We’re years away from a truly reasoning computer.

      Right now it’s all mimicry. Mimicry that hallucinates no less…

      • Ilandar@aussie.zone
        link
        fedilink
        English
        arrow-up
        20
        arrow-down
        3
        ·
        25 days ago

        I think most people do understand this and the naysayers get too caught up on the words being used, like how you still get people frothing over the mouth over the use of the word “intelligence” years after this has entered mainstream conversation. Most people using that word don’t literally think ChatGPT is a new form of intelligent life.

      • Echo Dot@feddit.uk
        link
        fedilink
        English
        arrow-up
        17
        arrow-down
        5
        ·
        edit-2
        25 days ago

        I don’t think anyone is actually claiming this is AGI though. Basically people are going around going “it’s not AGI you idiot”, when no one’s actually saying it is.

        You’re arguing against a point no one’s making.

        • shiftymccool@programming.dev
          link
          fedilink
          English
          arrow-up
          2
          arrow-down
          11
          ·
          25 days ago

          Except that we had to come up with the term “AGI” because idiots kept running around screaming “intelligence” stole the term “AI”.

          • Echo Dot@feddit.uk
            link
            fedilink
            English
            arrow-up
            14
            arrow-down
            2
            ·
            edit-2
            25 days ago

            No we didn’t, Artificial General Intelligence has been determined since the '90s.

            We’ve always differentiated Artificial Intelligence and Artificial General Intelligence.

            What we have now is AI, I don’t know anyone who’s claiming that it’s AGI though.

            People keep saying people are saying that this is AGI, but I’ve not seen anyone say that, not in this thread or anywhere else. What I have seen said is people saying this is a step on the road to AGI which is debatable but it isn’t the same as saying this thing here is AGI.

            Edit to add proof:

            From Wikipedia although I’m sure you can find other sources if you don’t believe me.

            The term “artificial general intelligence” was used as early as 1997, by Mark Gubrud in a discussion of the implications of fully automated military production and operations. A mathematical formalism of AGI was proposed by Marcus Hutter in 2000.

            So all of this happened long before the rise of large language models so no the term has not been co-opted.

  • Buffalox@lemmy.world
    link
    fedilink
    English
    arrow-up
    74
    arrow-down
    7
    ·
    25 days ago

    trained to answer more complex questions, faster than a human can.

    I can answer math questions really really fast. Not correct though, but like REALLY fast!

    • tee9000@lemmy.world
      link
      fedilink
      English
      arrow-up
      30
      arrow-down
      3
      ·
      25 days ago

      It scores 83% on a qualifying exam for the international mathematics olympiad compared to the previous model’s 13% so…

      • average_joe@lemmynsfw.com
        link
        fedilink
        English
        arrow-up
        2
        ·
        23 days ago

        When you say previous model, you mean gemini with alpha geometry (an actual RL method)? Which scored a silver?

        I mean not only google did it before, they also released their details unlike openai’s “just trust me bro, its RL”.

        Openai also said that we should reserve 25k tokens for this “reasoning” and they will be charged the same as output tokens which is exorbitantly high (60$ for 1m tokens).

        And the cherry on top is that they won’t even give us these “reasoning” tokens. How the hell am I supposed to improve my prompts if I can’t even see it? How would I reduce the hallucinations without it?

        My personal experience is that, it does have an extra reasoning thing going for itself but in no way does it make openai’s tactics tolerable. The quality does not increase enough to justify its cost per token, let alone their “reasoning tokens” BS.

    • Echo Dot@feddit.uk
      link
      fedilink
      English
      arrow-up
      10
      arrow-down
      5
      ·
      25 days ago

      I’m the same with any programming question as long as the answer is Hello World

      • VirtualOdour@sh.itjust.works
        link
        fedilink
        English
        arrow-up
        5
        arrow-down
        3
        ·
        24 days ago

        That’s a flat out lie, I use it for code all the time and it’s fantastic at writing useful functions if you tell it what you want. It’s also fantastic if you ask it to explain code or options for problem solving.

  • wizardbeard@lemmy.dbzer0.com
    link
    fedilink
    English
    arrow-up
    39
    arrow-down
    2
    ·
    25 days ago

    So for those not familar with machine learning, which was the practical business use case for “AI” before LLMs took the world by storm, that is what they are describing as reinforcement learning. Both are valid terms for it.

    It’s how you can make an AI that plays Mario Kart. You establish goals that grant points, stuff to avoid that loses points, and what actions it can take each “step”. Then you give it the first frame of a Mario Kart race, have it try literally every input it can put in that frame, then evaluate the change in points that results. You branch out from that collection of “frame 2s” and do the same thing again and again, checking more and more possible future states.

    At some point you use certain rules to eliminate certain branches on this tree of potential future states, like discarding branches where it’s driving backwards. That way you can start opptimizing towards the options at any given time that get the most points im the end. Keep the amount of options being evaluated to an amount you can push through your hardware.

    Eventually you try enough things enough times that you can pretty consistently use the data you gathered to make the best choice on any given frame.

    The jank comes from how the points are configured. Like AI for a delivery robot could prioritize jumping off balconies if it prioritizes speed over self preservation.

    Some of these pitfalls are easy to create rules around for training. Others are far more subtle and difficult to work around.

    Some people in the video game TAS community (custom building a frame by frame list of the inputs needed to beat a game as fast as possible, human limits be damned) are already using this in limited capacities to automate testing approaches to particularly challenging sections of gameplay.

    So it ends up coming down to complexity. Making an AI to play Pacman is relatively simple. There are only 4 options every step, the direction the joystick is held. So you have 4n states to keep track of, where n is the number of steps forward you want to look.

    Trying to do that with language, and arguing that you can get reliable results with any kind of consistency, is blowing smoke. They can’t even clearly state what outcomes they are optimizing for with their “reward” function. God only knows what edge cases they’ve overlooked.


    My complete out of my ass guess is that they did some analysis on response to previous gpt output, tried to distinguish between positive and negative responses (or at least distinguish against responses indicating that it was incorrect). They then used that as some sort of positive/negative points heuristic.

    People have been speculating for a while that you could do that, crank up the “randomness”, have it generate multiple responses behind the scenes and then pit those “pre-responses” against each other and use that criteria to choose the best option of the “pre-responses”. They could even A/B test the responses over multiple users, and use the user responses as further “positive/negative points” reinforcement to feed back into it in a giant loop.

    Again, completely pulled from my ass. Take with a boulder of salt.

    • Nougat@fedia.io
      link
      fedilink
      arrow-up
      32
      arrow-down
      1
      ·
      25 days ago

      Again, completely pulled from my ass. Take with a boulder of salt.

      You’re under arrest. That’s ass-salt.

    • Echo Dot@feddit.uk
      link
      fedilink
      English
      arrow-up
      7
      arrow-down
      2
      ·
      25 days ago

      To be a little nitpicky most of the AI that can play Mario kart are trained not with a reinforcement learning algorithm, but woth a genetic algorithm, which is a sort of different thing.

      Reinforcement learning is rather like how you teach a child. Show them a bunch of good stuff, and show them a bunch of bad stuff, and tell them which is the good stuff and which is the bad stuff.

      Genetic algorithms are where you just leave it alone, simulate the evolutionary process on an accelerated time scale, and let normal evolutionary processes take over. Much easier, and less processor intensive, plus you don’t need huge corpuses of data. But it takes ages, and it also sometimes results in weird behaviors because evolution finds a solution you never thought of, or it finds a solution to a different problem to the one you were trying to get it to find a solution to.

      • Nougat@fedia.io
        link
        fedilink
        arrow-up
        2
        ·
        25 days ago

        … sometimes results in weird behaviors because evolution finds a solution you never thought of, or it finds a solution to a different problem to the one you were trying to get it to find a solution to.

        Those outcomes seem especially beneficial.

        But it takes ages, …

        Is this process something that distributed computing could be leveraged for, akin to SETI@home?

        • Echo Dot@feddit.uk
          link
          fedilink
          English
          arrow-up
          2
          ·
          25 days ago

          I work in computer science but not really anything to do with AI so I’m only adjacently knowledgeable about it. But my understanding is unfortunately, no not really. The problem would be that if you run a bunch of evolutions in parallel you just get a bunch of independent AIs, all with slightly different parameters but they’re incapable of working together because they weren’t evolved to work together, they were evolved independently.

          In theory you could come up with some kind of file format that allowed for the transfer of AI between each cluster, but you’d probably spend as much time transferring AI as you saved by having multiple iterations run at the same time. It’s n^n problem, where n is the number of AIs you have.

          • FatCrab@lemmy.one
            link
            fedilink
            English
            arrow-up
            2
            ·
            23 days ago

            Genetic algorithms is a sort of broad category and there’s certainly ways you could federate and parallelize. I think autoML basically applies this within the ML space (multiple trainings explore a solution topology and convergence progress is compared between epochs, with low performers dropping out). Keep in mind, you can also use a genetic algorithm to learn how to explore an old fashioned state tree.

  • khepri@lemmy.world
    link
    fedilink
    English
    arrow-up
    27
    arrow-down
    3
    ·
    24 days ago

    So they slapped some reinforcement learning on top of their LLM and are claiming that gives it “reasoning capabilities”? Or am I missing something?

    • Evotech@lemmy.world
      link
      fedilink
      English
      arrow-up
      16
      arrow-down
      2
      ·
      24 days ago

      It’s like 3 lms on top of eachother in a trenchcoat, and appau a calculator so it gets math right

    • Zos_Kia@lemmynsfw.com
      link
      fedilink
      English
      arrow-up
      4
      ·
      24 days ago

      No the article is badly worded. Earlier models already have reasoning skills with some rudimentary CoT, but they leaned more heavily into it for this model.

      My guess is they didn’t train it on the 10 trillion words corpus (which is expensive and has diminishing returns) but rather a heavily curated RLHF dataset.

  • Nougat@fedia.io
    link
    fedilink
    arrow-up
    24
    arrow-down
    2
    ·
    25 days ago

    “We have noticed that this model hallucinates less,” Tworek says. But the problem still persists. “We can’t say we solved hallucinations.”

    On one hand, yeah, AI hallucinations.

    On the other hand, have you met people?

    • Echo Dot@feddit.uk
      link
      fedilink
      English
      arrow-up
      15
      ·
      edit-2
      25 days ago

      Is that even the goal? Do we want an AI that’s self aware because I thought that basically the whole point was to have an intelligence without a mind.

      We don’t really want sapient AI because if we do that then we have to feel bad about putting it in robots and making them do boring jobs. Don’t we basically want guildless servants, isn’t that the point?

      • SynopsisTantilize@lemm.ee
        link
        fedilink
        English
        arrow-up
        2
        ·
        25 days ago

        For the servants bots, yes no sentience. For my in house AI assistant robot buddy/butler/nanny/driver - also yes no sentience.

      • Daemon Silverstein@thelemmy.club
        link
        fedilink
        English
        arrow-up
        1
        ·
        24 days ago

        It seems utopia/dystopia, but some things get discovered/invented by accident. The more companies and organizations (and even individuals) fiddle with AI improvement, the more the “odds” of a sentient AI (AGI) being accidentally created increases. Let’s not forget that there are lots of companies, organizations and individuals (yeah, individuals, people outside organizations but with lots of computing power and knowledge) simultaneously developing and training AIs. Well, maybe I’m wrong and just very optimistic for such thing to appear out of nowhere.

      • kent_eh@lemmy.ca
        link
        fedilink
        English
        arrow-up
        1
        ·
        25 days ago

        What we want doesn’t have any impact on what our corporate overlords decide to inflict on us.

        • Echo Dot@feddit.uk
          link
          fedilink
          English
          arrow-up
          3
          ·
          24 days ago

          They don’t want sapient AI either, why would they?

          No one is trying for a self-aware artificial intelligence.

    • hedgehog@ttrpg.network
      link
      fedilink
      English
      arrow-up
      6
      ·
      25 days ago

      I’m more concerned about them using the word “sapient.” My dog is sentient; it’s not a high bar to clear.

  • drspod@lemmy.ml
    link
    fedilink
    English
    arrow-up
    29
    arrow-down
    8
    ·
    25 days ago

    Can’t wait to read about it telling someone to put glue on pizza.

  • Etterra@lemmy.world
    link
    fedilink
    English
    arrow-up
    19
    arrow-down
    1
    ·
    24 days ago

    That’s not what reasoning is. Training is understanding what they’re talking about and being able to draw logical conclusions based on what they’ve learned. It’s being able to say, I didn’t know but wait a second and I’ll look it up," and then summing that info up in original language.

    All Open AI did was make it less stupid and slap a new coat of paint on it, hoping nobody asks too many questions.

    • ours@lemmy.world
      link
      fedilink
      English
      arrow-up
      8
      ·
      24 days ago

      And this is something data scientists have already been doing with existing LLMs.

  • Lucidlethargy@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    12
    ·
    24 days ago

    I think I’ve used it if this is the latest available, and it’s terrible. It keeps feeding me wrong information, and when you correct it, it says you’re right… But if you ask it again, it again feeds you the wrong information.

    • leftzero@lemmynsfw.com
      link
      fedilink
      English
      arrow-up
      5
      arrow-down
      1
      ·
      23 days ago

      if you ask it again, it again feeds you the wrong information

      Well, it’s a LLM, they can’t learn anything without rebuilding the whole model from scratch, which I wouldn’t exactly call learning anyway… all they “know” is what word is most likely to follow a certain sequence of words according to their model.
      Any other facts or information are completely inconsequential for their operation and results.

  • ulkesh@lemmy.world
    link
    fedilink
    English
    arrow-up
    16
    arrow-down
    5
    ·
    24 days ago

    I just love how people seem to want to avoid using the word lie.

    It’s either misinformation, or alternative facts, or hallucinations.

    Granted, a lie does tend to have intent behind it, so with ChatGPT, it’s probably better to say falsehood, instead. But either way, it’s not fact, it’s not truth, and people, especially schools, should stop using it as a credible source.

    • IndustryStandard@lemmy.world
      link
      fedilink
      English
      arrow-up
      20
      arrow-down
      1
      ·
      edit-2
      23 days ago

      Being wrong is not the same as lying. When LLMs start giving wrong answers on purpose to mislead people we would have a big problem.

      • irreticent@lemmy.world
        link
        fedilink
        English
        arrow-up
        1
        ·
        23 days ago

        The thought of a maliciously deceptive AGI is terrifying to me. Many, many people will trust it until it’s too late.

    • JustTesting@lemmy.hogru.ch
      link
      fedilink
      English
      arrow-up
      8
      ·
      23 days ago

      There was a recent paper that argues ‘bullshitting’ is the most apt analogy. I.e. telling something to satisfy the other person without caring about the truth content of what you say

  • LANIK2000@lemmy.world
    link
    fedilink
    English
    arrow-up
    15
    arrow-down
    4
    ·
    edit-2
    24 days ago

    Dang, OpenAI just pulled an Apple. Do something other people have already done with the same results (but importantly before they made a big fuss about it), claim it’s their innovation, give it a bloated name so people imagine it’s more than it is and produce a graph comparing themselves to themselves, hoping nobody will look at the competition.

    Just like Apple, they have their own selling point, but instead they seem to prefer making up stuff while forgetting why people use em.

    On a side note they also pulled an Elon. Where’s my AI companion that can comment on video in realtime and sing to me??? Ya had it “working” “live” a couple months ago, WHERE IS IT?!?

    • Semperverus@lemmy.world
      link
      fedilink
      English
      arrow-up
      2
      ·
      edit-2
      22 days ago

      Meanwhile a bald turtle and his AI anime daughter on twitch can do exactly this, and he’s building her at home on nvidia GPUs.

      (Vedal987 and Neuro-sama, if you’re curious)

    • riodoro1@lemmy.world
      link
      fedilink
      English
      arrow-up
      2
      arrow-down
      7
      ·
      24 days ago

      Pulled an Apple?

      I know you hate apple because android is way better but people loved their ipods, iphones, airpods and apple watches. Sure those things were made before but Apple did make them better. So I don’t know what your point is.

      • LANIK2000@lemmy.world
        link
        fedilink
        English
        arrow-up
        8
        arrow-down
        1
        ·
        edit-2
        24 days ago

        Assuming I’m an android fan for pointing out that Apple does shady PR. I literally mention that Apple devices have their selling point. And it isn’t UNMATCHED PERFORMANCE or CUTTING EDGE TECHNOLOGY as their adds seems to suggest. It’s a polished experience and beautiful presentation; that is unmatched. Unlike the hot mess that is android. Android also has its selling points, but this reply is already getting long. Just wanted to point out your pettiness and unwillingness to read more than a sentence.

  • Chozo@fedia.io
    link
    fedilink
    arrow-up
    28
    arrow-down
    21
    ·
    25 days ago

    Technophobes are trying to downplay this because “AI bad”, but this is actually a pretty significant leap from GPT and we should all be keeping an eye on this, especially those who are acting like this is just more auto-predict. This is a completely different generation process than GPT which is just glorified auto-predict. It’s the difference between learning a language by just reading a lot of books in that language, and learning a language by speaking with people in that language and adjusting based on their feedback until you are fluent.

    If you thought AI comments flooding social media was already bad, it’s soon going to get a lot harder to discern who is real, especially once people get access to a web-connected version of this model.

    • BetaDoggo_@lemmy.world
      link
      fedilink
      English
      arrow-up
      32
      arrow-down
      5
      ·
      edit-2
      25 days ago

      All signs point to this being a finetune of gpt4o with additional chain of thought steps before the final answer. It has exactly the same pitfalls as the existing model (9.11>9.8 tokenization error, failing simple riddles, being unable to assert that the user is wrong, etc.). It’s still a transformer and it’s still next token prediction. They hide the thought steps to mask this fact and to prevent others from benefiting from all of the finetuning data they paid for.

      • Echo Dot@feddit.uk
        link
        fedilink
        English
        arrow-up
        1
        arrow-down
        1
        ·
        24 days ago

        They hide the thought steps to mask this fact and to prevent others from benefiting from all of the finetuning data they paid for.

        Well possibly but they also hide the chain of thought steps because as they point out in their article it needs to be able to think about things outside of what it’s normally allowed allowed to say which obviously means you can’t show the content. If you’re trying to come up with worst case scenarios for a situation you actually have to be able to think about those worst case scenarios

    • Voroxpete@sh.itjust.works
      link
      fedilink
      English
      arrow-up
      14
      arrow-down
      5
      ·
      25 days ago

      It’s weird how so many of these “technophobes” are IT professionals. Crazy that people would line up to go into a profession they so obviously hate and fear.

      • Chozo@fedia.io
        link
        fedilink
        arrow-up
        8
        arrow-down
        3
        ·
        25 days ago

        I’ve worked in tech for 20 years. Luddites are quite common in this field.

        • Voroxpete@sh.itjust.works
          link
          fedilink
          English
          arrow-up
          10
          arrow-down
          6
          ·
          25 days ago

          Read some history mate. The luddites weren’t technophobes either. They hated the way that capitalism was reaping all the rewards of industrializion. They were all for technological advancement, they just wanted it to benefit everyone.

          • Chozo@fedia.io
            link
            fedilink
            arrow-up
            7
            arrow-down
            3
            ·
            25 days ago

            I’m using the current-day usage of the term, but I think you knew that.

    • LANIK2000@lemmy.world
      link
      fedilink
      English
      arrow-up
      2
      ·
      edit-2
      24 days ago

      Big leap for OpenAI, as in a kind of ML model they haven’t explored yet. Not that big for AI in general as others have done the same with similar result. Until they can make graphs where they look exceptionally better compared to other models than their own, it’s not that much of a breakthrough.

  • sinceasdf@lemmy.world
    link
    fedilink
    English
    arrow-up
    22
    arrow-down
    15
    ·
    24 days ago

    Lol Lemmy has the funniest ai haters they drown out any real criticism with stupid strawman nonsense

    • Zos_Kia@lemmynsfw.com
      link
      fedilink
      English
      arrow-up
      11
      arrow-down
      7
      ·
      24 days ago
      • it’s not actually AI
      • it’s just fancy auto complete/ glorified Markov chains
      • it can’t reason it’s just a pLagIaRisM MaChiNe

      Now if I want to win the annoying Lemmy bingo I just need to shill extra hard for more restrictive copyright law!

      • lud@lemm.ee
        link
        fedilink
        English
        arrow-up
        1
        ·
        edit-2
        23 days ago

        Remember the people that cry that copyright is an invention of the devil and how it should be more open*

        *Doesn’t apply to AI of course.