https://futurism.com/the-byte/government-ai-worse-summarizing

The upshot: these AI summaries were so bad that the assessors agreed that using them could require more work down the line, because of the amount of fact-checking they require. If that’s the case, then the purported upsides of using the technology — cost-cutting and time-saving — are seriously called into question.

  • DPRK_Chopra [comrade/them]@hexbear.net
    link
    fedilink
    English
    arrow-up
    0
    ·
    14 days ago

    I didn’t mention marketing, I’m talking about benchmarks. Benchmarks designed to test the machine’s abilities to perform reasoning like humans. And they’re being improved on constantly. Sorry if that rubs ya the wrong way.

    • UlyssesT [he/him]@hexbear.net
      link
      fedilink
      English
      arrow-up
      0
      ·
      edit-2
      14 days ago

      I didn’t mention marketing

      That’s too bad, because “AI” as it stands, and what is branded as “AI,” is not what it claims to be on the label. There are certainly scientific efforts underway to make rudimentary versions of that, but large language models and related technology simply isn’t it, and to believe otherwise is marketing, whether you accept it or not.

      Benchmarks designed to test the machine’s abilities to perform reasoning like humans. And they’re being improved on constantly

      Again, you’re believing in the marketing.

      https://bigthink.com/the-future/artificial-general-intelligence-true-ai/

      https://time.com/collection/time100-voices/6980134/ai-llm-not-sentient/

      Sorry if that rubs ya the wrong way.

      You’re not sorry, this isn’t /r/Futurology or /r/Singularity, and the smuglord closer to your post only makes it worse.

      • DPRK_Chopra [comrade/them]@hexbear.net
        link
        fedilink
        English
        arrow-up
        0
        ·
        edit-2
        14 days ago

        You seem to have a kind of “head in the sand” approach to this (I get it, we have to protect our egos). Maybe educate yourself on what some of the research in this field looks like.

        Here’s a list of a lot of the common benchmarks that are used by researchers all over the world, and have nothing to do with Sam Altman trying to hype OpenAI’s stock price or whatever the latest late stage capitalist shenanigans are in the business world.

        • MMLU (Massive Multitask Language Understanding)
        • TruthfulQA
        • HellaSwag
        • ARC (AI2 Reasoning Challenge)
        • Winogrande
        • BIG-Bench Hard
        • GSM8K (Grade School Math 8K)
        • HumanEval
        • MBPP (Mostly Basic Programming Problems)
        • CodeXGLUE
        • Chatbot Arena
        • MT-Bench

        I know some people are, but I’m not saying these things are sentient (nice Time link tho lmao). This is a massive leap in logic that you are making. I’m saying, these models are way better at taking standardized tests and shit than they were even months ago and that has implications for labor.

        Honestly you sound scared about this stuff.

        • UlyssesT [he/him]@hexbear.net
          link
          fedilink
          English
          arrow-up
          0
          ·
          edit-2
          14 days ago

          You seem to have a kind of “head in the sand” approach to this

          Even more smuglord and there’s so much more text to read. Here we go.

          (I get it, we have to protect our egos)

          Maybe educate yourself on what some of the research in this field looks like.

          Maybe stop ignoring entire fields of research that, to this date, are still figuring out what biological brains are doing and how they are doing them instead of just nodding along to what you already want to believe from people that have blinders for anything outside of their field (computers, in this case). It’s a case of someone with a hammer seeing everything as a nail, and you buying into that.

          Honestly you sound scared about this stuff.

          More like tired. If you weren’t so religiously defensive about the apparent advent of whatever you’re hoping for, you’d know that I have on many occasions stated that artificial intelligence is possible and may even be achieved within current lifetimes, but reiterating and refining the currently hyped “AI” product simply isn’t it.

          It’s like if people were trying to develop rocketry to achieve space travel, but you and yours were smugly stating that this particularly sharp knife will cut the heavens open, just you wait.

          • DPRK_Chopra [comrade/them]@hexbear.net
            link
            fedilink
            English
            arrow-up
            0
            ·
            14 days ago

            religiously defensive

            I respect you, but I think you have a hard time separating the players (silicon valley, redditor incels, marketers, hype men) from the game (real science that is getting done that is interesting and miles beyond where were were last year).

            I’m not talking about biology or anything else. Just pointing out that if this train keeps moving at it’s current pace, we’re in for a massive upheaval. I’m not hoping for anything or pushing an agenda. Honestly the best case probably would be if a lot of the detractors are right, and this tech stagnates or plateaus in some way to give society time to adjust a bit. Or to imagine a world where you don’t die if you don’t have a job. I personally don’t have reason to believe it will stagnate, and am preparing for it not to.

              • DPRK_Chopra [comrade/them]@hexbear.net
                link
                fedilink
                English
                arrow-up
                0
                ·
                14 days ago

                Preparing my life to change from unemployment mostly. Paying off debts, figuring out how to best allocate the cash flow I currently have into some kind of durable savings. Making connections in my community and continuing to learn to grow my own food. General materialist / “prepper” fare honestly. Useful for any existential collapse, automation being just one of many scenarios.

                • BodyBySisyphus [he/him]@hexbear.net
                  link
                  fedilink
                  English
                  arrow-up
                  0
                  ·
                  12 days ago

                  I’ve been thinking about this comment a lot over the last couple of days. I do my research in agriculture and food systems so I’ve had a lot of exposure to the “future is rural” philosophy, but it’s mainly in the context of climate change. It seems like anyone talking sense about the trajectory our society is on is quietly buying small plots of land for smallholder agriculture or posting about how farms are probably going to stop supplying food systems and start focusing on meeting their own needs as conditions get less hospitable. It’s interesting to consider that there’s a convergent response emerging as a result of automation.

                  Meanwhile I’m sitting here on my small expensive urban plot that couldn’t sustain more than some summer vegetables because I thought I’d get bored doing actual agriculture blob-no-thoughts

                  • DPRK_Chopra [comrade/them]@hexbear.net
                    link
                    fedilink
                    English
                    arrow-up
                    1
                    ·
                    12 days ago

                    I’m not as worried about the food production stuff as some others. It hasn’t been profitable to make market gardening or small scale farming a viable career for a long time for most people. Because of that we haven’t seen as much focus on local farming as we need. Yet. We all know that’s going to start changing rapidly soon.

                    A single person can grow loads of potatoes in a pretty small area. My only issue, especially for other leftists is that the skills to do so might take you a few seasons to acquire. So get out there and start growing. If you haven’t yet, it’s kind of a bad time in North America, but read up on it this winter and try to grow some taters starting next spring. Use containers or whatever you can get your hands on for your context.

                    I don’t know that we’ll start starving anytime soon, but I think the cost of everything will make life unbearable, and when it does, people will suddenly discover their green thumbs like in the old days.