16
submitted 1 day ago by nerdhd@lemmy.world to c/asklemmy@lemmy.ml

I genuinely believed that AI this capable wouldn't be feasible in my lifetime.

you are viewing a single comment's thread
view the rest of the comments
[-] RamRabbit@lemmy.world 32 points 1 day ago* (last edited 1 day ago)

Anytime I ask it about things I'm knowledgeable about, it falls on it's face. It only seems smart on topics I don't know shit about (this red flag has spotlights on it!). Given this, I cannot trust it on anything lest I be led down false paths. Given how LLMs work, I don't see this problem as fixable.

I have found them useful for search term generation. (Using a topic I know things about) If I need a more powerful drill for screwing lag bolts into hardwood and I'm not finding what I need, asking it and and getting back the keyword 'impact driver' is helpful, as it lets me go search for what that is and if it is the solution to my need for a more powerful drill. Note: I do not let it teach me about impact drivers (as it falls on it's face all the fucking time), only use it to get the keyword to then use to search the internet.

To circle back to your question, I'm not scared with how fast they are advancing. I'm scared by how many people think they are good at everything and put them in places they don't belong.

[-] bridgeenjoyer@sh.itjust.works 8 points 1 day ago

Exactly. If it only "seems smart on topics I don't know shit about" thats a massive red flag.

I'll keep thinking for myself while the masses get dumber.

[-] lost_faith@lemmy.ca 2 points 1 day ago

Hello Mr. Sure

[-] Kronusdark@lemmy.world 5 points 1 day ago

I have to use AI tools for my work, so arguably I am knowledgeable about that topic (programming). I have seen Claude code do pretty good work. HUGE CAVEAT it works well because we spent a lot of time building out our architecure and the really complex parts have an easy to follow pattern. It’s standing on the backs of giants.

If you do something like software engineering and you have a significant body of existing good work for it to pull from. Claude can be pretty exceptional.

It’s not great at breaking new ground though.

[-] eldavi@lemmy.ml 3 points 1 day ago* (last edited 1 day ago)

If you do something like software engineering and you have a significant body of existing good work for it to pull from. Claude can be pretty exceptional.

the fresh grad new hires at my last place were able to code circles around me because of their embrace of ai and it made me think that i was already a dinosaur and became the biggest reason why i went back into IT.

It’s not great at breaking new ground though.

but watching the soon-to-be grads w a similar embrace fall flat on their faces repeatedly because the codebase at my new place hasn't been updated in almost 15 years and was created by their fellow students, has made me realize that this is also true.

still though, if you know what you're doing; ai is a pretty decent idea/concept generator and sounding board if all but one of your colleagues are students, so you don't have anyone else to ask like it is in my present situation.

[-] locuester@lemmy.zip 1 points 1 day ago

Anytime I ask it about things I'm knowledgeable about, it falls on it's face.

How long ago did you try?! Have an example?

LLMs now search the web and compile results and info very fast. They do exactly what I’ve been doing for decades, searching and skimming results.

If you ask one “I need a more powerful drill for screwing lag bolts into hardwood” it’ll toss you a whole write up on things.

[-] RamRabbit@lemmy.world 7 points 1 day ago* (last edited 1 day ago)

How long ago did you try?! Have an example?

I expected it to get this one wrong and it did; I expected that as Hollywood portrays this wrong and people don't have an intuitive understanding of missile rocketry. Interceptor missiles only burn for a few seconds, get going very fast, then coast to their target. It is just flat wrong here.

I then fixed my grammar mistake and asked again, and poof, 100% opposite answer. I literally got the OPPOSITE ANSWER just because I fixed a grammar mistake. This fundamentally cannot be trusted for actual learning.

[-] locuester@lemmy.zip 2 points 1 day ago

I see. It definitely gets thrown off by the perceived confidence in the question, which is made to steer it toward a wrong response. It’s training data likely has far less instances of text that derails the question based on incorrect original assumptions.

Thanks for the response!

this post was submitted on 19 May 2026
16 points (100.0% liked)

Asklemmy

54370 readers
319 users here now

A loosely moderated place to ask open-ended questions

Search asklemmy 🔍

If your post meets the following criteria, it's welcome here!

  1. Open-ended question
  2. Not offensive: at this point, we do not have the bandwidth to moderate overtly political discussions. Assume best intent and be excellent to each other.
  3. Not regarding using or support for Lemmy: context, see the list of support communities and tools for finding communities below
  4. Not ad nauseam inducing: please make sure it is a question that would be new to most members
  5. An actual topic of discussion

Looking for support?

Looking for a community?

~Icon~ ~by~ ~@Double_A@discuss.tchncs.de~

founded 7 years ago
MODERATORS