253

cross-posted from: https://lemmy.world/post/45309948

**

90% of the time right means 10% of the time wrong, huge deal when you deal with billions of queries! **

you are viewing a single comment's thread
view the rest of the comments
[-] Fondots@lemmy.world 24 points 1 day ago

I work in a 911 dispatch center, one time I had someone from the police in one town, let's call it Townsville, trying to get ahold of an officer from another town in our county, Citysburg.

I go to put a phone call request in for them, and ask what it's regarding, and they say it's about an incident that happened at the Mega Lo Mart in Citysburg.

There is no Mega Lo Mart in Citysburg, but there are a couple in nearby towns, some of them have Citysburg mailing addresses, or people might casually say that they're in Citysburg because they don't really know where the borders are, this is pretty common and we deal with it a lot, so I ask if they have the address to make sure that I'm getting them in contact with the police department that actually covers that store.

They spit out an address like 123 Main St in East Jabip

East Jabip isn't in our county, I'd never even heard of that town before. I punch it into Google maps, it's like 2 or 3 hours away from us and sure enough there is a Walmart at that address there.

So to make sure I wasn't missing something, I asked why they wanted to speak with Citysburg police if the incident happened in East Jabip.

And they reply "yeah, I'd never heard of east Jabip either, so I punched the address into Google and the AI told me that it was in Citysburg"

Just blatantly false, AI-hallucinated bullshit.

And our cops (or their office staff, can't remember who exactly it came from) just blindly believed it and didn't bother to verify it at all.

And Citysburg isn't some nowhere town, we're a fairly dense suburban county, these two towns are maybe about a 20 minute drive from each other if traffic cooperates, and Citysburg is our county seat, cops from all over the county are there all the time for court and such and the surrounding areas, they should know that area at least well enough to know that East Jabip isn't there

And they even admitted that it didn't sound right to them, but they still went ahead with it and didn't question the AI.

And luckily this wasn't for anything too urgent, it was for credit card fraud or something along those lines. But actual emergencies get called into us all kinds of bass-ackwards ways like someone in another state calls their mom who lives here who calls her local police who transfer her to us so that we can transfer her to the police where the person who's actually having an emergency is.

That kind of stuff happens pretty frequently by the way, that's not some bullshit scenario I'm making up, I get that probably on a weekly basis.

And so it burns me up thinking that if there had been an actual emergency, having to sort out this bullshit could have caused delays in getting help to someone who needed it because someone outsourced their thinking to a shitty AI

[-] madeindex@lemmy.world 3 points 1 day ago

And luckily this wasn’t for anything too urgent, it was for credit card fraud or something along those lines. But actual emergencies get called into us all kinds of bass-ackwards ways like someone in another state calls their mom who lives here who calls her local police who transfer her to us so that we can transfer her to the police where the person who’s actually having an emergency is.

Thank you for giving us so much insight and taking the time to explain the background! I haven't even considered this kind of scenario, I mean this sounds like a patter and something that might even increase as more people rely on bad AI. Can you maybe raise this issue with a higher up office? Also thank you for the important work you are doing, if I had an emergency, I would hope somebody considerate like you is on the other end! :)

[-] Fondots@lemmy.world 1 points 14 hours ago

It hasn't become a pattern yet, at least not in my area, but I'm sure it's not gonna be the last call I handle where bad AI info is gonna be a problem somehow

I did mention it to my supervisor, and did my best to politely and professionally chew the cop out for blindly trusting the AI search results.

We've already had plenty of experience sorting out issues where addresses and such that people got from Google maps or whatever don't match up with reality, but we're pretty good at catching that kind of stuff and figuring it out.

As far as getting calls passed along to us in weird ways, unfortunately I think the only solution for that is for people to just suck it up and call 911 on their own instead of calling their mom. With a few exceptions for VoIP phones and such, if you call 911, it's going to your local dispatch center wherever you're located, and we hopefully have some kind of approximate location for you. The amount of times I've had to play 20 questions with a 3rd party caller who has no clue about what's going on for something I could have cleared up in about 30 seconds if someone had just called themselves is pretty insane.

And even if you do have to be that 3rd party making a call for someone somewhere else, calling 911 is probably going to be your fastest way to get there. It can be weirdly hard to find a good number for local police sometimes, but most 911 centers have access to some database or service to find the right contact info faster than you probably would googling it (I've gotten calls come into me for towns in other states or even other countries, because they had the same or similar names to ones in our area, and the caller didn't double check that they were calling for the right Townsville)

Although, I will say, some 911 centers are pretty terrible. One that borders my county has a bad habit of transferring any calls for something that isn't in their area to us, either because they didn't bother to verify the location, or because they just can't be bothered to look up the information themselves and they know we'll do it for them. Occasionally they even transfer us calls that they should have kept themselves and I have to transfer a really frustrated caller back to them.

That's another thing my higher-ups are aware of and working on.

[-] regedit@lemmy.zip 3 points 1 day ago

Boomers have some of the highest lead levels of any currently living generations. They are also, on average, very gullible. Them holding positions of power, during genAI startup, is why ICE was arresting citizens, with multiple forms of ID, because an app told them the person was someone else. They are told to believe the tech and they don't question it because they don't question anything someone with authority tells them.

[-] Fondots@lemmy.world 2 points 14 hours ago

As much as I'm happy to blame boomers

The youngest boomers are in their 60s now, not too many of them are out working as any kind of field agent. Most of those assholes out there now are Gen X, Millennials, or even Gen Z.

There have been some changes under this administration, and I don't know what the current "rules" are (as if they care about following rules anyway) but I know at one point there was actually a mandatory retirement age for federal LEOs, and I'm pretty sure it was at about 55 or 60, so under those old rules you couldn't be an ice agent as a boomer. Some probably hung around in admin positions and such, and since the rule changes I'm sure a couple have come out of retirement, but I'm pretty confident that that's a vast minority.

The issues with not questioning authority, gullibility, tech-illiteracy, etc. remain though.

this post was submitted on 07 Apr 2026
253 points (100.0% liked)

News

37047 readers
2472 users here now

Welcome to the News community!

Rules:

1. Be civil


Attack the argument, not the person. No racism/sexism/bigotry. Good faith argumentation only. This includes accusing another user of being a bot or paid actor. Trolling is uncivil and is grounds for removal and/or a community ban. Do not respond to rule-breaking content; report it and move on.


2. All posts should contain a source (url) that is as reliable and unbiased as possible and must only contain one link.


Obvious biased sources will be removed at the mods’ discretion. Supporting links can be added in comments or posted separately but not to the post body. Sources may be checked for reliability using Wikipedia, MBFC, AdFontes, GroundNews, etc.


3. No bots, spam or self-promotion.


Only approved bots, which follow the guidelines for bots set by the instance, are allowed.


4. Post titles should be the same as the article used as source. Clickbait titles may be removed.


Posts which titles don’t match the source may be removed. If the site changed their headline, we may ask you to update the post title. Clickbait titles use hyperbolic language and do not accurately describe the article content. When necessary, post titles may be edited, clearly marked with [brackets], but may never be used to editorialize or comment on the content.


5. Only recent news is allowed.


Posts must be news from the most recent 30 days.


6. All posts must be news articles.


No opinion pieces, Listicles, editorials, videos, blogs, press releases, or celebrity gossip will be allowed. All posts will be judged on a case-by-case basis. Mods may use discretion to pre-approve videos or press releases from highly credible sources that provide unique, newsworthy content not available or possible in another format.


7. No duplicate posts.


If an article has already been posted, it will be removed. Different articles reporting on the same subject are permitted. If the post that matches your post is very old, we refer you to rule 5.


8. Misinformation is prohibited.


Misinformation / propaganda is strictly prohibited. Any comment or post containing or linking to misinformation will be removed. If you feel that your post has been removed in error, credible sources must be provided.


9. No link shorteners or news aggregators.


All posts must link to original article sources. You may include archival links in the post description. News aggregators such as Yahoo, Google, Hacker News, etc. should be avoided in favor of the original source link. Newswire services such as AP, Reuters, or AFP, are frequently republished and may be shared from other credible sources.


10. Don't copy entire article in your post body


For copyright reasons, you are not allowed to copy an entire article into your post body. This is an instance wide rule, that is strictly enforced in this community.

founded 2 years ago
MODERATORS