this post was submitted on 20 May 2025
349 points (99.4% liked)

Technology

70150 readers
3418 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 2 years ago
MODERATORS
 

In 2012, Palantir quietly embedded itself into the daily operations of the New Orleans Police Department. There were no public announcements. No contracts made available to the city council. Instead, the surveillance company partnered with a local nonprofit to sidestep oversight, gaining access to years of arrest records, licenses, addresses, and phone numbers all to build a shadowy predictive policing program.

Palantir’s software mapped webs of human relationships, assigned residents algorithmic “risk scores,” and helped police generate “target lists” all without public knowledge. “We very much like to not be publicly known,” a Palantir engineer wrote in an internal email later obtained by The Verge.

After years spent quietly powering surveillance systems for police departments and federal agencies, the company has rebranded itself as a frontier AI firm, selling machine learning platforms designed for military dominance and geopolitical control.

"AI is not a toy. It is a weapon,” said CEO Alex Karp. “It will be used to kill people.”

you are viewing a single comment's thread
view the rest of the comments
[–] AcidicBasicGlitch@lemm.ee 6 points 14 hours ago (1 children)

Yeah there's already at least one well known case. This article mentions it https://wp.api.aclu.org/press-releases/208236

The use of facial recognition technology by Project NOLA and New Orleans police raises serious concerns regarding misidentifications and the targeting of marginalized communities. Consider Randal Reid, for example. He was wrongfully arrested based on faulty Louisiana facial recognition technology, despite never having set foot in the state. The false match cost him his freedom, his dignity, and thousands of dollars in legal fees. That misidentification happened based on a still image run through a facial recognition search in an investigation; the Project NOLA real-time surveillance system supercharges the risks.

“We cannot ignore the real possibility of this tool being weaponized against marginalized communities, especially immigrants, activists, and others whose only crime is speaking out or challenging government policies. These individuals could be added to Project NOLA's watchlist without the public’s knowledge, and with no accountability or transparency on the part of the police departments

Police use to justify stops and arrests: Alerts are sent directly to a phone app used by officers, enabling immediate stops and detentions based on unverified purported facial recognition matches.

[–] hendrik@palaver.p3x.de 2 points 13 hours ago* (last edited 13 hours ago) (1 children)

I'm looking more for large-scale quantitative numbers. I mean one destroyed life is really bad. But they could argue they'd have saved 30 lives in turn, and then we'd need to discuss how to do the maths on that...

[–] AcidicBasicGlitch@lemm.ee 2 points 8 hours ago (1 children)

Yeah, I am not sure but hopefully somebody has the numbers. That is usually the argument for trampling the constitution.

Hard to say how much has been actually documented bc they've been doing a lot of this stuff off record.

They potentially saved 30000 lives locking up 100 people for crimes committed by somebody else in a states they've never been to and we might not even know about it

[–] hendrik@palaver.p3x.de 2 points 7 hours ago* (last edited 7 hours ago)

Oh well, some people in the USA have a really "interesting" relationship with their own constitution these days... I sometimes feel like explaining it to them. Or what a constitutional republic is.

Yeah, keeping things "off record" is the usual strategy to get away with whatever you wanted.