In 2023 and 2024, Flock sent 1,427 alerts to the Roseville [CA] Police Department.

Roseville police found that Flock misread license plates in 71% of those alerts.

Max Isaacs, director of technology law and policy with the Policing Project at New York University's School of Law, described Roseville's misread data as "stunning."

"A 71% misread rate is really beyond the pale," he told Business Insider, referring to Roseville's reported error rate for stolen and felony vehicle alerts. He added that "in the absence of concrete rules that directly address the problem of misreads, this technology is not safe to be deployed in communities."

top 50 comments

sorted by: hot top controversial new old
[–] 81 points 2 weeks ago* (15 children)

How can they suck that bad? A 29€ raspberry pi with a basic ML model can get 90% accurate results

  • source
  • hideshow 18 child comments
  • [–] 51 points 2 weeks ago (2 children)

    That's probably exactly what they did, deployed a sbc + some off the shelf model and increased the price 300x by making a black plastic shell.

  • source
  • parent
  • hideshow 4 child comments
  • [–] 12 points 2 weeks ago (10 children)

    I guess that they are implementing crappy cameras? Not sure about american plates, but in most jurisdictions licence plates are optimized for easy OCR:

    Note how each letter is unique and can't be transformed with a sharpie into another. That also makes OCR easy. If you use a crappy dashcam, you will get problems regardless. Esp. in low light situations at higher speeds.

    So I would guess that Flock uses cheap sensors and cheap lenses. Which kind of makes sense when they are putting out thousands of scanners.

  • source
  • parent
  • hideshow 15 child comments
  • [–] 2 points 2 weeks ago (1 child)

    Not sure about american plates, but in most jurisdictions licence plates are optimized for easy OCR:

    Are they? Off the top of my head Germany is the only country I can think of that uses such a font (FE-Schrift).

  • source
  • parent
  • hideshow 2 child comments
  • load more comments (5 replies)
  • [–] 11 points 2 weeks ago

    If you have a million stolen licenses, but on the road remain very few, say 1k. While there are say 100m other cars. If you now have 99% accuracy, you will read 990 stolen cars, and misread 1m plates. Since 1% of plates are stolen, you randomly hit 10k of those misreads into a stolen plate.

    This is generally alwayd an issue with rolling out mass tests. If the thing you search is even rarer than your failure rate, most detections are errors no matter how good your test.

    This is why we don't just test everyone for diseases all the time even when it would be very cheap and simple.

  • source
  • parent
  • load more comments (12 replies)
    [–] 43 points 2 weeks ago (9 children)

    If it's the responsibility of the party that's been misidenified to correct the mistake, this was intentional. Putting fines to random people, knowing a proportion won't fight it, is a foundationional pillar of Authoritarianism. What's worse is even more work will now need to be done to undo and correc this, because it's already in place. The lawmakers will try to get the percentage up, instead of removing the system.

  • source
  • hideshow 9 child comments
  • load more comments (9 replies)
    [–] 20 points 2 weeks ago

    For a Trump admin approved device, we're all shocked it read that well

  • source
  • [–] 20 points 2 weeks ago (1 child)

    I hope this results in their evidence being inadmissible to judges/juries.

    If you're ever on a jury remember this

  • source
  • hideshow 2 child comments
  • [–] 19 points 2 weeks ago (3 children)

    I live in a relatively small mountain town near that City and the wonderful citizens of my town have taken a liking to absolutely fucking destroying those things to the point where we're having a city hall thing on the 10th so that everybody can air their complaints.

  • source
  • hideshow 6 child comments
  • [–] 19 points 2 weeks ago (3 children)

    On one hand that's a good thing.

  • source
  • hideshow 5 child comments
  • [–] 16 points 2 weeks ago (2 children)

    But on the other its not, as it can cause someone else with a similar plate number to be accused of a crime or infraction, etc that another committed.

  • source
  • parent
  • hideshow 4 child comments
  • [–] 14 points 2 weeks ago (2 children)

    Yup, just read an article about that the other day. They even acknowledged it was going to keep happening to the person whose vehicle was mistakenly flagged because of a partial ID match, and just advised him to keep the car at home until they figured out how to fix it. In his case it wasn't as big a deal since it was a rental, but can you imagine being told to not drive your own fucking car or the cops will be automatically called to come pull you over as a carjacker??

  • source
  • parent
  • hideshow 4 child comments
  • [–] 7 points 2 weeks ago* (last edited 2 weeks ago) (1 child)

    Dozens of times so far. And the perpetrators point at each other, or simply refuse to acknowledge wrongdoing.

    Edit: found the story I was thinking of! This guy was wrongfully added to these lists, and the sheriff only removed him locally after the news stated investigating. And that's only for one county, so the problem will repeat if he drives to a different county.

  • source
  • parent
  • hideshow 1 child comment
  • load more comments (1 reply)
  • load more comments (1 reply)
    [–] 13 points 2 weeks ago* (1 child)
    • True Positives (TP) 415
    • False Positives (FP) 1,012
    • False Negatives (FN) (Calculated using 96% Recall) 17 Target plates that were missed.
    • Precision TP / (TP + FP) 29.1% When it hits, it's wrong most of the time.
    • Recall (Assumed from Global Acc.) 96.0% It successfully catches almost all targets.

    That's the problem if you are fishing for a very small number of targets out of an absolutely bonkers large pool of potential targets - at some point your false positives start becoming more and more prevalent than actual positives. That is simply statistics and if flock can't improve the global accuracy by some exponents, this problem will grow.

  • source
  • hideshow 2 child comments
  • [–] 9 points 2 weeks ago

    this technology is not safe to be deployed in communities

    The main point for AI

  • source
  • [–] 7 points 2 weeks ago

    Yay! Great investment. Totally worth the buck.

  • source
  • [–] 6 points 2 weeks ago

    I'm pretty sure I could do better stoned. I mean, I'm typing with a much higher accuracy than 71%, and I'm stoned right now.

  • source
  • load more comments
    view more: next ›