Comment by jncfhnb

Comment by jncfhnb 6 months ago

14 replies

I would challenge you to find a picture of text that you think a human can read and OCR cannot. I’m happy to demonstrate. The text shown in this article is trivial.

demosthanos 6 months ago

The archivists themselves say that they run into such texts often enough that this program was needed:

> The agency uses artificial intelligence and a technology known as optical character recognition to extract text from historical documents. But these methods don’t always work, and they aren’t always accurate.

They are absolutely aware of the advances in these tools, so if they say they're not completely there yet I believe them. One likely reason is that the models probably have less 1800s-era cursive in their training set than they do modern cursive.

It's likely that with more human-tagged data they could improve on the state of the art for OCR, but it's pretty arrogant to doubt the agency in charge of this sort of thing when they say the tech isn't there yet.

  • tedunangst 6 months ago

    Can someone please post a sample of one of these images that can only be read by a human for us naive OCR believers to see?

    • CamperBob2 6 months ago

      To be fair there was a similar discussion a few days ago in which an SME remained unconvinced: https://news.ycombinator.com/item?id=42566391

      I don't necessarily agree with her conclusion because she wasn't participating directly in the thread and wasn't completely responsive to some of the points raised, but still, it appears that there are a few instances of difficult-to-read handwriting where OCR is still coming in second to skilled human interpretation.

      • jncfhnb 6 months ago

        That’s comprehension of English not reading characters

    • BugsJustFindMe 6 months ago

      I've posted these above, but I'll give you your own copy because the bits are free. Does your OCR work on these? Mine sadly doesn't. But if yours does, then I'll switch to it.

      https://imgur.com/a/CDU6Lgs

      • jncfhnb 6 months ago

        The problem statement was text that random humans can read and OCR cannot.

        If you want to provide a good faith answer at least make it English. I assume this is French but it’s obviously much harder to evaluate on both ends when you’re mixing up the language.

        • BugsJustFindMe 6 months ago

          I'm confused.

          Which parts of "OCR" and "human" stand for "modern english"?

          Are you suggesting that humans can't read or write in french? Because I can point to a lot of them who would disagree.

  • jncfhnb 6 months ago

    Then please provide a single example that we can’t instantly solve. Happy to prove them wrong.

AdieuToLogic 6 months ago

> I would challenge you to find a picture of text that you think a human can read and OCR cannot.

Are you aware of CAPTCHA[0] images?

0 - https://en.wikipedia.org/wiki/CAPTCHA

  • jncfhnb 6 months ago

    Text that is _intentionally constructed_ to fool computers but not humans is obviously out of scope. But they’re generally easily solved with OCR these days anyway.

  • jahewson 6 months ago
    • AdieuToLogic 6 months ago

      > Solvable with the right tools.

      The original assertion was:

        I would challenge you to find a picture of text
        that you think a human can read and OCR cannot.
      
      Not if many CAPTCHA image challenges could be automated. Unless the tool referenced guarantees 100% correct solutions for all manipulated text images.
      • CamperBob2 6 months ago

        The AI models are now better at CAPTCHAs than I am, for both text- and image-based questions. But when confronted with a CAPTCHA, humans work for free, and the models don't. :(

        As long as that's the case, CAPTCHAs probably won't be considered truly obsolete.

BugsJustFindMe 6 months ago

Yeah ok, but it might take me a few tries because I don't know what you're using. I hope that's agreeable?

What does your OCR say that these say? The first one isn't too hard for a human (assuming appropriate language skill). The second one is a bit more difficult.

https://imgur.com/a/CDU6Lgs