Comment by IncreasePosts
Comment by IncreasePosts 19 hours ago
I agree about the importance of that use case, but how do you confirm that the AI doesn't modify the data in some unwarranted manner during the process?
Comment by IncreasePosts 19 hours ago
I agree about the importance of that use case, but how do you confirm that the AI doesn't modify the data in some unwarranted manner during the process?
Sure - I guess what I was asking is how to make sure everything is okay in the unstructured -> structured conversion.
"My name is John and I'm 40 years old" -> {name:"John", age:40}
How can you gain confidence that the AI doesn't spit out {name:"John", age:41}
The only thing I do currently is have a massive test suite to gain some statistical confidence it works, but I worry about situations like a person having a rare unicode character in their name (not to even speak of people intentionally trying to trick the system)
Great question! Don't use AI to process the data, especially when a computer can do the work :-). AI is good at taking unstructured data and structuring it. Computers are great at computing.
Here is an example of Google's AI failing
https://www.google.com/search?q=is+2026+next+year
Google screenshot: https://imgur.com/a/FOT4aDF
ChatGPT also fails: https://imgur.com/a/mb3rRgZ
and here is the ThetaEdge result: https://imgur.com/a/ZAZZgiR