Comment by slg
I don't follow your analogy. Is the "specialized tool" the AI or the way that it returns "problematic" results? Because I'm not saying the system is bad for using negative stereotypes. I'm saying the system is bad because it removes natural variety from the results making them misleading. The reliance on stereotypes are just one example of this phenomenon with another example being "suave English spy" only returning Daniel Craig.
I guess I’m saying that the specific application of stereotypes may be a feature. I don’t think we’ll see a single prevailing winner takes all model, so there is diversity in that respect too. And I think you will even see diversity from a single model. In other words, I don’t think Daniel Craig is the only thing a model will return for “suave english spy”. Just a cheap and easy one.