Comment by dekhn

(as an aside, this is a common thing that comes up when you have a good model: do you make a server that allows people to do one-off or small-scale predictions, or do you take a whole query set and run it in batch and save the results in a database; this comes up a lot)