Comment by est
I hope there's some kind of memory-hungry checker to replace the CPU cost.
a 2GB memory consumption wont stop them, but it will limit the parallelism of crawlers.
I hope there's some kind of memory-hungry checker to replace the CPU cost.
a 2GB memory consumption wont stop them, but it will limit the parallelism of crawlers.