Comment by saagarjha
Pretty sure CUDA will limit your thread count to hardware constraints? You can’t just request a million threads.
Pretty sure CUDA will limit your thread count to hardware constraints? You can’t just request a million threads.
Thread counts per block are limited to 1024 (unless I’ve missed and change and wikipedia is wrong), but total threads per kernel is 1024(2^32-1)65535*65535 ~= 2^74 threads
https://en.wikipedia.org/wiki/Thread_block_(CUDA_programming...
You can request up to 1024-2048 threads per block depending on the gpu; each SM can execute between 32 and 128 threads at a time! So you can have a lot more threads assigned to an SM than the SM can run at once