“…In particular, the body update region kernels will simply run too fast to hide these costs. We investigated the scaling over 1,2,4,8,10,20,30,40,50,60,70,80,90,100,110,120 GPUs. However, because of the limited memory on each GPU, larger problems cannot run on a smaller number of GPUs.…”