Apparently having exactly 256 sprites (or a multiple of 256) causes an internal sprite counter to overflow and become 0, and as a result not load any sprites properly.
Now it'll only break if you somehow reached 65536 sprites. (or a multiple! :P )