Quick update: It seems Delphi has a $SetPEFlags directive for setting the PE flags! Was searching for this for some time now.

Now I can add a: {$SetPEFlags IMAGE_FILE_UP_SYSTEM_ONLY} flag so that windows only assigns a single core to the program.