And I saw talk about SGI having a computer with 1024 cpus that Linux runs on. That computer is quite special, it behaves like PCs on a network, it is not a single computer. It has something like 128 nodes, and all benchmarks always are using 128 instances of the work load, one for each node. Basically, it is just a cluster, some PCs on a fast switch. Here is more technical information on the SGI computer:
If you dont understand what he is talking about, it is ok. But try, and you will see why all SGI benchmarks always are parallell tasks that would equally be good in a cluster with 1024 cpus. This is not a vertical scaling machine.