Or if the card has something way overkill, like anything above 512mb, why would it be a bad idea to use it for swap?

(ref overkill for my uses, my display is 1600x900)