Using video memory as swap is straightforward: http://en.gentoo-wiki.com/wiki/Using...Memory_as_Swap

This is somewhat popular with Playstation 3 Linux users, as you have 256 MB RAM + 256 MB video memory there. Unfortunately, data transfer from video memory to the CPU is slow on the PS3.