PTS doesn't have the ability to run multiple benchmarks at once (a sort of on the fly suite), but creating your own suite is pretty simple. Just copy the universe-cli.xml file in pts/test-suites and adapt it to your needs. You may need to look at some of the test profile xml files to work out what test arguments to use.