Benchmarking Mercury As The "Fastest Firefox Fork" With AVX, AES, LTO + PGO

Written by Michael Larabel in Storage on 22 August 2023 at 11:55 AM EDT. Page 3 of 4. 29 Comments.
Selenium benchmark with settings of Benchmark: Jetstream 2, Browser: Firefox. Firefox 118.0a1 was the fastest.
Selenium benchmark with settings of Benchmark: Jetstream 2, Browser: Firefox. Firefox 118.0a1 was the fastest.
Selenium benchmark with settings of Benchmark: Jetstream 2, Browser: Firefox. Firefox 118.0a1 was the fastest.
Selenium benchmark with settings of Benchmark: Jetstream 2, Browser: Firefox. Firefox 118.0a1 was the fastest.

With the modern JetStream 2.0 benchmark again I wasn't finding any measurable benefits with Mercury 115 compared to upstream Firefox 115, but did continue to be pleased with the direction the performance is moving with Firefox 118.

Selenium benchmark with settings of Benchmark: CanvasMark, Browser: Firefox. Firefox 117.0b8 was the fastest.
Selenium benchmark with settings of Benchmark: CanvasMark, Browser: Firefox. Firefox 117.0b8 was the fastest.
Selenium benchmark with settings of Benchmark: CanvasMark, Browser: Firefox. Firefox 117.0b8 was the fastest.
Selenium benchmark with settings of Benchmark: CanvasMark, Browser: Firefox. Firefox 117.0b8 was the fastest.

With CanvasMark there appears to be a strange -- and severe -- regression with Firefox 118 nightly.

Selenium benchmark with settings of Benchmark: Maze Solver, Browser: Firefox. Firefox 115.0.2 was the fastest.
Selenium benchmark with settings of Benchmark: PSPDFKit WASM, Browser: Firefox. Firefox 117.0b8 was the fastest.
Selenium benchmark with settings of Benchmark: WASM collisionDetection, Browser: Firefox. Firefox 118.0a1 was the fastest.
Selenium benchmark with settings of Benchmark: WASM imageConvolute, Browser: Firefox. Firefox 118.0a1 was the fastest.

With the WebAssembly benchmarks there wasn't much change in performance across the benchmarked browsers when it came to the raw performance.

Selenium benchmark with settings of Benchmark: PSPDFKit WASM, Browser: Firefox. Firefox 117.0b8 was the fastest.
Selenium benchmark with settings of Benchmark: PSPDFKit WASM, Browser: Firefox. Firefox 117.0b8 was the fastest.

But PSPDFKit's WASM benchmark for example was showing lower CPU power consumption and utilization when running with the Firefox 118 alpha state.


Related Articles