Just yesterday we unleashed Phoromatic 1.0 with a horde of improvements to our remote test management system and as part of that introduced the Phoromatic Ubuntu Tracker, which benchmarks Ubuntu on a daily basis looking for performance regressions across multiple systems. Earlier today we then called out for benchmarking requests as what we should track next using our testing and execution framework (so far the likely contender is seeing how Wine's performance is evolving on a per-commit basis, but let us know what you think). Now to end out this week of announcements I have something else to share that's particularly interesting.
With Phoromatic we make it easy to build a test farm for benchmarking and automated regression management and to prove it we began monitoring the Linux kernel performance on a daily basis where we track the performance of the latest Linux kernel code on a daily basis using multiple systems. This has been going on for months and then yesterday we announced that Phoromatic reached a 1.0 status and that we have launched Phoromatic Ubuntu Tracker, a way to monitor the performance of Ubuntu Linux as a whole on a daily basis by benchmarking the most recent development packages. A day has passed so now we are already thinking of what next to add to our test farm for continuous performance tracking.
Following in the success of the Phoronix Test Suite, last month we launched Phoromatic as a remote test management system targeted for enterprise users of the Phoronix Test Suite that allows the automatic scheduling of tests, remote installation of new tests, and the management of multiple test systems all through an intuitive, easy-to-use web interface. Whether you are looking to build a test farm or just benchmark systems around the world, Phoromatic can turn this otherwise taxing work into a really easy process with turn-key deployment capabilities. As an extension of Phoromatic, we then wrote Phoromatic Tracker that is designed to track any software component (either on a timed or per-commit basis) and automatically execute a set of tests each time around all in an autonomous matter and then pump the data back to the Phoromatic server and showcase it on the Phoromatic Tracker interface.
It's been just a month since releasing Phoronix Test Suite 2.4 and that was followed by the release of our PTS Desktop Live 2010.1 operating system, but since then work has been flowing into the next release of the Phoronix Test Suite and related benchmarking technologies. The next release, Phoronix Test Suite 2.6, is codenamed Lyngen and will be officially available in May. Today the first alpha release for Phoronix Test Suite 2.6 is available.
There's a surprising number of people curious about what the Phoronix office looks like from where hardware is tested and the Phoronix Test Suite developed, so here are a few humble photographs from last month that display this area.
For those out there using the Phoronix Test Suite, the first (and likely only) point release for the 2.4 Lenvik release is now available. The 2.4.1 release incorporates a variety of bug-fixes and other work that was back-ported to Lenvik over the past two weeks.
As a reminder, this weekend is the Southern California Linux Expo (SCALE) that is being held in Los Angeles, California. This three day affair that's sponsored by the likes of Google and IBM has a wide array of talks, including one of our own. As the last talk on Saturday for Track C prior to the day's evening reception is a presentation by Matthew Tippett (the former ATI Linux manager) and myself entitled "Five Stages of Benchmark Loss: PTS and You."
One of the most common areas of feedback on Phoronix and also by those using the Phoronix Test Suite has been over the graphs that show our test / benchmark results. They're simple yet effective, however, as of late more parties have become interested in having these graphs display greater detail about the test results and other information. Fortunately, one of the major areas already being planned for Phoronix Test Suite 3.0 (to be introduced by the end of 2010) is a totally overhauled graphing interface.
Phoronix Test Suite 2.4 "Lenvik" was released earlier this month, but the first (and likely only) point release for this major release that brought many changes should be released. Phoronix Test Suite 2.4.1 will consist of various small fixes and cosmetic improvements that have been committed since the 2.4.0 Lenvik release. There may also be a new test profile if AMD commits its new OpenCL test in time.
Phoronix Test Suite 2.4 (codenamed "Lenvik") was released on Tuesday. Since then we have been quite pleased with the adoption of this new quarterly update and the new features and enhancements that it provides. There are also many new uploads on Phoronix Global, new registrations on Phoromatic, etc.
Tomorrow we will be formally releasing Phoronix Test Suite 2.4 "Lenvik" as a quarterly update to our testing software that brings many major improvements. Later this month we will be releasing PTS Desktop Live 2010.1 "Anzhofen" as the second release of our Linux LiveDVD/USB distribution that is designed to carry out Linux benchmarking in a completely standardized software stack. This release is likely coming prior to our benchmarking talk in California. Anzhofen is the successor to PTS Desktop Live 2009.3 "Gernlinden", but for those unfamiliar with our benchmarking OS, here is an excerpt from our documentation:
Since earlier this month I have received at least two dozen emails from individuals looking for a refund on software they claim to have purchased from us... What software? The Phoronix Test Suite, Phoromatic, and other software projects developed by Phoronix Media are free software. All of them claim it's for anti-virus software!
I had intended for Phoronix Test Suite 2.4 Beta 2 to be the last development build for this release codenamed Lenvik, but things have changed. After continuing to do intensive, last minute work on Phoronix Test Suite 2.4 since the Lenvik Beta 2 release four days ago, a third beta has been warranted.
Just a week ago Phoronix Test Suite 2.4 went into beta, but now the second (and potentially last) beta release is available. Phoronix Test Suite 2.4 "Lenvik" brings a multitude of new features that are discussed in various Phoronix articles -- image quality comparison capabilities, support for mobile device/phone platforms, initial Windows support, and literally many other advancements to this benchmarking framework. However, I have decided to hold off on pushing a bulk of the Microsoft Windows 7 support until the Phoronix Test Suite 2.6 cycle at this point in time 2.4 Lenvik is in a rather clean and optimal state so I am pressed to release this major update a bit early.
As the inaugural Phoronix Test Suite release for 2010, we have just released the first beta of the upcoming Phoronix Test Suite 2.4 "Lenvik" milestone. Phoronix Test Suite 2.4 is set to deliver initial Windows support, support for Palm webOS and other mobile devices, new test profiles, image quality comparison support, and many other new features that are detailed in this article.
For those of you attending the Southern California Linux Expo (SCALE) next month in Los Angeles, Matthew Tippett and I will be hosting a talk. This talk is entitled "5 Stages of Benchmark Loss: PTS and You" and, of course, covers the Phoronix Test Suite software and its capabilities and more for autonomously testing Linux and other operating systems.
While I am technically away on a sabbatical that is focused on providing support for Microsoft Windows in the Phoronix Test Suite, which will make PTS the first full-featured, open-source testing framework that is compatible with Linux / BSD / OpenSolaris / OS X / Windows operating systems and its numerous test profiles, work on a new benchmark has also commenced.
Nearly two months ago I showed off the Phoronix Test Suite running on Windows 7 and later confirmed that the first bits of Windows compatibility within this leading open-source testing software would arrive with Phoronix Test Suite 2.4. The Windows 7 support is just the latest that is coming after the Linux, OpenSolaris, Mac OS X, FreeBSD, NetBSD, and OpenBSD operating systems are already well supported.
Last week there was the release of Phoronix Test Suite 2.4 Alpha 2 and that was the last planned development release of "Lenvik" for 2009, but this evening a third alpha release has been made available. Phoronix Test Suite 2.4.0 Alpha 3 doesn't bring anything too exciting for end-users over the second alpha release, but most of the changes are internal to the pts-core benchmarking engine. This third alpha release is being put out in preparation for a big Windows push that will be announced tomorrow and then happen over the coming weeks.
Last week we rolled out Phoromatic Tracker as the public interface to our test farm and with the Phoromatic Tracker launch we made it possible for other projects and companies to build their own performance/regression trackers using our Phoromatic software in conjunction with the Phoronix Test Suite. Our initial reference implementation of Phoromatic Tracker was in the form of our kernel tracker that autonomously benchmarks the latest Linux 2.6 kernel code on a daily basis with about 50 benchmarks.
While the plan was to release PTS Desktop Live 2009.4, the quarterly update to our Linux-based benchmarking operating system from a Live DVD/USB environment, shortly after the release of Phoronix Test Suite 2.2, this has not happened and it is not going to happen. I have decided not to make the release public of PTS Desktop Live 2009.4 (formerly codenamed "Loderhof"). I am just too bottlenecked at the moment and therefore cannot be certain that this OS update will far exceed my own personal goals and expectations for this release. Instead, these efforts will be diverted to ensuring a rock-solid release of PTS Desktop Live 2010.1, which is codenamed Anzhofen.
As of this morning the second alpha release for Phoronix Test Suite 2.4 "Lenvik" is available for PC benchmarking and testing. Phoronix Test Suite 2.4 Alpha 2 brings many changes, including but not limited to, GTK GUI improvements, test result merging improvements, new command options (analyze-image-delta and analyze-linear-tracker), support for soon-to-be-announced Phoromatic features, and many enhancements to bilde_renderer (our image rendering library that's used for generating the JPG/PNG/SVG/SWF graphs) and in particularly vastly improving the SVG renderer back-end.
When shopping online this holiday season, don't forget to use our shopping links (always available from the home-page) for NewEgg and Amazon. Additionally, if you want to get yourself something, consider a Phoronix Premium subscription for yourself that will let you view Phoronix and the Phoronix Forums without any advertisements, are able to view multi-page articles on a single page, and this is also a gift to us (or you can also make a tip/donation in being able to better support all of our Linux hardware efforts (we have some exciting announcements planned for this week!).
Back in October we made it possible to autonomously find performance regressions in a project's code-base by leveraging the Phoronix Test Suite atop Git's bisect command. A new Phoronix Test Suite module was created that would automatically run a binary search on a defined code-base and keep running the specified test(s) on each revision and then traverse to the next using Git bisect until the lone commit causing the defined regression was located. In that article we demonstrated this module by finding the commit that caused a serious performance drop for EXT4 by default in the Linux 2.6.32 kernel. While this feature is great for finding a regression that occurred at some point in the past, with the Phoronix Test Suite you can find regressions nearly in real-time now that Phoromatic is available to the public.
To those of you reading Phoronix that are locating in Japan or Korea, we have a new survey we kindly ask that you take. IDG TechNetwork, which handles the graphics advertising responsibilities for Phoronix.com, is in the process of ramping up their efforts in Japan and Korea. This is a very short survey and can be found on this web-page. The survey is to just collect some statistics about the Phoronix reading population in Korea/Japan so that IDG will be able to better fit some advertising campaigns towards your interests. Thanks for participating.
With many Internet retailers starting their major holiday sales beginning today and tomorrow, if any of your online shopping adventures lead you to Amazon or NewEgg, don't forget to click our affiliate links. Clicking these links will lead you directly to the retailer, and will not take any other effort on your behalf, but will allow our Linux hardware and software efforts to benefit via the retailer paying us a commission. These links can always be found on the home page or they are also listed below.
This week at Phoronix we did our usual roundabout with X.Org / Linux graphics news coverage along with sharing new work on our benchmarking software, and we also broke the news that Samsung is sponsoring the development of Enlightenment. Another popular story was that Fedora 13 may support system rollbacks via Btrfs.
Today marks the two-year anniversary of the creation of Phorogit.com. Phorogit is the Git repository that is sponsored by Phoronix Media to house the development of a few free software projects.
It was just a week ago that we confirmed the Phoronix Test Suite is being ported to Windows, then on Monday delivered Phoronix Test Suite 2.2, and a day after that announced a major advancement for Phoronix Test Suite 2.4 "Lenvik" and that was image quality comparison and analysis support to take our benchmarking software to the next level. Today we are continuing on this roll by announcing the Phoronix Test Suite is coming to mobile phones! To assist those in optimizing their software on mobile phones and devices for not only the pure performance but also matters like monitoring the battery power consumption, the Phoronix Test Suite has made the jump into the mobile space.
Some of the notable news items we covered this week at Phoronix included a new GRUB 2.0 release, Mesa / Gallium3D coming to Android netbooks, exclusive word from a former Namesys employee that Reiser4 may go after mainline Linux inclusion in 2010, GNOME 3.0 being officially delayed to September, and a virtual Gallium3D driver coming for VMware.
542 Phoronix news articles published on Phoronix.