os-test

os-test is a set of test suites for POSIX operating systems designed to make it easy to compare differences between operating systems and to find operating system bugs. It consists of test suites that focus on different operating system areas.

This page visualizes the results for the POSIX operating systems that are relevant today.

os-test has been generously funded by the Next Generation Internet Zero Commons fund managed by the NLnet Foundation.

Source Code

The os-test source code is available on gitlab. You also can view the source code for each test by clicking the test title in the leftmost entry of each row. os-test is licensed under the ISC license, see the LICENSE file in the source code for details.

Please feel free to contribute more tests and suites and I'll be happy to run them on every operating system and publish the data.

Setup

I run os-test on my host Linux system; AIX, macOS, and Solaris are graciously provided by cfarm; and the rest of the systems run in qemu virtual machines. The testing harness connects to each machine over ssh and runs tests there. The systems are:

• AIX
• DragonFly
• FreeBSD
• Haiku
• Hurd
• Linux
• macOS
• Minix
• NetBSD
• OmniOS
• OpenBSD
• Solaris
• Sortix

I'm still looking for access to Integrity, LynxOS, HP-UX, OpenServer, QNX, UnixWare, VxWorks, and z/OS systems, or any other relevant maintained POSIX systems with a sshd port. Please get in touch if you can help.

Suites

os-test currently contains these suites:

• io - This suite tests input/output system calls.
• malloc - This suite tests memory allocation.
• process - This suite tests process system calls.
• pty - This suite tests pseudoterminals.
• signal - This suite tests signal system calls.
• udp - This suite tests the UDP stack.

Results