PluginTests.com will automatically test every new revision (except tags) that you commit to the WordPress.org plugin repository. You can also trigger tests manually.
Only applies to your own repositories.
Get test reports as JSON, and a few more things.
When there are many pending tests, plugins that have been claimed or added by registered users will be tested before other plugins.