When checked, GitHub Pull Request Builder will try to add comment with results if updating commit status fails. This can happen when user doesn't have push rights for your repository.