When there are tests errors, by default, the plug-in marks the Build as UNSTABLE. If you check this option, the plug-in will mark the Build as FAILURE.