You can enable the configuration for Removing old jobs if checked.