In newer version of Solidworks template there seems to be a setting that makes every feature have a color:

In older versions features had no appearance by default, and I would prefer this behavior.

Is there any way to achieve this?

At the moment:

I can delete the appearance of each feature (time consuming)

Or set "Ignore feature colors" on in template, but turning this on means if I want to have a feature with a different color this needs to be manually set to be off and any other features need to have colors removed.