I have some workspaces that are large and have too many lists/tables etc. These will not run with Feature Caching enabled - as they will use 20+ hours. Without it, its done in less than 1 hour.
Other workspaces I like to have Feature Caching enabled, and I easily forget to switch back.
Make a parameter - similar to Rejected Feature Handling - that is "per workspace". For instance:
Feature Caching: Enabled / disabled