Are the outstanding delays still executed when a flow is deactivated?
Yes. If delays are stored in a flow, they will still be executed even if the flow is inactive.
Option 1
Delete the flow entirely instead of just deactivating it.
Option 2
Manually delete the outstanding delays that are no longer required under ‘Settings > Extensions > Flow Builder Delay > Flow Builder Delay’.