Are the outstanding delays still executed when a flow is deactivated?

Yes. If delays are stored in a flow, they will still be executed even if the flow is inactive. Option 1 Delete the flow entirely instead of just deactivating it.

Option 2
Manually delete the outstanding delays that are no longer required under ‘Settings > Extensions > Flow Builder Delay > Flow Builder Delay’.