Situational for me.
Anything near the hole I leave. A yellow birch just above my favorite hole has many of my flies in it. I have figured out how to flick the fly off the birch leaves (sometimes) just by using the weight of the line and a gently timed pull. There would be hundreds in the tree if every one got caught.
Away from the hole I may snip a few alders here and there overhead if it frees up my role cast. I usually leave in stream habitat the way it is.