I wouldn't say remove it altogether I think planes crashing is nice feature BUT it would be nice to know where the plane intends on crashing (perhaps a map ping to inform you) so if you are quick enough (or paying enough attention) you are able to attempt to move your unit out of the designated zone. As this is what would typically happen in the real world.
I'm wondering if there's a way they could make it so that it always steers away from any units on the ground, or alternatively (but not as fun) the plane glides off-map before crashing. Lastly and perhaps the best option: make the plane explode once it's about 10 meters off the ground, it'll blow into pieces that'll rain on the earth looking really cool (but since physics objects are cosmetic and just bounce around harmlessly, it won't hurt anyone!).
Side-Note: I miss the Panzerknackers from CoH1 and how when they crashed, they just nose-dived into the ground with the wreckage just like
Relic needs to bring back the Hs 129 for a doctrine, I'm tired of Ju 87's