The Jagdpanzer IV is capable only of fighting vehicles. All the other tank destroyers in the game with that argument have something to make up for it (except the ISU-152 and the Elefant, but who uses those?), be it mobility and good visibility, or be it an ability to self-spot. These points all come with a trade-off of course, with the Jackson being fragile and the SU-85 being slow when spotting for itself.
The Jagdpanzer has neither of those, it can't spot for itself, it isn't mobile, it doesn't have superior range or anything. Instead it has that stealth ability, with the tradeoff being even less mobility.
So a complete removal simply is out of the question, unless the vehicle is reworked to make up for it. What should be done is giving it a longer re-cloak counter and a slightly higher detection radius. Additionally, I would like to see a rework of the ability as a whole, making the vehicle immobile while used, but refraining from adding a cooldown.