You are changing how the recording sounds on that speaker by adding more Bass or low end. It’d be like if you still had an equalizer and moved the low all the way up but left the mod and high channels regular. If you are in a situation that doesn’t offer optimal listening then I think it’s ok to do this so you might enjoy some of the low end that is typically missing on regular speakers. The other side is all speakers are tuned slightly differently and most of them favor the middle channel because that’s the vocal range channel. Especially mass market portable speakers... they expect mostly pop music so they are tuned for that type. BEATS changed the game in a way by offereing speakers that were tuned for sub bass. Sennheiser offers the most optimal listening experience imo.
I keep this bullshit off. The hard part is when you turn it on the music sounds, in my experience, so much more impressive and powerful that it's a hard drug to quit. But, also in my experience, dynamics and precision suffer and my ears are more easily fatigued by the choons.