It seems like a more ideal method, than removing the option, is to make it so an "age-restricted" or "explicit" server should only allow for toggling channels NSFW on. While a server set to "Safe" should only allow the NSFW toggle to be changed to off.
Thread
Comment by @SomewhatDamaged