A friend and I have tested this feature and we were able to talk in our AFK channel as if it was a normal voice channel. -Recently, two members and I were in the voice channel of my server, and one of them was moved into the AFK channel and was unable to reconnect to the normal voice room.
Thread
Comment by @TheBlindBard1978