Scrambling in the black hole portrait