Ignore scroll if it's not moving in the same direction that the panel overflows in e.g. stops us interfering with vertical scrolls on horizontally scrolling panels: https://files.facepunch.com/alexguthrie/1b3011b1/sbox-dev_12znz25nJC.mp4