Found the cause. It's because the check I added to fix this problem in keyboard mode only worked if you'd only recently visited one intermap location, e.g. the Waste area you left, but technically you also visited a Garrison earlier and that threw off the check! Okay will fix.
(Note however that your current location is indicated by the glowing "> <", not the selected map. Normally your last map would've been autoselected since you're in keyboard mode, but due to this particular route you took and the resulting internal confusion, the cursor part of the code didn't didn't know where you were and couldn't move the invisible cursor, so it remained where it was on your current position and highlighted an earlier map instead.)