KöMaL 2017 B4859

Rudi chose a positive integer $k$, and observed that $4^k$ and $5^k$ began with the same digit in decimal notation. Prove that this digit may only be a $2$ or a $4$.