HMMT 2020 A8

Let $P(x)$ be the unique polynomial of degree at most 2020 satisfying $P\left(k^{2}\right)=k$ for $k=0,1,2, \ldots, 2020$. Compute $P\left(2021^{2}\right)$.