Is it worth starting to invest in stocks if you plan to permanently move abroad in 4-5 years?

I have savings as well as I'm interested in investments, however, I withheld on actually starting doing it because I have plans on moving abroad in 4 years time and, potentially, not come back to UK.
My question would be, is it worth start investing in my situation? As I understand, I won't be able to contribute to my investment portfolio (UK) when I'm abroad and will have to start investing from zero when I'm there (abroad)?
Would appreciate anything that's helpful related to the topic. Thanks!