Swap short positions before ex dividend date

Let’s say I’m short SPY and want to avoid paying the dividend. The last ex-dividend date for SPY was March 17 while VOO had an ex-dividend date of March 24. It seems that I can sell SPY on March 16 and buy VOO on same date and do the opposite before March 24 to avoid paying the dividend on either stocks. Is there any risk that I’m missing here?