not wearing your retainer for 2 days ?

So I have PE in school..and today is Friday so on accident i left my retainer in my locker...i wont get it back untill Monday during 6th period...will my teeth shift ? Because i just got my braces off yester day...and idont want to have braces all over again.