How long can i go without wearing rubber bands with your braces?

i have braces and i wear rubber bands with them. for some reason the oart that hold the rubber band and the braces is coooming loose so i decided not to wear them to take the ase off the thing so it would not come out. would not wearing them for like 2 days affects me? i still have 1 in but not the other