Yes, if you don't wear your retainers as directed by your orthodontist, your teeth are likely to shift. This can undo the progress you made with braces or other orthodontic treatments and can even lead to new problems.