There's always more to see, but stuff doesn't run away if you don't see it right away :) I'm only in Japan once or twice a year and still manage to travel quite a bit. So don't worry too much about that :)