I collected the first four gym badges, defeated Giovanni in the Team Rocket hideout under the casino, use the Silph scope to defeat Team Rocket on top of Ro ghost tower as well as receiving the pokeflute from the old man, I have fresh water, lemonade and soda pop in my bag and none of the guards at all the entrances of saffron are letting me in. Am I missing something?