Balcony again

My brother talked me into letting Manzi out this morning after breakfast. Manzi was getting into so much trouble inside so maybe flying would help him release some energy. Manzi was a bit hesistant to fly around at first (maybe because he never goes out in the morning). After a few minutes he was off and dissappeared. I found him nearby in a tree and let him be. After not returning for 30 minutes, I called him down from the tree. Instead of coming he did a lot of flying around. He would get with a foot or so and then take off enjoying himself. All was well until he thought it might be fun to land on a balcony again. This time, there was nothing for him to chew except the railing (which I didn't worry about). He wouldn't come down and was very interested in the noises coming from inside the house. A couple was fighting (quite loudly). I didn't want to knock and their door and interrupt them to get Manzi down, so I just called my sis and talked with her to tempt Manzi down (making him jealous I am doing something other than paying attention to him). It worked and after 5 minutes Manzi came down to me. After getting a grape he was ready to take off again. I let him play in a tree for a few minutes, but then I took him inside since I didn't want him be stuck out in the heat of the day. If so, he would get too hot and wait to fly down until it cooled down. It is a major set back in training because I am reinforcing that if he comes down to me, I will put him away. I wasn't sure what else to do since I have engagements to attend today. I shouldn't have let him out to begin with so early. I think for the time being I will stick to evening flying sessions.