Try to book your hotel inside the old town. This is the best part of the city proper. It’s better to come outside the peak tourist season. We went in late November and it was great. The nights got a bit cold but there was lots of sunshine during the day and far fewer people. Wandering the temple complex on the hill takes about an hour.