Firstly, there are a few sightseeing options available within walking distance of other, specially when you are found in Circular Quay.
Just a tip at rock bottom the way to the caves make sure you selected a low gear or you'll then burn out your brakes. https://Sites.Google.com/view/bestbeautyproducts121/home