It might be difficult, but there's definitely a way out of McElhone Stairs! Bring the youngsters and see how many minutes it takes you all to get to the finish.
Located in Potts Point, this network of paths and hedges is worth including in your schedule. But you'll find plenty more to see in the area. Sydney Opera House, Sydney Harbour Bridge, and Bondi Beach are within easy reach of McElhone Stairs.