Once you get to San Manuel you could take the county road back up to Oracle. From Oracle you could then take the Mt Lemmon road back up into the mountain and then take the Catalina highway back down to Tucson. That would be an all day trip, but you would see new country each way. Or from San Manuel you could go south back down to Benson and catch the I-10 back into Tucson. All the un-paved routes that I mentioned are county maintained dirt roads.
The Reddington road from Tucson is rutted and bumpy (also called Tanque Verde Pass road), but does not require 4-wheel drive...I just drove it 2 weeks ago. Since the Aspen Fire this summer, the back road from Oracle to Mt Lemmon has changed a bit (also called The Control Road by some old timers) , check locally to find about conditions. The road down to Benson runs next to the San Pedro river most of the way but is paved for the last couple of miles before getting to the town of Pomerene just outside of the town Benson. Enjoy your visit