You can. The City of Annapolis transit system has a bike-on-bus program. All of the Annapolis Transit vehicles have bike racks that will hold standard length bicycles.
Bikes ride free with the person. This can be an easy way to meet your friends across town for a ride, extend your riding horizons, get home if you have a flat, or take your bike for maintenance.