Across the street from the Hodelpa Caribe Colonial is a new place to stay, called the Hostal La Colonia. Running it is a former Caribe Colonial employee, Felipe. Completely new and very nice it has rooms starting at $50 per night. All the comforts like air-conditioning, hot water, security, and yes, no problems with having visitors.
Check them out.