Where can I go for a NON-RESORT tropical vacation?

I want to vacation somewhere in the tropics, but I hate resorts and overly fancy hotels. Where can I go that is fairly secluded and not too expensive? Maybe somewhere I can rent a bungalow or hut along the beach?