Again as I stated above, every theme is different so I would not really know how your theme works. I can only give you my suggestion and give a general guidance on how to approach this.
I think a good way is just to look at the generate source. You can use tools like firebug or chrome tools to see the underlying code which will reveal how it is put together in terms of the HTML markup.