Is there a way to edit the text on the help, comment, or content tabs, or are the tabs solid images?

They're images.
You can edit them but I'd suggest doing this in a module under production rather than the base files in courselab itself.