Hence is an adverbial conjunction like the word "however" or "consequently."

It joins two independent clauses and is preceeded by a semicolon and followed by a comma.

People often say "and hence" because they are trying to use "and" as a coordinate conjunction as well.

I was sick; hence, I didn't go to work.