Despite, and in spite of (Regardless of) are prepositions (NOT conjunctions). Despite sth (WITHOUT of): ‘Despite the heat, she wouldn’t take her coat off.’
In spite of sth (WITH of): ‘In spite of the heat, she wouldn’t take her coat off.’