Why does he get so mad when hes in the wrong...?

So my boyfriend and i have Complete different work schedule's! he works 5 a.m- 2 p.m Monday through Saturday and sometimes Sunday and i work 5p.m- 11p.m Monday though Saturday and some afternoons and this really blows! We live together but it seems like we NEVER see each other. But whatever i can deal with the work schedule's, we are young and its necessary for us both to work but my problem is when we actually do get to see each other from 2-5 he is never home because he is always helping someone do something. So typically i get mad and pissy at him and he basically tells me to deal with it, or even if he is home he is sleeping.. What do i do? i tell him all the time that if his friends want his help they can wait till after 5 when i leave for work but for some reason he cant tell them no, WTF.. Should i just deal with this or what?? like for example i just got home from work at 2 and i have to go back at 5 but of course he is sleeping, and i don't dare wake him because he will get mad at me and give me the " i work 60 hours a week im tired!" All i want to do is spend time with him, maybe cuddle once in awhile and watch a little TV together whats so wrong with that?