Please someone help me!!! Child custody battle?

Hi, i am currently in a child custody nattle with my ex boyfriend, i always been the one taking care of my daughter, i requested sole custody, and supervised visitation because he father threatened to kill himself and also to kill me, since i started the process on january he hasnt seen the baby because i was scared that he would take her due to not having a court order, recently his mother went into a coma and i felt really bad so spoke to my lawyer to try to come to an agreement with my ex for him to have supervised visitation with my mother there until we have our first hearing and the agreement would be signed by a judge, ex accepted after a week and came to see the baby on her bday yesterday, he was supposed to be here at 3 pm and got here at 3 41 pm, didnt even bring her a dollar store toy, baby kept crying and he started screaming at my mother infront of our baby and said i cannot stand her crying and got up slammed the door and took off in his car like a maniac within 4 min of seeing her, he didnt even try to play with her or anything, now i am scared to allow him to see her with my mom there because i dont think it was good how he screamed at my mother cursing infront of the baby, the baby was histerical crying because she got scared of how he screamed, if i deny the visitation until we go to the hearing can i get in trouble? Would i be held on concempt? What should i do? Should i keep trying with supervised visitation or should i deny it until we go to court? Please help asap i want was best for my child i love her and i dont want nothing bad to happen to her .