Chris Brown's Baby Mama -- Royalty's Not Safe Around His 'Gang' Friends

Chris Brown could lose more than property after the home invasion ... it could cost him some daddy time, because his baby mama is worried Royalty 's in danger when she's with Chris and his homies. Sources close to Nia Guzman tell TMZ ... she thinks many of Chris' friends are gang members or gang-affiliated, and the robbery shows they've now turned on Chris. He just filed docs asking a judge to hammer out a formal custody agreement -- partly because he says Nia's been denying him visits with Royalty. If the court sees things Nia's way it could affect custody.