The four children reportedly called each other “Robert” – the name of their father, who is now in custody