He reportedly said the dogs were coming in between his relationship with his girlfriend