“They won’t even release it to me because that many people have called and said it was a fraudulent account,” Brown said