Yes. Once the out-of-state company is filed in Mississippi and you obtain an EIN, you can open a Mississippi bank account.