Yes. Once the out-of-state company is filed in Delaware and you obtain an EIN, you can open a Delaware bank account.