Yes. Once the out-of-state company is filed in Georgia and you obtain an EIN, you can open an Georgia bank account.