Comment by Nextgrid
Starling Bank as the bank, and FreeAgent as the accounting software - it'll handle personal tax (self-assessment), corporation tax, VAT, and payroll. If you need an accountancy practice, I very much recommend Maslins - they'll provide FreeAgent access in that case as part of their fee.
Thanks for the recommendation, will take a look at Starling Bank and FreeAgent.