You're many, many years too late. There's no practical, feasible way to do this anymore. Secrecy is if not dead then on its very dying breath.
You can move to another EU/EEA member state quite easily to lower your corporate and personal tax burden (Malta, Cyprus, Ireland, Portugal) but you still need to comply with VAT regulations.
If your business is small enough, you could relocate to outside of the EU/EEA (such as UAE), run a business from there, and not charge customers VAT. Technically, you might still be required to charge VAT but enforcement is rather limited for businesses that are small enough to get on anyone's radar.
If you form an offshore company, open an offshore bank account, and somehow manage to get payment processing, the company becomes tax resident in Norway (has to pay Norwegian tax), the bank account is reported to Norway under CRS, and payment processing will be fragile at best and quite expensive.