You seem to have a lot of recommendations already, but I just wanted to mention beancount as well. It’s a decently powerful plain text accounting software. Not sure if it does invoicing.
For me it has been good because I think it is fun to hack some new functionality together that I feel missing. E.g. parse pdf receipts and break down transactions into postings based on what is in the receipt. But it you aren’t interested in simple Python programming, I’d probably not recommend it.
Being able to easily version control it using git is really helpful when you are trying things.
I have never ordered something from Amazon. It was introduced in my country a few years back, but it isn’t really that good of a site (at least the few times I have visited it).
Like many here, I do not want to support a monopolistic company like Amazon. Luckily I live in a country where I have better options. I tend to buy things from plenty of well rated sites. Environmentally conscious sites if I can.
I could see myself buying from them if there genuinely isn’t another option and it is something I really need, but that has yet to happen.