At the same time, I will also be the first one to admit that I don't have like 20-50k EUR laying around for the hardware to run inference fast enough on good models. Hell, even an RTX 5060 Ti 16 GB is at least 700 EUR (820 USD) right now over here, so regular consumers are also screwed, same with RAM prices and storage prices. Absolutely insane time to buy hardware.
as already suggested, buy and host your own inference system. just own both side of such "RCE". make sure you audit and use open source software for the entire stack.
you are just complaining on something that can be totally safeguarded. yes, it won't be cheap, it require a lot of work, welcome to the capitalist world.
