https://webllm.mlc.ai/ is amazing and terrifying at the same time.

Amazing because you don't need fancy GPU servers to run an LLM, it can just run in a browser. From purely technical point of view this is mind blowing.

Terrifying because before long every other site will download not just 50 MiB of JavaScript and CSS, but also 6 GiB of neural network so they can grace you with another useless AI assistant ready to sell you whatever garbage they are peddling.