Is anyone using a locally hosted AI setup with reasonable results?

I have a Framework Desktop that I want to put AI models on. I keep hearing that local models are getting more and more impressive. I would love to one day get off of my Claude dependence for the sake of privacy and running things in house. I am currently trying out using pi agent [https://pi.dev/] with GLM-4.7-Flash Q8_0. I don’t have much of a reference to say how it compares to other local models, but it’s definitely not something I could switch over to as a main driver instead of Claude. What are you guys thoughts? This is also the first time I’ve tried Pi. I’ve also been recommended hermes, which I know very little about. ▗▄▄▄ ▗▄▄▄▄ ▄▄▄▖ root@nixos ▜███▙ ▜███▙ ▟███▛ ------------ ▜███▙ ▜███▙▟███▛ OS: NixOS 26.05 (Yarara) x86_64 ▜███▙ ▜██████▛ Host: Desktop (AMD Ryzen AI Max) ▟█████████████████▙ ▜████▛ ▟▙ Kernel: Linux 6.18.44 ▟███████████████████▙ ▜███▙ ▟██▙ Uptime: 11 days, 21 hours, 26 ms ▄▄▄▄▖ ▜███▙ ▟███▛ Packages: 500 (nix-system) ▟███▛ ▜██▛ ▟███▛ Shell: bash 5.3.9 ▟███▛ ▜▛ ▟███▛ Terminal: /dev/pts/7 ▟███████████▛ ▟██████████▙ CPU: AMD RYZEN AI MAX+ 395 (32)z ▜██████████▛ ▟███████████▛ GPU: AMD Radeon 8060S Graphics ] ▟███▛ ▟▙ ▟███▛ Memory: 39.81 GiB / 125.09 GiB ) ▟███▛ ▟██▙ ▟███▛ Swap: 6.73 MiB / 7.45 GiB (0%) ▟███▛ ▜███▙ ▝▀▀▀▀ Disk (/): 119.94 GiB / 3.57 TiB4 ▜██▛ ▜███▙ ▜██████████████████▛ Local IP (enp191s0): 192.168.0.4 ▜▛ ▟████▙ ▜████████████████▛ Locale: en_US.UTF-8 ▟██████▙ ▜███▙ ▟███▛▜███▙ ▜███▙ ▟███▛ ▜███▙ ▜███▙ ▝▀▀▀ ▀▀▀▀▘ ▀▀▀▘