AM
Adam Miller
@maxible.bsky.social
maxamillion.sh/
Distinguished Engineer at Red Hat
Husband. Father. Leader. Pythonista. Gopher. Ansible Contributor. Fedora & CentOS Community Member. Linux nerd. SysAdmin. Hatter. Texan. Geek. Author. Speaker.
I speak only for myself.
26 followers42 following27 posts
Playing with llama-cpp-python on CPU and I'm honestly impressed at how well newer Intel chips perform when they have AVX512. It's not incredible by any means, but I expected worse. It's good enough to play around with chat bots. Doing both training and inference, in general I'm not displeased. 👍
AM
Adam Miller
@maxible.bsky.social
maxamillion.sh/
Distinguished Engineer at Red Hat
Husband. Father. Leader. Pythonista. Gopher. Ansible Contributor. Fedora & CentOS Community Member. Linux nerd. SysAdmin. Hatter. Texan. Geek. Author. Speaker.
I speak only for myself.
26 followers42 following27 posts