Tiny-LLM – a course of serving LLM on Apple Silicon for systems engineers

https://github.com/skyzh/tiny-llm

The first model in my #tinyllm review series is #qwen 1.5 0.5b. A truly tiny model that can run comfortably on my Lichee Pi4a #riscv64 single board system. Read the article and let me know if you can think of anything else I should test on #qwen and the future models.

https://kyle.works/blog/tiny-llm-reviews-qwen-1-5/