Npu Llm

Ollama alternative for Rockchip NPU: An efficient solution for running AI and Deep learning models on Rockchip devices with optimized NPU support ( rkllm )

A simple Python script for running LLMs on Intel's Neural Processing Units (NPUs)