Agents-A1-Q8_0-GGUF works pretty well for me (anecdotal feedback)

For the last day or so I've been using Agents A1 Q8 InternScience/Agents-A1-Q8_0-GGUF on my M1 Max mac (64GB) just like this: llama-server -hf InternScience/Agents-A1-Q8_0-GGUF --host 0.0.0.0 --port 8080 --temp 0.85 --top-p 0.95 --top-k 20 --min-p 0.0 --presence-penalty 1.1 --repeat-penalty 1.0 (these are the parameters they recommend) With full