Topic

Attention Optimization

1 items across the graph — tagged with Attention Optimization.

From the graph · 1

repo
peremartra/Rearchitecting-LLMs

Official code for the Manning book on structural LLM optimization: depth/width pruning, knowledge distillation, and attention optimization, runnable on free Col…

→

Related topics

large-language-models 1quantization 1model-optimization 1llm 1knowledge-distilation 1ai-fairness 1attention-optimization 1mode-compression 1fine-tuning 1qlora 1
Search Attention Optimization →All topics →