Labels

• API models
• bug
• correctness

  Everything related to the generation correctness
• dependencies

  Pull requests that update a dependency file
• documentation

  Linked to documentation and examples
• enhancement
• examples

  Linked to usage examples
• exllamav2
• grammar
• help wanted
• impact/user
• interface

  Related to improving the user interface
• JSON
• llama.cpp

  Related to the `llama.cpp` integration
• mamba
• mlxlm
• numba
• optimization

  Related to performance optimizations
• prompting
• question
• regex
• run-benchmarks
• structured generation

  Linked to structured generation
• tests

  Linked to library tests
• tokenization
• transformers

  Linked to the `transformers` integration
• transformers vision
• vLLM

  Things involving vLLM support