github

LocalAI

LocalAI

AI

leptonai A Pythonic framework to simplify AI service building

landscape2 Landscape2 is a tool that generates interactive landscapes websites, sncf

Tools

Triton

OpenAI triton

Document

      AST/Visitor     Triton/Compiler      libLLVM
Python --------> Triton-IR ------> LLVM-IR ------> PTX

Lightning

lightning

Fairscale

fairscale

PEFT

huggingface peft

Blog

PEFT approaches enable you to get performance comparable to full fine-tuning while only having a small number of trainable parameters.

Methods:

  • LoRA: LORA: LOW-RANK ADAPTATION OF LARGE LANGUAGE MODELS
  • Prefix Tuning: P-Tuning v2: Prompt Tuning Can Be Comparable to Fine-tuning Universally Across Scales and Tasks
  • Prompt Tuning: The Power of Scale for Parameter-Efficient Prompt Tuning
  • P-Tuning: GPT Understands, Too