import LLM-tools


build LLM-based apps

  • quickly design self-contained desktop apps or deploy on self-hosted, scalable infrastructure.
  • get started using our LLM application template. build for all platforms using a single codebase.
  • hardware targets: any cpu, apple silicon, nvidia
  • gui targets: mac, win, linux, web

using custom models

  • we customize the best open source LLMs for the task at hand, fine-tuned for your language and domain.
  • optimized for your hardware and runtime environment, from efficient desktop apps to high-performance clusters.
  • example: run a 7B parameter model with 4+ gb of ram and 1.6 ms per token on a macbook.

and our extensions