Skip to content

Best AI tools / Deploy

Best Self-hosted AI Tools

32 self-hosted tools, ranked by Stork's defensibility score — a human-reviewed verdict on which ones hold up as agents commoditize the rest.

  1. 1Azure Stack Hub AI50
  2. 2Apple MLX on-device36
  3. 3Run.ai Triton Orchestration29
  4. 4Edge Impulse29
  5. 5RunPod Dedicated26
  6. 6Llama.cpp23
  7. 7ncnn Mobile Deploy23
  8. 8Web Stable Diffusion23
  9. 9WebLLM23
  10. 10Mistral.rs23
  11. 11Edge Impulse Edge Ops21
  12. 12OctoAI Mobile Inference18
  13. 13SambaNova DataScale On-Prem17
  14. 14Domino Data Lab17
  15. 15NVIDIA Jetson Edge AI Stack16
  16. 16Dell Validated AI16
  17. 17Ollama14
  18. 18Edge Impulse BYOM14
  19. 19Apple Core ML14
  20. 20TensorFlow.js12
  21. 21Red Hat OpenShift AI12
  22. 22Red Hat OpenShift AI12
  23. 23Mechanical Orchard10
  24. 24HPE GreenLake for LLMs10
  25. 25tinybox10
  26. 26Brainchip Akida10
  27. 27Qualcomm AI Stack10
  28. 28HPE Ezmeral ML8
  29. 29Seldon Deploy8
  30. 30MLC LLM5
  31. 31TensorFlow Lite4
  32. 32Trugen AI2

Ranked by the Stork score — human-reviewed, recomputed as model capabilities ship.

One weekly email of tools worth shipping. No drip funnel.

one email per week · unsubscribe in two clicks · no third-party tracking