inference-x/ix-tools
0
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
43c771d2e3
ix-tools/README.md
Inference-X 43c771d2e3 docs: initial commit
2026-02-25 17:18:43 +00:00

1.5 KiB
Raw Blame History

IX Tools

Utilities for the Inference-X ecosystem

Inference-X · Community

A collection of tools for working with GGUF models, benchmarking hardware, managing Inference-X deployments, and integrating with common workflows.

Tools

Tool Description
ix-bench Hardware benchmark — measures t/s across backends
ix-convert Convert models to GGUF from SafeTensors, PyTorch
ix-pull Download GGUF models from Hugging Face
ix-serve Production-ready IX server wrapper with auth, logging
ix-proxy Load balancer across multiple IX instances
ix-monitor Dashboard — GPU usage, t/s, active connections
ix-chat Terminal chat UI with history and markdown rendering
ix-embed Batch embedding generation tool

Quick Start

git clone https://git.inference-x.com/inference-x/ix-tools
cd ix-tools && make

# Benchmark your hardware
./ix-bench --all-backends

# Download a model
./ix-pull qwen2.5-7b-instruct-q4_k_m.gguf

# Start production server
./ix-serve --model model.gguf --port 8080 --workers 4

# Monitor running instances
./ix-monitor --host localhost:8080

Hardware Benchmark Reference (Feb 2026)

Run ./ix-bench to measure your actual hardware.
Community results: git.inference-x.com/inference-x-community/ix-scout

inference-x.com · MIT License