History

Salka Elmadani ec36668cf5 Inference-X v1.0 — Universal AI Inference Engine Better output from the same model. Fused computation, adaptive precision, surgical expert loading. 305 KB, 19 backends, zero dependencies. https://inference-x.com		2026-02-23 07:10:47 +00:00
..
bench.sh	Inference-X v1.0 — Universal AI Inference Engine	2026-02-23 07:10:47 +00:00
chat.sh	Inference-X v1.0 — Universal AI Inference Engine	2026-02-23 07:10:47 +00:00
check_profile.sh	Inference-X v1.0 — Universal AI Inference Engine	2026-02-23 07:10:47 +00:00
hello.sh	Inference-X v1.0 — Universal AI Inference Engine	2026-02-23 07:10:47 +00:00
ix.sh	Inference-X v1.0 — Universal AI Inference Engine	2026-02-23 07:10:47 +00:00
profile_experts.sh	Inference-X v1.0 — Universal AI Inference Engine	2026-02-23 07:10:47 +00:00
profile_run.sh	Inference-X v1.0 — Universal AI Inference Engine	2026-02-23 07:10:47 +00:00
README.md	Inference-X v1.0 — Universal AI Inference Engine	2026-02-23 07:10:47 +00:00

README.md

Examples

Quick start

# Build first
make -j$(nproc)

# Hello world
./examples/hello.sh /path/to/model.gguf

# Chat with system prompt
./examples/chat.sh /path/to/model.gguf "You are a desert ecology expert."

# Benchmark
./examples/bench.sh /path/to/model.gguf 10

# Expert profiling (MoE models)
./examples/profile_experts.sh /path/to/kimi-k2.5.gguf expert_data.csv

Notes

All scripts take the model path as first argument
Chat template is auto-detected from GGUF metadata
Expert profiling only produces data for MoE models (Kimi K2.5, DeepSeek V3)