Salka Elmadani
ec36668cf5
Better output from the same model. Fused computation, adaptive precision, surgical expert loading. 305 KB, 19 backends, zero dependencies. https://inference-x.com
18 lines
904 B
Bash
Executable File
18 lines
904 B
Bash
Executable File
#!/bin/bash
|
|
# ═══════════════════════════════════════════════════════════════════════════════
|
|
# INFERENCE-X — Chat Script
|
|
# Copyright (C) 2025-2026 Salka Elmadani. All rights reserved.
|
|
# Licensed under the Business Source License 1.1 (BSL-1.1)
|
|
# See LICENSE file for full terms. See LICENSE for terms.
|
|
# ═══════════════════════════════════════════════════════════════════════════════
|
|
|
|
MODEL=${1:-"./model.gguf"}
|
|
SYSTEM=${2:-"You are a helpful assistant."}
|
|
|
|
./inference-x "$MODEL" \
|
|
-s "$SYSTEM" \
|
|
-p "Explain how a tree survives strong winds." \
|
|
-n 256 \
|
|
-t 0.6 \
|
|
--top-p 0.9
|