Opta LMX Features

Inference Server

• MLX-native inference on Apple Silicon
• OpenAI-compatible /v1/chat/completions endpoint
• Streaming SSE responses
• GGUF model loading (llama.cpp fallback)
• Automatic quantization selection
• Model hot-swap without restart
• Concurrent request handling
• KV cache management
• Context length enforcement
• vLLM backend for parallel batching

Model Management

• Model inventory API (/admin/models)
• Dynamic load/unload API
• Memory headroom enforcement (never crash on OOM)
• Model health monitoring
• HuggingFace model download integration
• GGUF format support
• LoRA adapter loading
• Model benchmarking suite

API Compatibility

• OpenAI /v1/chat/completions
• OpenAI /v1/models
• Health endpoint /healthz
• Admin events SSE /admin/events
• Rerank endpoint /v1/rerank
• Skills API /v1/skills
• Agents API /v1/agents
• Embeddings endpoint /v1/embeddings
• Function calling (tool_use)

Performance

• ANE (Apple Neural Engine) utilization
• Batch request coalescing
• Throughput metrics (tokens/sec)
• Active request tracking
• Auto-tune quantization per model size
• Thermal throttle detection

Deployment Readiness

• Production LMX + Daemon configuration for status/admin/local-web health wiring

Voice & Audio

• Speech-to-text endpoint POST /v1/audio/transcriptions (mlx-whisper)
• Text-to-speech endpoint POST /v1/audio/speech (mlx-audio + Kokoro)
• Multipart form upload for audio files (WebM, WAV, MP3)
• soundfile I/O for audio processing
• Real-time streaming transcription (WebSocket STT)
• Voice activity detection (VAD)

Recent Updates

• 2026-03-05 — The Opta LMX Dashboard has been completely overhauled with the new Holographic HUD design language.

• 2026-03-05 — The Opta LMX Dashboard has been completely overhauled with the new Holographic HUD design language.

• 2026-03-04 — This update introduces native localized voice dictation, Text-to-Speech (TTS), and global audio p...

Auto-Synced Features

• Design: The Opta LMX Dashboard has been completely overhauled with the new Holographic H
• Design: The Opta LMX Dashboard has been completely overhauled with the new Holographic H
• Integrated the mlx-whisper package for STT processing at POST /v1/audio/transcriptions and mlx-audio for TTS generation at POST /v1/audio/speech. Handled natively using the MLX framework with no system-crashing processes.