InferenceX is an evaluation and observability repository at SemiAnalysisAI/InferenceX; maintainers describe it as: Open Source Continuous Inference Benchmarking Qwen3.5, DeepSeek, GPTOSS - GB200 NVL72 vs MI355X vs B200 vs GB300 NVL72 vs H100 & soon™ TPUv6e/v7/Trainium2/3. Its recorded primary language is Python. License metadata lists Apache-2.0. GitHub metadata shows about 893 stars. The project homepage is https://inferencex.com/.
License
Apache-2.0
Stars
1,098
Homepage
https://inferencex.com/Features
- Recorded summary for InferenceX: Open Source Continuous Inference Benchmarking Qwen3.5, DeepSeek, GPTOSS - GB200 NVL72 vs MI355X vs B200 vs GB300 NVL72 vs H100 & soon™ TPUv6e/v7/Trainium2/3
- InferenceX uses Python as its recorded primary language, which helps with stack-fit review.
- InferenceX acts as a reference point for measuring, tracing, benchmarking, or monitoring behavior.
- InferenceX lists Apache-2.0 license metadata; review obligations before redistribution or hosted use.
- InferenceX has about 893 GitHub stars in the local metadata snapshot.
- InferenceX links to https://inferencex.com/ for homepage, docs, or demo validation.
Use Cases
- Evaluate InferenceX when the need is evaluation and observability and the repo summary matches: Open Source Continuous Inference Benchmarking Qwen3.5, DeepSeek, GPTOSS - GB200 NVL72 v...
- Compare the Python implementation in InferenceX before choosing a similar internal architecture.
- Use InferenceX to compare evaluation or monitoring approaches before production rollout.
- Complete a Apache-2.0 license review before packaging InferenceX into a commercial or hosted workflow.
- Use InferenceX's GitHub traction as one input when prioritizing open-source evaluation.
- Check InferenceX's homepage alongside the repository when validating setup, demos, or documentation.
FAQ
Start from the repository summary (Open Source Continuous Inference Benchmarking Qwen3.5, DeepSeek, GPTOSS - GB200 NVL72 vs MI355X vs B200 vs GB300 NVL72 vs H100 & soon™ TPUv6e/v7/Trainium2/3), then verify maintenance status, integration boundaries, and whether its evaluation and observability focus matches the intended workflow. Repository: https://github.com/SemiAnalysisAI/InferenceX. Stars: about 893. License: Apache-2.0. Language: Python.
InferenceX is best treated as a repository-level component or reference implementation for evaluation and observability. Good evaluation scenarios include: Evaluate InferenceX when the need is evaluation and observability and the repo summary matches: Open Source Continuous Inference Benchmarking Qwen3.5, DeepSeek, GPTOSS - GB200 NVL72 v... Compare the Python implementation in InferenceX before choosing a similar internal architecture. Use InferenceX to compare evaluation or monitoring approaches before production rollout.
