ai-inference-server

Here are 3 public repositories matching this topic...

okba14 / NeuroHTTP

High-Performance AI-Native Web Server — built in C & Assembly for ultra-fast AI inference and streaming.

open-source web-server high-performance assembly grpc low-latency neural http3 c-language grpc-server ai-inference ai-native ai-inference-server

Updated Oct 23, 2025
C

ABHIPATEL98 / AI-Inference-On-HPC

Star

A comprehensive framework for multi-node, multi-GPU scalable LLM inference on HPC systems using vLLM and Ollama. Includes distributed deployment templates, benchmarking workflows, and chatbot/RAG pipelines for high-throughput, production-grade AI services

hpc rag ai-inference vllm llm-inference ollama distributed-inference vllm-serve ai-inference-server multinode-training

Updated Dec 10, 2025
Python

industrial-edge / industrial-ai-vision-blueprint

Star

This repository features an application example for Siemens' Industrial AI Vision Blueprint

siemens simatic edge-computing pick-and-place industrial-edge profinet-io-connector industrial-ai-suite vision-connector ai-inference-server visual-quality-inspection

Updated Sep 5, 2025

Improve this page

Add a description, image, and links to the ai-inference-server topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the ai-inference-server topic, visit your repo's landing page and select "manage topics."

Learn more

Provide feedback

Saved searches

Use saved searches to filter your results more quickly