High-Performance server for NATS.io, the cloud and edge native messaging system.
-
Updated
Nov 20, 2026 - Go
Edge Computing and Artificial Intelligence of Things (AIoT) involve performing localized data processing directly on edge devices rather than relying entirely on centralized cloud servers. This architectural approach combines Internet of Things (IoT) hardware with optimized, lightweight machine learning models to enable real-time decision-making, drastically reduce network latency, and improve overall data privacy and bandwidth efficiency.
High-Performance server for NATS.io, the cloud and edge native messaging system.
Sub-50mb agentic, voice and vision intelligence for consumer devices.
Device-native foundation models: 145B on a laptop, 35B on a phone. Latent MoE, SSD-streamed weights, a router that predicts loads a step ahead. Mac, iPhone, Android, Windows.
PyTorch implementation of YOLOv3, YOLOv3-SPP, and YOLOv3-tiny for real-time object detection with training, validation, inference, and multi-format export.
LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.
2bit quants, kernels and runtime for consumer devices.
Open-Source Personal Cloud OS for Always-On Agents
A human-centric, resource-aware Android node for edge computing and federated learning. Orchestrates distributed intelligence with privacy-first localization and empathetic hardware management.
An all-in-one, pure C++ inference engine for audio models, powered by ggml. Supports TTS, STT, VAD, voice conversion, music generation, and more, with highly optimized performance. No Python dependency.
FEDML - The unified and scalable ML library for large-scale distributed training, model serving, and federated learning. FEDML Launch, a cross-cloud scheduler, further enables running any AI jobs on any GPU cloud or on-premise cluster. Built on this library, TensorOpera AI (https://TensorOpera.ai) is your generative AI platform at scale.
The Swiss Army Knife of Offline AI. Chat, see, speak, and generate images on your phone or Mac — GGUF LLMs, vision, Whisper speech-to-text, Stable Diffusion, tool calling, and local-network servers. Runs on your CPU, GPU, or NPU. No account, no API key, zero data leaves your device.
Production-grade C++ edge AI engine for video analytics and on-device VLM across Sophon, Rockchip RKNN, and x86, with visual orchestration, real-time OSD, events, and reproducible benchmarks.
[ICLR 2020] Once for All: Train One Network and Specialize it for Efficient Deployment
Deep learning gateway on Raspberry Pi and other edge devices
A reading path for CPU performance engineering, from one instruction to production inference. Primary sources only, with a runnable benchmark for every section.
maxxing the ability to run different LLMs on the smallest devices possible
Microsoft AI for Good Lab biodiversity hub: project catalogue, documentation and navigation for conservation AI, SPARROW and MegaDetector.
Run MoE models bigger than your RAM. Frontier-size MoE on a phone, laptop, edge. Lossless, on stock llama.cpp. An adaptive streaming optimizer. Any hardware, any OS, any model, any quantization, behind a local OpenAI-compatible server.
LibreYOLO is a MIT licensed open source computer vision library