RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.

Alibaba Cloud's high-performance KVCache system for LLM inference, with components for global cache management, inference simulation(HiSim), and more.

ANOLISA(Agentic Nexus Operating Layer & Interface System Architecture)

A distribution of Nginx with some advanced features

An easy-to-use framework for large scale recommendation algorithms.

MNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-performance on-device LLMs and Edge AI.

Open-source & free — Battle-tested at Alibaba's scale. Hybrid architecture code review tool: deterministic pipelines + LLM Agent, precise line-level comments, built-in fine-tuned ruleset (NPE, thread-safety, XSS, SQL injection), OpenAI & Anthropic compatible.

an easy-to-use dynamic service discovery, configuration and service management platform for building AI cloud native applications.

OpenTelemetry Compile-Time Instrumentation for Golang