AI chip

Definition

AI chips are processors designed specifically for artificial intelligence workloads, with hardware-level optimizations for matrix operations and deep learning inference. Compared to general-purpose CPUs, AI chips deliver orders-of-magnitude improvements in energy efficiency and computational throughput, serving as the foundational hardware for training and deploying large models.

Usage Example

NVIDIA's H100 GPU is the leading AI chip for large model training, supporting FP8 precision acceleration.

Related Terms

GPUNPUTPU

1100View

Related terminology

Edge Computing

Edge computing is a computing model that processes and analyzes data at the network edge, close to its source. In AI scenarios, it deploys inference capabilities to end devices to reduce latency and protect privacy, serving as a core enabling technology for smart hardware.