Its many arithmetic units execute matrix and tensor operations concurrently, while specialized memory systems feed data to them. Performance depends on compute precision, memory capacity, bandwidth, and communication with other devices.
A graphics processing unit is a highly parallel processor widely used for neural network training and inference.
Its many arithmetic units execute matrix and tensor operations concurrently, while specialized memory systems feed data to them. Performance depends on compute precision, memory capacity, bandwidth, and communication with other devices.