The optimised synthetic intelligence (AI) chip helps superior pc imaginative and prescient and chatbot AI with prime efficiency and vitality effectivity.
Rebellions Inc has launched a synthetic intelligence (AI) chip, ATOM, that claims to deliver a revolutionary change in AI expertise. The corporate says the chip is optimised for pc imaginative and prescient and chatbot AI purposes. By specializing in particular duties, the chip consumes solely roughly 20% of the facility required by different related chips for these specific duties. The chip bridges latency-critical Machine Studying (ML) duties and hyper-scale ML providers. The corporate claims the System on Chip (SoC) is a high-speed inference machine perfect for coaching fashions utilized in generative AI purposes, resembling ChatGPT. The chip helps cutting-edge AI networks, together with state-of-the-art GPT language fashions, with prime efficiency and vitality effectivity. The chip is designed to satisfy the rigorous calls for of advanced AI providers by incorporating multi-instance partitioning and safe boot options.
Based on the corporate, the SoC effectively accelerates numerous neural networks like convolutional neural networks (CNNs), lengthy short-term reminiscence (LSTM), bidirectional encoder representations from transformers (BERT) and up to date transformer networks resembling T5, GPTs, and so forth. ATOM permits simultaneous assist for as much as 16 remoted jobs at totally different {hardware} and software program ranges by way of environment friendly partitioning. Maximised vitality effectivity is achieved by implementing a low-power design methodology and utilising tidy core constructions. The AI core can accommodate networks with totally different depths and complexities, starting from small-scale purposes to high-level information centre providers.
ATOM is powered by Samsung Electronics’ cutting-edge Excessive Ultraviolet (EUV) course of node, making certain optimum efficiency and vitality effectivity. With superior applied sciences like Peripheral Element Interconnect Specific (PCIe) Technology 5 (Gen5) and Graphics Double Knowledge Charge 6 (GDDR6) high-speed IO, the processor caters to numerous markets, from edge computing to information centres.
A few of the technical specs of the AI chip embrace:
- FP16: 32 TFLOPS
- INT8 / INT4: 128 TOPS / 256 TOPS
- On-chip SRAM: 64 MB
- Max Thermal Design Energy (TDP): 60 – 150W (Configurable)
- Reminiscence: 16 GB, GDDR6 (ECC enabled), 256 GB/s
- Host / Chip-to-Chip Interface: PCIe Gen5, 64 GB/s
- Multi-Occasion NPU: HW isolation as much as 16 unbiased duties
For extra info, click on right here.
