Co-founder & CEO at Cerebras Systems
SRAM memory is exceptionally fast but cannot store much data per unit area. To hold the weights of modern AI models on fast SRAM, we had to build a chip that was forty-six thousand square millimeters, which is fifty-eight times larger than a standard GPU.
This answer is part of a full interview with Andrew Feldman, Co-founder & CEO at Cerebras Systems.
Found this insight valuable? Share it with your network to help others learn from Andrew Feldman's experience.
Use this answer in your research, article, or academic work