Etched, a startup focusing on transformer-based chips, has unveiled Sohu, an ASIC aimed at outperforming Nvidia’s H100 in AI LLM inference. The company claims that a single 8xSohu server can offer the performance of 160 H100 GPUs, potentially saving data centers on upfront and operational costs. Current AI accelerators, be it CPUs or GPUs, are … Read more
Intel has unveiled its latest Gaudi 3 AI accelerator, boasting up to 128GB of HBM2e memory and a memory bandwidth of up to 3.7TB/s. How does it stack up against NVIDIA’s Hopper H100 80GB AI GPU? Well, the key difference lies in cost: Intel’s Gaudi 3 AI accelerator is priced at $16,000 per unit with … Read more
Intel has unveiled the prices of its Gaudi 2 and Gaudi 3 accelerators for AI, which are significantly lower than Nvidia’s H100. The company revealed at Computex 2024 that eight Gaudi 2 processors on one motherboard will cost $65,000, while eight Gaudi 3 processors will cost $125,000. This means that a single Gaudi 2 is … Read more
xAI, Elon Musk’s AI startup, is planning to build a massive supercomputer to enhance its AI chatbot, as reported by Reuters quoting Information. This project, referred to as the Computing Gigafactory, is expected to be completed by the fall of 2025 and may involve a collaboration with Oracle. The supercomputer aims to surpass rival GPU … Read more