Home Technology OpenAI says its Jalapeño chip can power faster AI...
Technology

OpenAI says its Jalapeño chip can power faster AI responses than the competition

OpenAI says its Jalapeño chip can power faster AI responses than the competition
Key Points

OpenAI says its new AI chip, Jalapeño, completes tasks more efficiently and returns responses faster than other AI systems, according to a blog post published on Tuesday. During a briefing with reporters, OpenAI hardware vice president Richard Ho said Jalapeño offers the "best of both worlds" with lower latency and higher throughput, as AI systems typically "have to make a trade-off between the two." First introduced in June, Jalapeño is an Application-Specific...

OpenAI says its new AI chip, Jalapeño, completes tasks more efficiently and returns responses faster than other AI systems, according to a blog post published on Tuesday. During a briefing with reporters, OpenAI hardware vice president Richard Ho said Jalapeño offers the "best of both worlds" with lower latency and higher throughput, as AI systems typically "have to make a trade-off between the two."

First introduced in June, Jalapeño is an Application-Specific Integrated Circuit (ASIC) made in partnership with Broadcom. It's designed for AI inference - the process of running a trained AI model to complete a task or deploy an agent.

To mea …

Read the full story at The Verge.

[Image text:] 260224-0005 WIDER-B ISC R91-0679489900001-0
Jalapeño (ORG) AI (ORG) Jalapeño (LOCATION) Richard Ho (PERSON) ASIC (ORG) Broadcom (ORG)
Originally published by The Verge Read original →