LLM Inference

OpenAI Jalapeño Chip: Challenging Nvidia's AI Dominance

OpenAI challenges Nvidia's dominance with Jalapeño, a custom 3nm inference chip. Delivering 1.9x more throughput per kilowatt and 3.6x lower latency than Blackwell, it marks a new era of AI silicon.