The LPU inference engine excels in dealing with significant language designs (LLMs) and generative AI by beating bottlenecks in compute density and memory bandwidth.
Groq was Started in 2016 by former Google https://bookmarkshq.com/story19201119/how-much-you-need-to-expect-you-ll-pay-for-a-good-groq-ai-inference-speed