Groq, a startup growing chips to run generative AI fashions quicker than standard {hardware}, has a watch towards the enterprise — and public sector.
In the present day, Groq introduced that it’s forming a brand new division — Groq Methods — targeted on drastically increasing its buyer and developer ecosystem. Inside Groq Methods’ purview is serving organizations, together with authorities companies, that want to add Groq’s chips to current knowledge facilities or construct new knowledge facilities utilizing Groq processors.
In forming the brand new unit, Groq has acquired Definitive Intelligence, a Palo Alto–primarily based agency providing a variety of business-oriented AI options, together with chatbots, knowledge analytics instruments and documentation builders. Definitive Intelligence CEO Sunny Madra is now main GroqCloud, Groq’s cloud platform that gives Groq {hardware} documentation, code samples and self-serve API entry to the corporate’s cloud-hosted accelerators.
“At Groq, we’re committed to creating an AI economy that’s accessible and affordable for anyone with a brilliant idea,” Groq co-founder and CEO Jonathan Ross mentioned in a press launch. “We’re excited to welcome Sunny and his team from Definitive Intelligence to help us achieve this mission … The Definitive team has expertise in AI solutions and go-to-market strategies, as well as a proven dedication to sharing knowledge with the community.”
Madra co-founded Definitive Intelligence in 2022 with Gavin Sherry, ex-director of engineering at EMC. Previous to launching Definitive Intelligence, Madra and Sherry co-launched Autonomic, a cloud-based platform for connecting mobility techniques that Ford acquired in 2018.
Definitive Intelligence presents a number of business-oriented GenAI merchandise, together with OpenAssistants (a set of open supply libraries for growing AI chatbots) and Advisor (a visualization generator that connects to each enterprise and public databases). Certainly one of Definitive’s premier instruments is Pioneer, an “autonomous data science agent” designed to deal with numerous knowledge analytics duties, together with predictive modeling.
Previous to the acquisition, Definitive Intelligence had raised $25.5 million in enterprise capital.
“The world is just now realizing how important high-speed inference is to generative AI,” Madra mentioned in an emailed assertion. “At Groq, we’re giving developers the speed, low latency, and efficiency they need to deliver on the generative AI promise. I’ve been a big fan of Groq since I first met Jonathan in 2016 and I am thrilled to join him and the Groq team in their quest to bring the fastest inference engine to the world.”
Groq, which emerged from stealth in 2016, is creating what it calls an LPU (language processing unit) inference engine. The corporate claims that its LPU can run current massive language fashions related in structure to OpenAI’s ChatGPT and GPT-4 at 10x the pace.
Ross’ declare to fame helps to invent the tensor processing unit (TPU), Google’s customized AI accelerator chip used to coach and run fashions.
Definitive Intelligence is Groq’s second acquisition after Maxeler Applied sciences, a high-performance compute and AI infrastructure options agency, in 2022. It may not be its final. The marketplace for customized AI chips is a extremely aggressive one, and — to the extent the Definitive buy telegraphs Groq’s plans — Groq is clearly intent on establishing a foothold earlier than its rivals have an opportunity.
