Key insights
- RadixArk, an AI chip efficiency startup, raised $100M in seed funding led by Accel and Spark Capital, with participation from Nvidia. Their SGLang software optimizes AI model processing, potentially reducing computing costs. This could positively impact semiconductor demand and AI infrastructure investments, indirectly benefiting US equity markets by fostering innovation and efficiency in the AI sector.
Investing.com -- RadixArk, a startup focused on making artificial-intelligence chips more efficient, has raised $100 million in a seed funding round at a $400 million valuation, according to a report from the Wall Street Journal. The round was led by Accel and Spark Capital, with participation from Nvidia’s NVentures, Broadcom CEO Hock Tan, and others.
The company operates a software tool designed to help AI models process queries more efficiently and at lower cost. Its open-source software engine, SGLang, functions as a middle layer between AI models and hardware, utilizing short-term memory to reduce the total computing power needed for calculations.
RadixArk’s inference engine reuses KV cache by organizing conversation snippets into a filing system called a Radix tree. The engine scans new queries to determine if the beginning of a prompt matches previously processed information. When a match is found, the system skips that portion of the query and proceeds directly to generating an answer, reducing the cost of running the AI model.
This article was generated with the support of AI and reviewed by an editor. For more information see our T&C.