Democratizing AI with Anarchy: LLM Infrastructure for Conversational UI

The world of Artificial Intelligence is constantly evolving, and with it comes the need for more accessible and reliable tools for developers to use. Conversational UI is becoming increasingly popular, and LLMs (Large Language Models) are being used as the backbone for creating natural language interfaces. However, working with LLMs can be unpredictable and requires a significant amount of time and resources, which is where Anarchy comes in. Anarchy is a start-up that is dedicated to democratizing AI by providing LLM infrastructure for conversational UI. In this article, we will take a closer look at Anarchy, its founders, the problem they are solving, and their solution.

Founders: Matthew Mirman and James Spoor

Anarchy was founded in 2022 by Matthew Mirman and James Spoor. Both founders have extensive experience in the field of AI and have worked on a variety of projects before starting Anarchy. Matthew received his PhD in AI from ETH Zurich in 2022 and is an expert in taming LLMs. He has also worked at Apple on JS compiler optimizations that saved the world a billion dollars in time wasted waiting for pages to load. James, on the other hand, has a background in engineering and has created a 7-figure digital business in just 6 months. Together, they have created Anarchy to share their expertise in AI with developers who want to use LLMs in production.

The Problem: Inconsistent and Unreliable LLMs

As LLMs become more popular for creating conversational UI, developers are encountering a variety of problems. One of the biggest challenges is the unpredictability and inconsistency of LLMs. Developers and prompt engineers want LLMs that are consistent and reliable, but coaxing LLMs to behave this way is a difficult and time-consuming process. Additionally, relying on a single provider for LLMs can be a risky point of failure. Anarchy recognizes these challenges and has created a solution to address them.

The Solution: LLM Infrastructure for Conversational UI

Anarchy's platform is designed to abstract away the unpredictable work of researching ideal prompts, allowing developers to focus on building business logic. To use Anarchy, developers provide their API and its description, as well as their LLM-keys. Anarchy then provides an LLM endpoint (or web-interface chatbot) that can answer questions and solve problems using the provided API. The platform load-balances between LLMs, making it more reliable than relying on a single provider. Anarchy is starting by building the first provider-independent LLM-VM and offering managed hosting to assist the transition away from single-point-of-failure providers.

The Technical Details: LLM-VM and Natural Language Compilation

Anarchy's LLM-VM is a Just-In-Time (JIT) tool that uses LLMs to convert conversational natural language into a dynamic series of LLM and IO commands. Developers provide the underlying provider(s), actions (APIs, code-hooks) and their descriptions, and data-sources (PDFs, websites, etc.), and the LLM-VM takes care of load-balancing, LLM selection and fine-tuning, natural language compilation, and tree-of-thought. This abstraction makes it easier for developers to create natural language interfaces without having to spend significant amounts of time and resources on LLMs.

Anarchy's Promises: Open-Source and the Commoditization of AI

Anarchy is committed to the democratization of AI, and they believe that open-source is a critical component of achieving this goal. They plan to move towards open-source, not away from it, and they will work to accelerate the commoditization of AI.

The commoditization of AI means making AI technology accessible and affordable to everyone. It means breaking down the barriers to entry that have traditionally made AI the domain of large companies with deep pockets. Anarchy believes that everyone should have access to the power of AI, regardless of their resources or technical expertise.

Anarchy is committed to supporting the open-source community by contributing code, documentation, and tools. They believe that open-source software provides the best possible foundation for building powerful and scalable AI applications. By making their technology open-source, Anarchy hopes to encourage others to build on their work and continue to advance the field of AI.

The Future of Conversational UI

Anarchy's technology has the potential to transform the way we interact with machines. Conversational UI has already begun to revolutionize the way we communicate with our devices, but Anarchy's platform takes this to the next level by making it easier to build and deploy powerful conversational interfaces.

As AI becomes more ubiquitous, we can expect to see conversational UIs become increasingly sophisticated and capable. We may see AI-powered assistants that can not only answer our questions but also anticipate our needs and preferences. We may see AI-powered chatbots that can handle complex customer service interactions and even help us make purchase decisions.

Anarchy's platform is helping to pave the way for this future by making it easier for developers to build and deploy these advanced conversational UIs. By abstracting away the complex work of researching prompts and managing LLMs, Anarchy is enabling developers to focus on building the business logic that will power these next-generation interfaces.

Conclusion

Anarchy's LLM infrastructure for conversational UI is an exciting development in the world of AI. By providing a platform that abstracts away the complexities of managing LLMs, Anarchy is making it easier for developers to build and deploy powerful conversational interfaces. Their commitment to open-source and the democratization of AI is also commendable, and their promises to move towards open-source and accelerate the commoditization of AI bode well for the future of the field.

As AI becomes more ubiquitous, we can expect to see conversational UIs become increasingly sophisticated and capable. With Anarchy's platform leading the way, we may see AI-powered assistants that can anticipate our needs and preferences, chatbots that can handle complex customer service interactions, and much more. The future of conversational UI is bright, and Anarchy is helping to make that future a reality.