dotagent

It is a self-modifying framework designed for building AI-powered software, specifically optimized for code generation and prompt engineering. Nextpy, developed as the world’s first Autonomous Modifying System (AMS), provides advanced tools for controlling and optimizing interactions with large language models (LLMs). It focuses on enhancing efficiency by pre-compiling prompts, maintaining session states with LLMs, and optimizing token usage, particularly for open-source models. The framework is built to align with how LLMs process text, enabling precise control over output structures and improving the overall quality of AI-generated content.

Nextpy introduces a powerful prompt engine that surpasses traditional methods like few-shot prompting or chaining, offering greater control and efficiency. It eliminates redundant LLM processing by handling basic prompt processing at compile time and leverages session states with LLMs to reuse KV caches, significantly speeding up complex and lengthy prompts. The framework also supports speculative sampling, a method that uses a smaller draft model to generate multiple tokens per transformer call, potentially increasing token generation speed by up to 3x.

The framework is modular, extensible, and designed for multiplatform deployment, allowing components to run on various environments, including cloud, personal computers, and mobile devices. It supports exporting agents into simple `.agent` or `.🤖` files for seamless execution in any environment. Additionally, Nextpy includes features like syntax error detection for LLM-generated code, enabling automatic correction of hallucinations and invalid methods.

Nextpy integrates insights and components from prominent open-source projects such as Guidance, DSPy, LangChain, FastAPI-Mail, ReactPy, and Next.js, while also drawing inspiration from the React and Rust ecosystems. It includes a generative UI module, currently using forked versions of Reflex, Reacton, and Solara. The framework emphasizes developer-first principles, offering containerized and scalable solutions for AI-powered software development.

Nextpy is still in its early “just for friends” stage, encouraging feedback and contributions from the community. It is deeply rooted in the open-source ethos, acknowledging the contributions of creators and maintainers whose work has shaped its development. The framework aims to advance the era of AI-powered software development by providing innovative tools and fostering collaboration within the open-source community.