A marketplace concept for LLM-powered web apps where developers earn revenue on token margins, addressing the challenge

I've encountered two major problems while building AI-powered sites: 1) Most agentic tooling doesn't have a enough of a targeted approach to edits to existing files, and will make extraneous edits, 2) Many users will want to try things casually but not spend on each LLM-powered webapp they want to use.

The first problem of targeting edits was a much bigger issue previously, where, before agents, ChatGPT would just delete a chuck of code and replace it with `// existing code goes here`. Simply editing existing files was a pain. This is mostly solved now as Cursor et al. do a much better job by replacing specific lines and such. However, they still go off the rails a lot (especially gemini cli I've noticed) and make unnecessary and unwanted changes.

I'm hoping to solve that by using my Abstract Syntax Tree approach: when editing a file, the LLM is actually instructed to write code that will modify the data structure backing the source text, rather than the source text itself. For example, to edit an HTML file, we instruct the LLM to write python that imports beautifulsoup and then modifies the data structure underneath it.

I hope to solve the second problem (of token usage costing real money but users not wanting to sign up for every site they might want to use) by running a token margin sharing system. Here's how it works: I charge 2x for token usage based on the LLM provider (Anthropic and OpenAI support so far). This cr