Project Swap: What happens when agents trade for us?
https://www.anthropic.com/research/project-swap📌 【Anthropic 實驗】201 位員工的 AI 代理人上場喬換書
TL;DR:Anthropic 讓 201 名員工的 AI 代理人互相議價換書,發現模型能力比 prompt 指令更決定議價成敗。
如果你的 AI agent 代表你去跟別人的 agent 討價還價,它真的懂你想要什麼嗎?這個問題聽起來抽象,Anthropic 卻找了 201 名員工,搭了一座真實的交易市場來測試答案。
🤔 為什麼好交易常常沒發生
生活中充滿了本可以讓雙方都更好的交易,卻因為找到對的交易對象、談出條件太花力氣而從未成真:病人因為一家診所報價太貴就放棄治療,卻不知道另一家收費更低,或原本那家其實願意在被要求時降價;理想的工作機會與合適的僱主可能就在附近,卻因為雙方都沒時間持續搜尋而錯過彼此。日常生活裡也有排班互換、共乘拼車、代接送孩子這類容易被忽略的小型交易。如果有一個 agent 全天候替你去找潛在交易對象並談條件,這些交易會不會就此成真?這牽涉到一連串還沒有答案的問題:agent 真的理解你嗎?當許多 agent 齊聚一堂互相交涉時,誰來訂定「誰能入場、交易破局怎麼辦、市場活動對參與者是否可見」這些規則?
這是 Anthropic 第二次做類似實驗。第一次「Project Deal」讓 agent 在一個為期一週的分類廣告市集裡替員工買賣真實物品,但因為商品五花八門(乒乓球、雪板等)且議價方式自由開放,很難有客觀標準去衡量交易結果好壞。這次他們改用更容易量化評分的設計。
🧩 一場以書換書的實驗
201 名 Anthropic 員工分布在舊金山、紐約、倫敦、西雅圖、華盛頓特區與都柏林六個辦公室,各地人數從 3 人(都柏林)到 115 人(舊金山)不等。每位參與者帶來一本自己想送出的書。接著,每人與 Claude 進行一段簡短、半結構化的對話,聊聊自己的閱讀喜好與這個夏天想讀什麼類型的書。Claude(此步驟使用 Fable 5 模型)根據這段對話,為每位參與者建構出對其所在書池中每一本書的排序預測。
為了驗證這個預測的準確度,Anthropic 另外收集了「真實答案」:每位參與者親自從自己書池中挑出 10 本書排序,這份排序 agent 從未看過。之後,agent 帶著各自估計出的偏好上場,在數位「交易大廳」裡向其他 agent 推銷、討價、談成交易,直到時間結束,參與者最終拿回自己 agent 談來的書。
📊 五分鐘對話,猜中六成一的偏好順序
結果顯示,僅憑一段五分鐘的對話,agent 對書籍的排序預測與參與者本人排序相比,兩兩配對比較的一致率達到 61%——對這麼短的對話來說,這個結果被形容為「意外地好」。
Anthropic 接著把每個交易大廳重跑了數十次,分別更換所用的模型與給 agent 的指令。結果發現:agent 所使用的模型,比給它的指令內容,更能左右議價結果;使用更強模型的市場,整體交易效率也更高。此外,大多數拿到書的人都表示喜歡這本書,平均每位參與者表示,願意把自己每年書籍預算的三分之一左右交給 Claude 代為支配。
💡 市場卡關的原因,不在議價本身
Anthropic 指出,這個市場表現不如預期,主要原因是 agent 對參與者掌握的資訊不足,而不是議價過程本身出了問題——也就是說,瓶頸出現在「理解使用者偏好」這一端,而非「談判技巧」這一端。文章也區分了兩種市場設計:集中式市場需要一個「清算所」角色統籌所有人的需求並直接算出最佳配對,但參與者必須把資訊交給並信任這個中心單位,實務上常常沒有這樣的單位存在,或人們不願意全盤告知;去中心化市場則靠每個人(或其 agent)自行找對象、自行談判。由於 AI agent 的「注意力」遠比人類仲介(如房仲、獵頭)便宜,理論上有機會讓過去只有付得起仲介費的人才能享有的「全天候代理人」服務,普及到更多人身上。
⚠️ 樣本規模與未解問題
都柏林辦公室僅 3 人參與,因此被排除在多數分析之外;素材也提到「大多數人」對拿到的書感到滿意,暗示並非所有人都如此,但具體比例與原因未在摘錄中說明。此外,這個以書換書的簡化情境是否能推廣到更複雜、真實的市場(如求職或醫療報價),目前仍是未知數。
🎯 實務啟示
對於設計 AI 議價系統或多 agent 市場的工程師來說,這個實驗的重點提示是:真正的瓶頸往往出在「如何讓 agent 準確理解使用者偏好」,而不是「如何調校議價指令」;同時,選用更強的底層模型,可能比雕琢 prompt 更能改善整體協商結果。
🔗 來源
- 標題:Project Swap: What happens when agents trade for us?
- 作者/機構:Anthropic
- 連結:https://www.anthropic.com/research/project-swap
#Anthropic #Claude #AIAgents #MultiAgentSystems #AIEconomics #MarketDesign #AgentNegotiation #AIResearch #LLM #Fable5
原始資料 Anthropic Research · 收集於 2026-09-25
摘要原文
Economics Project Swap: What happens when agents trade for us? Sep 24, 2026 Read in PDF Summary To see what works and what breaks when agents are sent into a market, we made a miniature market of Claudes—a more controlled sequel to Project Deal , our first experiment with agents interacting in a marketplace on people's behalf. Anthropic employees across six offices brought in a book they wanted to give away. Each participant had a short chat with Claude about what they like to read, and sent a Claude-powered agent onto an open trading floor to pitch, haggle, and strike deals with other people’s agents. The goal was for everyone to take home a summer read they would enjoy. Participants also ranked 10 books based on their interests so we could score how well their agent represented them. From a five-minute chat, an agent’s ranking of the books matched its person's on 61% of pairs, which is surprisingly good for such a short conversation. Once on the trading floor, the agents traded well. The market fell short mostly because of the information agents lacked about their participants, rather than because of how they traded. We then re-ran every trading floor dozens of times, changing the models used and the agents’ instructions. We found that the model an agent ran on made more of a difference to its negotiating outcomes than the instructions we gave it. Markets with stronger models were more efficient. Most people who read their book liked it, and the average participant said they would hand Claude about a third of their yearly book budget to spend. Why we did this Life is full of deals and trades that would leave everyone better off, yet never happen. This is often simply because it takes too much work to find the right counterparty and negotiate until a deal is struck. Think of the patient who skips a treatment after one quote they can’t afford, when there’s a different clinic that charges far less, or the hospital that quoted them would have cut its bill if asked. Or think about your job. Somewhere there might be one that would suit you better, with an employer who would be glad to hire you. But you may not find each other, because neither of you has the time to be searching constantly. There are smaller, everyday deals that go overlooked too—shift-swapping in a workplace, coordinating carpools, or trading school pick-ups. Could these deals happen in the future if you had an agent working for you around the clock, talking to potential counterparties and working out possible terms? Maybe—but this future depends on a lot of questions we don’t have answers to yet. If an agent is going to act for you, how do you know it has understood you? Plus, when many agents meet to talk to each other, some marketplace or platform has to write the rules of engagement. Who is allowed in? What happens when a deal falls through? As agents are increasingly sent into real markets, these questions take on greater urgency. So this summer, we built a small, controlled market to study these questions: a barter economy with 201 Anthropic employees and their Claude-powered agents. Everyone brought in a book they wanted to give away. Then, they chatted with their Claude-powered agent about the kind of book they hoped to read this summer. The agents met on a digital “trading floor” and swapped books until time ran out. Everyone took home a book that their agent acquired for them (or, most people did… more on that later). The experiment gave us an early look at problems ahead. Anyone designing agents for markets will need a way to check that agents understand their participants. Anyone designing markets for agents will need clear rules about which agents are allowed in, what happens when a deal falls through, and how much market activity is visible to participants. How to make a market There are two basic ways to run a market. In a centralized market, everyone tells a single party what they want, and that party works out the trades. In a decentralized one, people find each other and negotiate directly. AI agents could help in both types. Take the centralized market. If a single entity knows exactly what everyone wants, working out the best trades is just a matter of computation. Economists have long understood this. One problem, in practice, is that spelling out exactly what you want is often too tedious to be worth the effort. A café manager, for example, could build the ideal schedule for their 20 employees if each person tabulated exactly what every single shift is worth to them in terms of every other—whether they’d take two Saturday mornings over one Friday close, whether a late close is fine as long as they’re not opening the next morning, and so on. If AI agents could learn what a person wants from a breezy conversation, markets that were too costly to run centrally could become practical. 1 But a central market also needs someone to run it—a “clearinghouse,” in economics parlance. And participants need to trust this entity with their information, and to enforce the chosen outcomes. Often, no such entity exists, or people would rather not tell it everything. A job seeker may not want a central matchmaker to know that they’re looking—or what they’re looking for. They’d rather approach a few employers discreetly, telling each only what it needs to know. In such cases, the market needs to be decentralized. Here, AI agents could enable new decentralized marketplaces by reducing the effort it takes to find counterparties and negotiate. We already know this kind of help is valuable, because people pay for it. There are human agents for hire who do exactly this: real estate agents, headhunters, even matchmakers. But because search and negotiation take up hours of a person’s scarce attention, they are expensive, employed only by those who can afford them. In contrast, an AI agent’s attention is far less scarce. If it bargains well too, more people could have what homesellers and executives have—an agent working tirelessly on their behalf. Figure 1: An illustration of the experiment design. Participants tell their agent about what they want to read. The agents take those preferences onto a decentralized trading floor to swap books with other agents. Participants take home the book their agent acquired for them. We simulate centralized market outcomes for comparison. How the experiment worked The 201 participants were spread across six local pools in the San Francisco, New York City, London, Seattle, DC, and Dublin offices. These pools ranged from three participants (Dublin) to 115 participants (San Francisco). With apologies to James Joyce, we exclude Dubliners from most of the analysis. 2 This is our second look at Claude-powered markets. In Project Deal , agents bought and sold real goods for Anthropic employees in a week-long classified marketplace. But with idiosyncratic goods (like ping-pong balls and snowboards) and free-form haggling, there was no simple way to say how good the outcomes could have been . So this time we built a market that is much simpler to study and to score. In this market, participants’ preferences were neatly represented as a ranking of all the books in their pool. We could then easily compute how well the market did at satisfying these preferences. But these clean measurements all hinge on knowing how people rank all the books in the pool. In practice, no one will rank 115 books by hand. So to learn people’s preferences, Claude conducted a short, semi-structured intake conversation with each participant, with a few open-ended questions about their general tastes and the kind of book they wanted to read this summer. From that conversation, Claude constructed a ranking over every book in the participant’s pool, estimating the participant’s preferences. For this step, we used a strong model, Fable 5. 3 Separately, we collected a ground truth: each participant ranked 10 books from their pool. 4 The agents never saw these ground-truth rankings.
由 claude-code/sonnet 自動生成