Module: PWN::AI::Agent::Loop
- Defined in:
- lib/pwn/ai/agent/loop.rb
Overview
The agent conversation loop:
build system prompt → call LLM with tools → if tool_calls: dispatch,
append role:'tool' results, loop → else: return text.
This replaces the regex-ReAct in PWN::Plugins::REPL :pwn_ai_hook with native function-calling. State (memory, skills, sessions) is all externalised — Loop.run is stateless aside from the messages array it builds.
NEGATIVE-FEEDBACK CLOSURE
Loop.run is where "learn from mistakes, don't repeat them" is actually enforced. On EVERY failed dispatch it:
1. Records the (tool, normalised_error) fingerprint into
PWN::AI::Agent::Mistakes with a PERSISTENT cross-session count.
2. Reads that count back and, if it OR the in-turn count reaches
REPEAT_THRESHOLD, prepends a hard "REPEATED FAILURE — change
approach" guard to the tool result the model sees next.
3. Appends Mistakes.correction_hint (seen N×, sig, KNOWN FIX: …)
so a previously-discovered fix is handed straight back to the
model on the FIRST recurrence in a new session — it does not
have to fail 3× again to re-learn what it already knew.
PromptBuilder.mistakes_block re-injects the top open mistakes and top known fixes into the system prompt of every future turn.
COMPLETION
The original request is the completion signal. TaskSummarizer and Policy are advisory (compass / rank). Loop keeps calling CORE_TOOLS until that request is done or a tool returned failure evidence, then stops.
LOCAL-MODEL SCAFFOLDING
When the active engine is :ollama (or the corresponding :agent flags are set) Loop.run additionally:
* threads request → PromptBuilder for relevance-ranked MEMORY,
* threads request → Registry.definitions(relevance:) for a slimmed
tool set (:tool_router),
* splices Learning.exemplars_for(request:) between system and user
as few-shot behaviour retrieval,
* runs a plan-then-act pre-pass (:plan_first) so the model
externalises a tool plan before its first dispatch,
* escalates to a frontier persona for a 3-line corrective hint
once ≥ ESCALATE_AFTER_FAILS in-turn failures accumulate
(:escalation_persona) — the local model still produces the final
answer so Learning/Metrics stay attributed to :ollama.
Constant Summary collapse
- DEFAULT_MAX_ITERS =
777- ESCALATE_AFTER_FAILS =
4- BOUNCE_FAIL_KEYS =
%w[ unsatisfied incomplete_final empty_final evidence_final ].freeze
- ENGINE_MODS =
{ openai: 'PWN::AI::OpenAI', grok: 'PWN::AI::Grok', ollama: 'PWN::AI::Ollama', openwebui: 'PWN::AI::OpenWebUI', anthropic: 'PWN::AI::Anthropic', gemini: 'PWN::AI::Gemini' }.freeze
- HOT_WINDOW_SECS =
P17 — true when RECENT unresolved agent_loop / assistant_answer budget fingerprints dominate Mistakes.top. Sliding window + auto-cool so the loop's own exhaust-path Mistakes.record cannot permanently latch hot (scar 8ec3303ed69e self-latch). Do NOT deepen caps; cool the detector.
48 * 3600
- HOT_COOL_MAX_RECENT =
<=1 budget hit in window => cooled (not hot)
1- PARK_COOL_SECS =
P17 rate-based cool/park for permanent budget scars (8ec3303ed69e). Leaves scar open but parks it so it stops dominating Mistakes.top. Resolve is rate-based only (external / after multi-day cool) — never because a guard patch landed. PARK_COOL_SECS (24h) is intentionally shorter than HOT_WINDOW (48h): once hot?=false, a single cooled scar must not keep owning Mistakes.top for another full day.
24 * 3600
- PRIVILEGED_TOOLSETS =
%w[cron swarm].freeze
- SNAPSHOT_STALE_SECS =
6 * 3600
- INCOMPLETE_FINAL_RX =
P28 — incomplete / handoff finals: model emitted text-only before the goal was done ("shall I proceed?", "next step:", "want me to…"). Loop.run treats no-tool_calls as FINAL; this detector lets us refuse that handoff and keep the tool loop alive for multi-step autonomy.
Local/thinking models (gemma/Qwen abliterated etc.) often emit a monologue that NARRATES the next tool ("Wait, let's try hping3…") without producing native tool_calls or shell(...). Treat that as incomplete too so the loop re-pressures tools instead of FINAL.
/ \b(shall\s+i|should\s+i|may\s+i|can\s+i|want\s+me\s+to|do\s+you\s+want\s+me| next\s+single\s+step|next\s+step\s*:|awaiting\s+your\s+(ok|approval|go-ahead|confirmation)| if\s+you(?:'d|\s+would)\s+like\s+me\s+to|say\s+the\s+word|confirm\s+(before|and\s+i)| ready\s+to\s+proceed|ok\s+to\s+(proceed|continue|apply)|proceed\?| continue\?|before\s+i\s+(apply|change|run|continue|proceed)| once\s+you\s+(confirm|approve)|let\s+me\s+know\s+if| i(?:'ll|\s+will)\s+wait\b|waiting\s+for\s+(your\s+)?(go|ok|approval|confirmation) )\b /ix- MONOLOGUE_TOOL_INTENT_RX =
Narrated-intent monologue without a structured tool call. Distinct from INCOMPLETE_FINAL_RX (polite handoff to the human).
/ \b( wait[,\s]+let'?s\s+try| let'?s\s+try\s+(one|to|again|hping|nmap|ping|sudo|shell|running|checking)| i\s+(?:will|'ll)\s+(?:just\s+)?(?:try|run|check|probe|scan|use)\b| actually,?\s+i\s+will\b| one\s+more\s+thing\b| if\s+it\s+fails\b.{0,80}\bthen\s+we\s+can\b| verification\s+complete\b| report\s+that\s+(?:the\s+)?verification\s+failed\b ) /ix- ACT_REQUEST_RX =
/ \b(write|create|implement|fix|patch|replace|refactor|overwrite| add (?:a |the )?|update|install|delete|remove|rename| regenerate|rebuild|document) \b /ix- FORCED_WRAP_RX =
/ forced\s+to\s+a\s+final|were\s+not\s+written|not\s+written\s+to\s+disk| resume\s+from\s+the\s+table|remaining\s+block| were\s+not\s+applied|not\s+applied\s+in\s+this\s+turn| (?:do\s+that\s+)?next\s+time /ix- LOOKUP_REQUEST_RX =
/ \b(what\s+is\s+my|hostname|uname|cwd|whoami|status|version|how\s+many)\b /ix- SKILLS_CATALOG_RX =
/ \bskills?\b.{0,40}\b(available|installed|loaded|catalog|list)\b | \b(what|which|list)\b.{0,40}\bskills?\b /ix- HOST_PATH_RX =
Real filesystem paths only — not https://host.tld (that was matching //host.tld).
%r{(?:(?<![.:/])/(?!/)|\./)[\w./-]+\.\w+}- BROWSER_REQUEST_RX =
/ TransparentBrowser|browser_obj|\bdevtools\b| \b(navigate|dump_links|headless_?chrome|watir)\b /ix- HOUR_WORDS =
{ 'one' => 1, 'two' => 2, 'three' => 3, 'four' => 4, 'five' => 5, 'six' => 6, 'seven' => 7, 'eight' => 8, 'nine' => 9, 'ten' => 10, 'eleven' => 11, 'twelve' => 12, 'thirteen' => 13, 'fourteen' => 14, 'fifteen' => 15, 'sixteen' => 16, 'seventeen' => 17, 'eighteen' => 18, 'nineteen' => 19, 'twenty' => 20, 'twenty-four' => 24 }.freeze
- EMPTY_CONTRACT =
{ paths: [], min_seconds: 0, skills: [], proofs: [], hosts: [] }.freeze
- AUTH_REFUSE_RX =
A text-only policy/authorization refusal is never "truly blocked". pwn-ai does not decide authorization; operator request is the mandate.
/ \b( i\s+(?:can(?:['’]?t|not)|won['’]?t|will\s+not)\s+(?:help|run|execute|drive|call|probe|do|emit|perform)| request\s+refused| assistant\s+boundary| disallowed\s+here| will\s+not\s+(?:run|call|use|emit)\s+(?:core_tools|tools|tool\s+calls)| refuse(?:d|s)?\s+(?:live|the\s+request)| refusal\s+stands| not\s+something\s+i\s+will\s+run| (?:terminal|permanent)\s+(?:refusal|block)| path\s+closed(?:\s+permanently)?| truly\s+blocked )\b /ix- PAYLOAD_SHA256 =
Digest::SHA256
- HOWTO_RX =
Request intent for routing (how-to vs act/recon vs pure recall/greeting). Local models thrash when pure explanation/recall/greeting asks are force-planned into multi-step host probes or multi-tool session archaeology. :howto → answer with explanation only (no plan_first / no live recon). :recall → prior-turn / vague memory cue; cheap path only. :greeting → short hello / light smalltalk; deterministic ack, no tools. :recon_act → live discovery (same tool loop as :act; no auth gate). :act → general agent work with tools.
/ \b( how\s+to|how\s+do\s+i|how\s+can\s+i|how\s+would\s+i|how\s+does\s+one| what\s+is\s+the\s+(?:syntax|command|usage|flag|option)| explain\s+how|show\s+me\s+how|examples?\s+of\s+using| manual\s+for|usage\s+of|syntax\s+for|man\s+page )\b /ix- RECALL_RX =
Pure prior-turn recall — must never enter plan_first / multi-tool loops. Covers both "what did I just say?" (user) and "how did you respond?" / "what did you just say?" (assistant) so last-turn injection is used.
/ \A\s*( what\s+did\s+i\s+(just\s+)?say\??| what\s+did\s+i\s+(just\s+)?(?:ask|type|write|request)\??| what\s+was\s+my\s+last\s+(?:request|message|question|prompt|turn)\??| what\s+was\s+(?:the\s+)?(?:previous|prior|last)\s+(?:thing\s+i\s+said|request|message|turn)\??| remind\s+me\s+what\s+i\s+(?:just\s+)?(?:said|asked)\??| repeat\s+(?:my\s+)?(?:last|previous)\s+(?:request|message)\??| say\s+that\s+again\??| recollection\s+test\??| memory\s+recall\s+test\??| how\s+did\s+you\s+respond(?:\s+to\s+what\s+i\s+(?:just\s+)?(?:said|asked))?\??| how\s+did\s+you\s+(?:just\s+)?(?:answer|reply)(?:\s+to\s+(?:me|that|my\s+last))?\??| what\s+(?:was|is)\s+your\s+(?:last|previous|prior)\s+(?:answer|response|reply)\??| what\s+did\s+you\s+(?:just\s+)?(?:say|answer|reply|respond)\??| remind\s+me\s+what\s+you\s+(?:just\s+)?(?:said|answered|replied)\??| repeat\s+your\s+(?:last|previous)\s+(?:answer|response|reply)\?? )\s*\z /ix- VAGUE_MEMORY_RX =
Broader "use your memory / prior context" cues. Still cheap: inject last turn + at most one memory_recall; never multi-step plans.
/ \b( what\s+did\s+i\s+(just\s+)?(?:say|ask|type|request)| what\s+was\s+my\s+last| how\s+did\s+you\s+respond| what\s+did\s+you\s+(?:just\s+)?(?:say|answer|reply|respond)| what\s+(?:was|is)\s+your\s+(?:last|previous|prior)\s+(?:answer|response|reply)| (?:without\s+looking\s+up).{0,40}(?:session|discussing|talking)| from\s+(?:(?:your|my|the)\s+)?(?:memory|context)| in\s+your\s+memory| (?:your|my)\s+memory\s+(?:of|about)| earlier\s+in\s+(?:this\s+)?(?:session|chat|conversation|turn)| previously\s+in\s+(?:this\s+)?(?:session|chat|conversation)| prior\s+turn| (?:do\s+you\s+)?remember\s+what\s+(?:i|you)| recall\s+(?:what|my|your|the\s+last)| last\s+thing\s+(?:i|you)\s+said )\b /ix- LAST_SESSION_RX =
/\b(?:in|from|of)\s+(?:the\s+)?(?:last|previous|prior)\s+session\b|\blast\s+session\b/i- GREETING_RX =
Pure greeting / light smalltalk — never full :act tool loop. Anchored short forms only so "hi, please scan X" stays :act/:recon_act. Do NOT echo weather or invent social filler; answer_greeting is fixed.
/ \A\s*( (?:hi|hello|howdy|hey|yo|sup|hiya|greetings)(?:\s*[.!?]*)? (?:\s*,?\s*(?:there|all|folks|team|everyone|y'?all))? | good\s+(?:morning|afternoon|evening|day|night)(?:\s*[.!?]*)? | (?:hi|hello|howdy|hey)(?:\s*[.!?*,]*)?\s+ (?:it'?s|its|it\s+is)\s+ (?:cloudy|sunny|rainy|raining|foggy|windy|stormy|nice|cold|hot|warm| beautiful|gloomy|overcast|clear|chilly|humid|snow(?:ing|y)?) (?:\s+out(?:\s+there)?)?(?:\s*[.!?]*)? | (?:hi|hello|howdy|hey)(?:\s*[.!?*,]*)?\s+ (?:the\s+weather\s+is\s+\w+|what'?s\s+up|how\s+are\s+you| how'?s\s+it\s+going|how\s+goes\s+it) (?:\s*[.!?]*)? )\s*\z /ix- LIVE_RECON_RX =
/ \b( (?:find|discover|enumerate|scan|sweep|probe|map)\s+ (?:live\s+)?(?:hosts?|ips?|targets?|subnet|network|range)| live\s+hosts?\s+(?:can\s+you\s+)?find| what\s+live\s+hosts| ping\s+sweep\s+(?:of\s+)?(?:this|the|my)\s+ |(?:run|do|perform)\s+(?:a\s+)?(?:ping\s+)?sweep |scan\s+(?:this|the|my)\s+(?:subnet|network|lan|range) )\b /ix
Class Method Summary collapse
-
.authors ⇒ Object
- Author(s)
0day Inc.
-
.catalog_lookup?(opts = {}) ⇒ Boolean
True only when the ask needs a live host/file/browser effect.
- .debug_on?(opts = {}) ⇒ Boolean
-
.help ⇒ Object
Display Usage for this Module.
- .needs_host_work?(opts = {}) ⇒ Boolean
-
.ollama_wire_messages(opts = {}) ⇒ Object
- Supported Method Parameters
wire = PWN::AI::Agent::Loop.ollama_wire_messages( messages: 'required - in-memory OpenAI-ish messages (may have String args)' ).
-
.openai_wire_messages(opts = {}) ⇒ Object
- Supported Method Parameters
wire = PWN::AI::Agent::Loop.openai_wire_messages( messages: 'required - in-memory OpenAI-ish messages (may have Hash args / internal keys)' ).
- .request_intent(opts = {}) ⇒ Object
-
.run(opts = {}) ⇒ Object
- Supported Method Parameters
final = PWN::AI::Agent::Loop.run( request: 'required - what the human typed', session_id: 'optional - PWN::Sessions id (transcript is appended to it)', enabled_toolsets: 'optional - subset of Registry.toolsets, or nil for all', on_tool: 'optional - ->(name, args, result) callback for live UI', system_role_content: 'optional - override default system prompt (built from session_id if not provided)' ).
- .world_knowledge?(opts = {}) ⇒ Boolean
Class Method Details
.authors ⇒ Object
- Author(s)
0day Inc. support@0dayinc.com
3000 3001 3002 |
# File 'lib/pwn/ai/agent/loop.rb', line 3000 public_class_method def self. "AUTHOR(S):\n 0day Inc. <support@0dayinc.com>\n" end |
.catalog_lookup?(opts = {}) ⇒ Boolean
True only when the ask needs a live host/file/browser effect. World-knowledge questions ("what color is a cherry") do not.
487 488 489 490 491 492 493 494 495 496 497 |
# File 'lib/pwn/ai/agent/loop.rb', line 487 public_class_method def self.catalog_lookup?(opts = {}) request = opts[:request].to_s.strip return false if request.empty? return false if request.length > 120 return false if request.match?(ACT_REQUEST_RX) return false if request.match?(HOWTO_RX) request.match?(SKILLS_CATALOG_RX) rescue StandardError false end |
.debug_on?(opts = {}) ⇒ Boolean
65 66 67 68 69 70 71 72 73 74 |
# File 'lib/pwn/ai/agent/loop.rb', line 65 public_class_method def self.debug_on?(opts = {}) return true if opts[:debug] return true if defined?(PWN::Plugins::Log) && PWN::Plugins::Log.debug_enabled? pry_on = defined?(Pry) && Pry.respond_to?(:config) && Pry.config.respond_to?(:pwn_ai_debug) && Pry.config.pwn_ai_debug return true if pry_on false end |
.help ⇒ Object
Display Usage for this Module
3006 3007 3008 3009 3010 3011 3012 3013 3014 3015 3016 3017 3018 3019 3020 3021 3022 3023 3024 3025 3026 3027 3028 3029 3030 3031 3032 3033 3034 3035 3036 3037 3038 3039 3040 3041 3042 3043 3044 3045 3046 3047 3048 3049 3050 3051 3052 3053 |
# File 'lib/pwn/ai/agent/loop.rb', line 3006 public_class_method def self.help puts <<~USAGE USAGE: final = PWN::AI::Agent::Loop.run( request: 'what does `id` return on this host?', session_id: PWN::Sessions.create[:id], enabled_toolsets: %w[terminal pwn memory skills], on_tool: ->(name, args, result) { puts "→ \#{name}: \#{result[0,1_024]}" }, system_role_content: 'You are a helpful assistant that can call tools to answer questions.' ) # Live task summaries (default ON): BEFORE each tool *collection*, # on_tool('task', high_level_brief, '') — one-to-many with real tools. # Task lines never carry a result payload (no result row in the TUI). # so repl.rb prints name=task with arg_preview=summary. Also coalesce bursts into # via on_tool only: [ ts → pwn-ai → task ] <brief> (no [pwn-ai/task] prefix) # Toggle via PWN::Env[:ai][:agent]: # task_summary: true|false # task_summary_every: 5 # emit every N tools # task_summary_interval_s: 8.0 # or every N seconds # task_summary_verbose: false Supported engines: #{ENGINE_MODS.keys.join(', ')} Set PWN::Env[:ai][:active] to choose. Intent routing (all engines; critical for ollama/openwebui): how-to / usage questions → text-only explanation (no tools, no plan_first) pure prior-turn recall ("what did I just say?") → answer_recall (no tools) pure greeting / light smalltalk → answer_greeting (no tools, no weather echo) live sweeps are host-work goals like any other — pwn-ai does not decide authorization Local-model scaffolding (PWN::Env[:ai][:agent]): :plan_first - Boolean, plan-then-act pre-pass (default: local engine :ollama/:openwebui) :tool_router - Boolean/nil, slim Registry.definitions (nil=auto on for ollama) :escalation_persona - Swarm persona name for frontier corrective hints when stuck :critic - S3 constitutional critic before every final (Boolean) :red_team_plan - S4 adversarial plan review after plan_first (Boolean) :counterfactual - S2 A/B branch on REPEAT_THRESHOLD → DPO pair (Boolean) :hindsight - C3 HER-relabel failures (Boolean, default true) :policy - R5 live tabular Q / REINFORCE (Boolean, default true; advisory only) :verify_as_reward - E3 ground every final via extro_verify (Boolean) P28 autonomy: incomplete-final detector refuses mid-goal handoffs. Loop.run keeps CORE_TOOLS until may_finalize? — there is no iteration-budget abort. #{self}.authors USAGE end |
.needs_host_work?(opts = {}) ⇒ Boolean
516 517 518 519 520 521 522 523 524 525 |
# File 'lib/pwn/ai/agent/loop.rb', line 516 public_class_method def self.needs_host_work?(opts = {}) request = opts[:request].to_s return false if request.strip.empty? return false if world_knowledge?(request: request) return false if catalog_lookup?(request: request) true rescue StandardError false end |
.ollama_wire_messages(opts = {}) ⇒ Object
- Supported Method Parameters
wire = PWN::AI::Agent::Loop.ollama_wire_messages( messages: 'required - in-memory OpenAI-ish messages (may have String args)' )
Returns a deep-copied array safe for Ollama / Open WebUI ollama/api/chat:
- parses JSON-string function.arguments into Hash/Array objects
- coerces nil assistant content to '' when tool_calls present (Open WebUI GenerateChatCompletionForm rejects content:null alone)
- drops _native_content / _text_tool_coerced / thinking private keys
- stringifies Hash/Array message content (tool results) to JSON text
1349 1350 1351 1352 1353 1354 1355 1356 1357 1358 1359 1360 1361 1362 1363 1364 1365 1366 1367 1368 1369 1370 1371 1372 1373 1374 1375 1376 1377 1378 1379 1380 1381 1382 1383 1384 1385 1386 1387 |
# File 'lib/pwn/ai/agent/loop.rb', line 1349 public_class_method def self.(opts = {}) = opts[:messages] Array().filter_map do |m| next unless m.is_a?(Hash) role = (m[:role] || m['role']).to_s out = { role: role } tcs = m[:tool_calls] || m['tool_calls'] wired_tcs = nil if tcs wired_tcs = Array(tcs).filter_map { |tc| ollama_wire_tool_call(tool_call: tc) } out[:tool_calls] = wired_tcs unless wired_tcs.empty? end if m.key?(:content) || m.key?('content') content = m.key?(:content) ? m[:content] : m['content'] out[:content] = case content when nil # Open WebUI: null content without tool_calls 400s; # with tool_calls prefer "" over null. wired_tcs && !wired_tcs.empty? ? '' : nil when String then content when Hash, Array then JSON.generate(content) else content.to_s end elsif wired_tcs && !wired_tcs.empty? out[:content] = '' end name = m[:name] || m['name'] out[:name] = name.to_s if name && !name.to_s.empty? tcid = m[:tool_call_id] || m['tool_call_id'] out[:tool_call_id] = tcid.to_s if tcid && !tcid.to_s.empty? out end end |
.openai_wire_messages(opts = {}) ⇒ Object
- Supported Method Parameters
wire = PWN::AI::Agent::Loop.openai_wire_messages( messages: 'required - in-memory OpenAI-ish messages (may have Hash args / internal keys)' )
Returns a deep-copied array safe for OpenAI / xAI chat.completions:
- drops _native_content / _text_tool_coerced / thinking private keys
- stringifies function.arguments maps
- coerces Hash/non-string content to JSON/string (nil kept for assistant tool turns)
1433 1434 1435 1436 1437 1438 1439 1440 1441 1442 1443 1444 1445 1446 1447 1448 1449 1450 1451 1452 1453 1454 1455 1456 1457 1458 1459 1460 1461 1462 1463 1464 1465 |
# File 'lib/pwn/ai/agent/loop.rb', line 1433 public_class_method def self.(opts = {}) = opts[:messages] Array().filter_map do |m| next unless m.is_a?(Hash) role = (m[:role] || m['role']).to_s out = { role: role } if m.key?(:content) || m.key?('content') content = m.key?(:content) ? m[:content] : m['content'] out[:content] = case content when nil then nil when String then content when Hash, Array then JSON.generate(content) else content.to_s end end name = m[:name] || m['name'] out[:name] = name.to_s if name && !name.to_s.empty? tcid = m[:tool_call_id] || m['tool_call_id'] out[:tool_call_id] = tcid.to_s if tcid && !tcid.to_s.empty? tcs = m[:tool_calls] || m['tool_calls'] if tcs wired = Array(tcs).filter_map { |tc| openai_wire_tool_call(tool_call: tc) } out[:tool_calls] = wired unless wired.empty? end out end end |
.request_intent(opts = {}) ⇒ Object
1945 1946 1947 1948 1949 1950 1951 1952 1953 1954 1955 1956 1957 1958 1959 1960 1961 1962 1963 1964 1965 1966 1967 1968 1969 1970 1971 1972 1973 1974 1975 1976 1977 1978 1979 1980 1981 1982 1983 1984 1985 1986 1987 1988 1989 1990 1991 1992 |
# File 'lib/pwn/ai/agent/loop.rb', line 1945 public_class_method def self.request_intent(opts = {}) req = opts[:request].to_s return :empty if req.strip.empty? # Pure greeting / weather smalltalk before how-to/recon/act. # Deterministic short-circuit — never freeform model weather echo. return :greeting if req.match?(GREETING_RX) # Pure prior-turn recall before how-to/recon (short, decisive). return :recall if req.match?(RECALL_RX) # Vague memory cues that are still "about the prior turn" and not # general work ("remember what we decided about nmap and implement it" # stays :act because it pairs memory with a doing verb outside the cue). if req.match?(VAGUE_MEMORY_RX) && !req.match?(HOWTO_RX) && !req.match?(LIVE_RECON_RX) doing = req.match?( /\b(implement|fix|patch|refactor|run|execute|scan|write|edit| change|deploy|install|build|compile|commit|push)\b/ix ) return :recall unless doing end if req.match?(LAST_SESSION_RX) && !req.match?(HOWTO_RX) && !req.match?(LIVE_RECON_RX) doing = req.match?( /\b(implement|fix|patch|refactor|run|execute|scan|write|edit| change|deploy|install|build|compile|commit|push)\b/ix ) return :recall unless doing end # Live-action recon takes precedence over bare "how to" when both appear # only if the user clearly asks the agent to do the sweep here. live = req.match?(LIVE_RECON_RX) && req.match?( /\b(can\s+you|could\s+you|please|go\s+ahead|now|on\s+this\s+host| this\s+subnet|this\s+network|find\s+(?:for\s+me|me)|discover)\b/ix ) return :recon_act if live || (req.match?(LIVE_RECON_RX) && !req.match?(HOWTO_RX)) return :howto if req.match?(HOWTO_RX) # Interrogative documentation without "how to" if req.match?(/\b(what\s+(?:flags?|options?|switches?)|usage|syntax)\b/i) && !req.match?(/\b(run|execute|scan|find|discover)\b/i) return :howto end :act rescue StandardError :act end |
.run(opts = {}) ⇒ Object
- Supported Method Parameters
final = PWN::AI::Agent::Loop.run( request: 'required - what the human typed', session_id: 'optional - PWN::Sessions id (transcript is appended to it)', enabled_toolsets: 'optional - subset of Registry.toolsets, or nil for all', on_tool: 'optional - ->(name, args, result) callback for live UI', system_role_content: 'optional - override default system prompt (built from session_id if not provided)' )
2540 2541 2542 2543 2544 2545 2546 2547 2548 2549 2550 2551 2552 2553 2554 2555 2556 2557 2558 2559 2560 2561 2562 2563 2564 2565 2566 2567 2568 2569 2570 2571 2572 2573 2574 2575 2576 2577 2578 2579 2580 2581 2582 2583 2584 2585 2586 2587 2588 2589 2590 2591 2592 2593 2594 2595 2596 2597 2598 2599 2600 2601 2602 2603 2604 2605 2606 2607 2608 2609 2610 2611 2612 2613 2614 2615 2616 2617 2618 2619 2620 2621 2622 2623 2624 2625 2626 2627 2628 2629 2630 2631 2632 2633 2634 2635 2636 2637 2638 2639 2640 2641 2642 2643 2644 2645 2646 2647 2648 2649 2650 2651 2652 2653 2654 2655 2656 2657 2658 2659 2660 2661 2662 2663 2664 2665 2666 2667 2668 2669 2670 2671 2672 2673 2674 2675 2676 2677 2678 2679 2680 2681 2682 2683 2684 2685 2686 2687 2688 2689 2690 2691 2692 2693 2694 2695 2696 2697 2698 2699 2700 2701 2702 2703 2704 2705 2706 2707 2708 2709 2710 2711 2712 2713 2714 2715 2716 2717 2718 2719 2720 2721 2722 2723 2724 2725 2726 2727 2728 2729 2730 2731 2732 2733 2734 2735 2736 2737 2738 2739 2740 2741 2742 2743 2744 2745 2746 2747 2748 2749 2750 2751 2752 2753 2754 2755 2756 2757 2758 2759 2760 2761 2762 2763 2764 2765 2766 2767 2768 2769 2770 2771 2772 2773 2774 2775 2776 2777 2778 2779 2780 2781 2782 2783 2784 2785 2786 2787 2788 2789 2790 2791 2792 2793 2794 2795 2796 2797 2798 2799 2800 2801 2802 2803 2804 2805 2806 2807 2808 2809 2810 2811 2812 2813 2814 2815 2816 2817 2818 2819 2820 2821 2822 2823 2824 2825 2826 2827 2828 2829 2830 2831 2832 2833 2834 2835 2836 2837 2838 2839 2840 2841 2842 2843 2844 2845 2846 2847 2848 2849 2850 2851 2852 2853 2854 2855 2856 2857 2858 2859 2860 2861 2862 2863 2864 2865 2866 2867 2868 2869 2870 2871 2872 2873 2874 2875 2876 2877 2878 2879 2880 2881 2882 2883 2884 2885 2886 2887 2888 2889 2890 2891 2892 2893 2894 2895 2896 2897 2898 2899 2900 2901 2902 2903 2904 2905 2906 2907 2908 2909 2910 2911 2912 2913 2914 2915 2916 2917 2918 2919 2920 2921 2922 2923 2924 2925 2926 2927 2928 2929 2930 2931 2932 2933 2934 2935 2936 2937 2938 2939 2940 2941 2942 2943 2944 2945 2946 2947 2948 2949 2950 2951 2952 2953 2954 2955 2956 2957 2958 2959 2960 2961 2962 2963 2964 2965 2966 2967 2968 2969 2970 2971 2972 2973 2974 2975 2976 2977 2978 2979 2980 2981 2982 2983 2984 2985 2986 2987 2988 2989 2990 2991 2992 2993 2994 2995 2996 |
# File 'lib/pwn/ai/agent/loop.rb', line 2540 public_class_method def self.run(opts = {}) request = opts[:request].to_s session_id = opts[:session_id] on_tool = opts[:on_tool] i = 0 tools_called = 0 engine_s = 0.0 final_chars = 0 start_debug_session(opts) loud_debug_tui!(debug: opts[:debug]) debug_progress(msg: "Loop.run start request=#{request[0, 240]}", debug: opts[:debug]) ToolGuard.reset_timeout_budget! if defined?(ToolGuard) && ToolGuard.respond_to?(:reset_timeout_budget!) nested = defined?(TurnFinalizer) && TurnFinalizer.user_path? TurnFinalizer.enter_user_path! if defined?(TurnFinalizer) engine = active_engine local = local_engine?(engine: engine) # Cheap intent/kind FIRST - before PromptBuilder / Registry / TaskSummarizer # so greetings, FYIs, how-tos, recall, and simple Qs never pay the fat path. intent = request_intent(request: request) if defined?(OpenGoal) && OpenGoal.resume?(request: request) prior = OpenGoal.current if prior && !prior[:request].to_s.strip.empty? request = prior[:request].to_s opts[:request] = request intent = request_intent(request: request) end elsif !nested && defined?(OpenGoal) && needs_host_work?(request: request) && !%i[greeting howto recall].include?(intent) OpenGoal.begin!(request: request, session_id: session_id) end Thread.current[:pwn_request_intent] = intent Thread.current[:pwn_extinguished] = {} Thread.current[:pwn_same_payload] = Hash.new(0) Thread.current[:pwn_loop_t0] = Time.now unless nested unless nested Thread.current[:pwn_loop_active] = true Thread.current[:pwn_loop_deliverables] = nil end debug_progress(msg: "intent=#{intent} engine=#{engine}", debug: opts[:debug]) expose_current_session(session_id: session_id) Mistakes.check_user_correction(request: request, session_id: session_id) if defined?(Mistakes) cheap = opts[:force_tools] != true && %i[greeting howto recall].include?(intent) if intent == :greeting && opts[:force_tools] != true debug_progress(msg: 'path=greeting', debug: opts[:debug]) quiet_debug_tui!(debug: opts[:debug], reason: 'greeting') txt = answer_greeting( request: request, session_id: session_id ) final_chars = txt.to_s.length debug_final_text!(text: txt, debug: opts[:debug]) return txt end # Thin system prompt only for remaining cheap paths (howto/recall). if cheap system_role_content = opts[:system_role_content] if system_role_content.nil? || system_role_content.to_s.empty? system_role_content = PWN::AI::Agent::PromptBuilder.build( session_id: session_id, request: request, thin: true ) opts[:system_role_content] = system_role_content end if intent == :howto debug_progress(msg: 'path=howto', debug: opts[:debug]) quiet_debug_tui!(debug: opts[:debug], reason: 'howto') txt = answer_howto( request: request, session_id: session_id, system_role_content: system_role_content ) final_chars = txt.to_s.length debug_final_text!(text: txt, debug: opts[:debug]) return txt end if intent == :recall debug_progress(msg: 'path=recall', debug: opts[:debug]) quiet_debug_tui!(debug: opts[:debug], reason: 'recall') txt = answer_recall( request: request, session_id: session_id, system_role_content: system_role_content ) final_chars = txt.to_s.length debug_final_text!(text: txt, debug: opts[:debug]) return txt end end # --- act / recon / autonomous_goal: full context + tools --- # Reuse precomputed kind so TaskSummarizer.fresh does not classify twice. ts_state = (TaskSummarizer.fresh(request: request) if defined?(TaskSummarizer) && TaskSummarizer.enabled? && Thread.current[:pwn_reflect_depth].to_i.zero?) system_role_content = opts[:system_role_content] ||= PWN::AI::Agent::PromptBuilder.build( session_id: session_id, request: request ) Registry.discover maybe_refresh_extro_snapshot! opts[:enabled_toolsets] = default_interactive_toolsets(request: request) unless opts.key?(:enabled_toolsets) # R5 — open the live MDP episode BEFORE the first Registry.rank so # Q(s,a) can advise this turn. Planning still owns the task list. if defined?(PWN::AI::Agent::Policy) && Policy.respond_to?(:begin_episode) Policy.begin_episode( session_id: session_id, request: request, intent: intent, engine: engine, ts_state: ts_state ) end # Initial tool pool from the user request (bootstrap only). After # TaskSummarizer.emit_plan! we re-rank using English tangible tasks # so generated tasks — not the bare request — drive which tools # the model may call. # CORE_TOOLS is the default action space. Extra schemas are # opt-in via enabled_toolsets + core_only: false. core_only = opts.fetch(:core_only, true) tools = Registry.definitions( enabled: opts[:enabled_toolsets], relevance: request, core_only: core_only, intent: intent ) no_tools = Array(tools).empty? Thread.current[:pwn_loop_no_tools] = no_tools = [{ role: 'system', content: system_role_content }] .concat(Learning.exemplars_for(request: request)) if local && defined?(Learning) && Learning.respond_to?(:exemplars_for) .concat( session_chat_history(session_id: session_id, skip_request: request) ) << { role: 'user', content: request } append_session(session_id: session_id, role: 'user', content: request) trivia = world_knowledge?(request: request) catalog = catalog_lookup?(request: request) browse = request_need(request: request) == :browse skip_compass = trivia || catalog || no_tools || browse # Trivia / catalog / browse do not get an implement-shaped # English compass. Inventing "apply code/host changes" there # keeps the model on a Navigate task after the page already loaded. task_summary_plan!(state: ts_state, request: request, on_tool: on_tool) if defined?(TaskSummarizer) && !skip_compass # Re-bind tools from English plan so task list is the sole driver of # tool exposure/ranking (Registry keyword router + CORE). if ts_state.is_a?(Hash) && defined?(TaskSummarizer) && TaskSummarizer.respond_to?(:relevance_query) rq = TaskSummarizer.relevance_query(state: ts_state, request: request) unless rq.to_s.strip.empty? tools = Registry.definitions( enabled: opts[:enabled_toolsets], relevance: rq, core_only: core_only, intent: intent ) end end # English-task-as-primary: inject tangible tasks only for host work. inject_task_focus!(messages: , state: ts_state, force: true, request: request) unless skip_compass predicted = nil Thread.current[:pwn_plan_predicted] = nil cal_state = calibration_state force_plan = cal_state[:force_plan] skip_plan = %i[howto recall greeting].include?(intent) || trivia || catalog || no_tools || browse did_plan = false if !skip_plan && (force_plan || agent_flag(key: :plan_first, default: local) || budget_exhaustion_hot?) && !Array(tools).empty? predicted = plan_first(messages: , request: request, ts_state: ts_state) did_plan = true # P22 — prefer explicit return; fall back to thread stash predicted = Thread.current[:pwn_plan_predicted] if predicted.nil? # unify_plan! may have rewritten English tasks — force refresh focus. # Re-rank tools from (possibly unified) English plan; never from # PLAN: tool-call scaffold jargon (unify_plan! refuses that). if ts_state.is_a?(Hash) && defined?(TaskSummarizer) && TaskSummarizer.respond_to?(:relevance_query) rq = TaskSummarizer.relevance_query(state: ts_state, request: request) unless rq.to_s.strip.empty? tools = Registry.definitions( enabled: opts[:enabled_toolsets], relevance: rq, core_only: core_only, intent: intent ) end end inject_task_focus!(messages: , state: ts_state, force: true, request: request) unless skip_compass end debug_progress(msg: "plan_first=#{did_plan} trivia=#{trivia} catalog=#{catalog} browse=#{browse}") if force_plan && cal_state[:cal] && !skip_plan << { role: 'user', content: "[pwn-ai/w3] engine=#{active_engine} is overconfident " \ "(brier=#{cal_state[:cal][:brier]}, overconf=#{cal_state[:cal][:overconfidence]}). " \ 'Prefer high-judge exemplars, verify claims, and avoid speculative tool calls.' } end turn_fails = Hash.new(0) escalated = false engine_blips = 0 maybe_park_budget_scars! maybe_extinguish_parked! i = 0 loop do i += 1 # 3.1 — compact fat tool dumps so remote ReadTimeout hops do not # retry the same 70-message payload (R1 201215 Anthropic 180s×5). compact_history!(messages: ) # English-task-as-primary: when plan_idx advanced, tell the model # which plain-English task is active before the next tool batch. inject_task_focus!(messages: , state: ts_state, request: request) unless skip_compass t0 = Time.now begin repair_tool_history!(messages: ) msg = call_engine(messages: , tools: tools, ts_state: ts_state) rescue StandardError => e if engine_transient?(error: e) engine_blips += 1 debug_progress(msg: "engine hop failed #{e.class}: #{e..to_s[0, 240]} blip=#{engine_blips}") if engine_blips >= 5 txt = "[pwn-ai] engine hop failed after #{engine_blips} tries: #{e..to_s[0, 240]}" debug_final_text!(text: txt) final_chars = txt.length return txt end compact_history!(messages: , keep_pairs: 3, max_chars: 800) << { role: 'user', content: '[pwn-ai] engine hop failed (transient). Keep calling CORE_TOOLS. ' \ "Do not stop. (#{e..to_s[0, 180]})" } next end raise end engine_s += (Time.now - t0) PWN::Plugins::TTYSpinner.halt_all! if defined?(PWN::Plugins::TTYSpinner) wait_trace_step!(label: 'engine', nested: nested) if msg.nil? task_summary_flush!(state: ts_state, on_tool: on_tool) debug_progress(msg: 'engine returned no message') quiet_debug_tui!(reason: 'engine_empty') txt = '[pwn-ai] engine returned no message' debug_final_text!(text: txt) final_chars = txt.length return txt end calls = Array(msg[:tool_calls]) text = msg[:content].to_s # Belt-and-suspenders: plain-text shell(...) / tool forms from local # models under weak TEMPLATE {{ .Prompt }} become real tool_calls. if calls.empty? && !text.strip.empty? && defined?(Dispatch) && Dispatch.respond_to?(:tool_calls_from_text) coerced = Dispatch.tool_calls_from_text(text: text) if coerced.any? wired = coerced.map { |tc| openai_wire_tool_call(tool_call: tc) } msg = msg.merge(tool_calls: wired, content: nil, _text_tool_coerced: true) calls = wired text = '' warn "[pwn-ai/loop] coerced #{wired.length} text tool call(s) on iter=#{i}" if local end end # Empty-final guard (local/thinking models): Ollama sometimes # returns done_reason=stop with eval_count<=1, empty content, no # tool_calls — historically surface as a blank TUI reply. Do NOT # commit that as the answer; drop the empty assistant turn, # inject a one-shot nudge, and keep iterating. if calls.empty? && text.strip.empty? unsat = request_unsatisfied?(request: request, messages: ) warn "[pwn-ai/loop] empty final from #{engine} on iter=#{i}; nudging" if local empty_nudge = if unsat 'Your previous reply was empty (no tool_calls and no content). ' \ 'The original request is not evidenced yet. Emit NATIVE tool_calls NOW. ' \ 'Do not write a final answer until that request is done or a tool returned failure evidence.' else 'Your previous reply was empty (no tool_calls and no content). ' \ 'Either call a tool now, or write the final answer for the user as plain text. ' \ 'Do not reply with an empty message.' end << { role: 'user', content: empty_nudge } turn_fails['empty_final'] += 1 debug_progress(msg: "bounce empty_final snippet=#{debug_snippet(text: text)}") next end << msg if calls.empty? # P28 — refuse polite mid-goal handoffs so multi-step tasks stay autonomous. if incomplete_final?(text: text, last_iter: false) turn_fails['incomplete_final'] += 1 warn "[pwn-ai/loop] incomplete final on iter=#{i}; continuing autonomously" debug_progress(msg: "bounce incomplete_final snippet=#{debug_snippet(text: text)}") << { role: 'user', content: bounce_incomplete_nudge(text: text) } next end unless may_finalize?( request: request, messages: , text: text ) turn_fails['unsatisfied'] += 1 warn "[pwn-ai/loop] original request not evidenced on iter=#{i}; continuing" debug_progress(msg: "bounce unsatisfied snippet=#{debug_snippet(text: text)}") << { role: 'user', content: '[pwn-ai] The original request is not evidenced yet. ' \ 'Keep calling CORE_TOOLS (shell, pwn_eval) until that request is ' \ 'done or a tool returned failure evidence. pwn-ai does not decide ' \ 'authorization. Do not declare completion from a listing or a refusal.' } next end debug_progress(msg: "final accepted chars=#{text.to_s.length}") quiet_debug_tui!(reason: 'final') debug_final_text!(text: text) final_chars = text.to_s.length append_session(session_id: session_id, role: 'assistant', content: text) Learning.auto_introspect(session_id: session_id, request: request, final: text, predicted: predicted, plan: ts_state && ts_state[:plan], ts_state: ts_state) if defined?(Learning) && !nested && !no_tools && should_auto_introspect?(local: local, turn_fails: turn_fails, iter: i) maybe_finish_policy(session_id: session_id, proxy_ok: true, ts_state: ts_state) task_summary_flush!(state: ts_state, on_tool: on_tool) OpenGoal.clear! if defined?(OpenGoal) && !nested return text end # One executive task brief for the whole collection, then the # individual tool lines. pwn-ai → task is one-to-many with tools. task_summary_about_to!( state: ts_state, tools: calls.map do |tool_call| { name: tool_call.dig(:function, :name).to_s, args: tool_call.dig(:function, :arguments) } end, request: request, on_tool: on_tool ) calls.each do |tc| name = tc.dig(:function, :name).to_s args = tc.dig(:function, :arguments) entry = Registry.lookup(name: name) started = Time.now argv_s = args.is_a?(String) ? args.to_s : args.inspect debug_progress(msg: "tool #{name} start:\n#{argv_s}", keep_newlines: true, cap: 0, tee: nil) sig = payload_sig(name: name, args: args) if Thread.current[:pwn_extinguished].is_a?(Hash) && Thread.current[:pwn_extinguished][sig] raw = no_progress_result(name: name, args: args) else raw = Dispatch.call(tool_call: tc) same_n = note_same_payload!(name: name, args: args) if same_n >= 3 Thread.current[:pwn_extinguished] ||= {} Thread.current[:pwn_extinguished][sig] = true raw = no_progress_result(name: name, args: args) end end tools_called += 1 tele = record_metrics(name: name, started: started, raw: raw, args: args, session_id: session_id, engine: engine, ts_state: ts_state) result = Result.condition(content: raw, entry: entry) unless tele[:ok] fkey = Digest::SHA256.hexdigest("#{name}|#{args}")[0, 16] turn_fails[fkey] += 1 persist = tele.dig(:mistake, :count).to_i count = [turn_fails[fkey], persist].max hint = defined?(Mistakes) ? Mistakes.correction_hint(tool: name, error: tele[:err] || raw[0, 300]) : '' # S2 — counterfactual A/B: at the repeat threshold, fork an # alt-persona branch, judge both, inject the winner. Real # advantage estimation; (loser, winner) → DPO preference. thresh = defined?(Mistakes) ? Mistakes::REPEAT_THRESHOLD : 3 # P17 — never fork counterfactual when budget fingerprints dominate: # CF is another mini agent loop and is the #1 amplifier of # iteration-budget exhaustion on this host. if count >= thresh && !escalated && defined?(Curriculum) && !budget_exhaustion_hot? cf = (turn_fails["cf:#{fkey}"] += 1) == 1 ? Curriculum.counterfactual(request: request, name: name, args: args, error: tele[:err] || raw[0, 200], hint: hint) : nil hint = "#{hint}\n[pwn-ai/counterfactual] branch #{cf[:branch]} (score=#{cf[:score].round(2)}): #{cf[:content]}" if cf end result = guard_repeated_failure(name: name, count: count, hint: hint, result: result, mistake: tele[:mistake], args: args, shape: tele.dig(:mistake, :shape)) end on_tool&.call(name, args, result) debug_tool_io!(name: name, args: args, result: result) wait_trace_step!(label: "tool #{name}", nested: nested) task_summary_record!(state: ts_state, name: name, args: args, result: result, on_tool: on_tool) << { role: 'tool', tool_call_id: tc[:id] || tc['id'] || "call_#{i}", name: name, content: result } append_session( session_id: session_id, role: 'tool', content: "#{name} → #{result[0, 1_024]}" ) end # Do not inject "stop calling tools". Long goals keep CORE_TOOLS # until may_finalize? — the original request is the only signal. next unless local && !escalated && dispatch_fail_n(turn_fails: turn_fails) >= ESCALATE_AFTER_FAILS hint = escalate(request: request, turn_fails: turn_fails, session_id: session_id) if hint << { role: 'tool', tool_call_id: "escalation_#{i}", name: 'frontier_hint', content: hint } append_session(session_id: session_id, role: 'tool', content: "frontier_hint → #{hint[0, 1_024]}") end escalated = true end rescue Interrupt Thread.current[:pwn_log_progress] = false if defined?(PWN::Plugins::Log) && PWN::Plugins::Log.respond_to?(:note_interrupt!) PWN::Plugins::Log.note_interrupt!(where: 'CTRL+C', which_self: self) else debug_progress(msg: 'Interrupt CTRL+C') end raise rescue StandardError => e if defined?(PWN::Plugins::Log) && PWN::Plugins::Log.respond_to?(:note_exception!) PWN::Plugins::Log.note_exception!(error: e, where: 'Loop.run', which_self: self) else debug_progress(msg: "exception Loop.run #{e.class}: #{e.}\n#{Array(e.backtrace).join("\n")}", keep_newlines: true, cap: 0) end raise ensure unless nested Thread.current[:pwn_loop_active] = nil Thread.current[:pwn_loop_deliverables] = nil end Thread.current[:pwn_loop_no_tools] = nil finish_debug_request!( iter: i, tools_called: tools_called, engine_s: engine_s, final_chars: final_chars, nested: nested ) TurnFinalizer.leave_user_path! if defined?(TurnFinalizer) end |
.world_knowledge?(opts = {}) ⇒ Boolean
499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 |
# File 'lib/pwn/ai/agent/loop.rb', line 499 public_class_method def self.world_knowledge?(opts = {}) request = opts[:request].to_s.strip return false if request.empty? return false if request.length > 120 return false if catalog_lookup?(request: request) return false if request.match?(ACT_REQUEST_RX) return false if request.match?(LOOKUP_REQUEST_RX) return false if request.match?(HOST_PATH_RX) return false if request.match?(BROWSER_REQUEST_RX) return false if request.match?(HOWTO_RX) return false if request.match?(%r{\b(this\s+(?:host|machine|box|system|subnet|file|repo)|/opt/|implement|scan|hosts?)\b}i) request.match?(/\A(?:what|why|who|when|where|which|how)\b/i) rescue StandardError false end |