"Reports involving AI agents are non-deterministic [...]"
"Please provide [...] the exact prompt or prompts you sent to the agent"
What's the point of an exact prompt if its effects cannot reliably be reproduced?
@aaribaud @jonny they cannot be reproduced by the end user prompt interface. proprietors of transformer models can invoke the first phase which essentially performs a keyword search without respect to word ordering and (if my hypothesis is correct that some implementations are literally just search engines) can remove inputs triggering the results. this is hidden from the user by the second phase which performs obfuscation of the first by fucking around with word ordering and pulling matches from multiple of the phase 1 search results