Good q - my guess is the answer is different by domain and SLA
I think the big difference is humans can usually encounter a new surface and navigate it with only a high level objective and be close to right on the first try without having seen that interface before. This is mostly tribal knowledge which in LLM context would be prompt context most likely, but have yet to see an agent architected that can hit the mark on the first try regardless of context provided. Just my 2c
This is a bit like asking LLMs to count r's in strawberry, where they've provided the LLM a tool to count letters in a word (often just the ability to write a quick python script) and trained it to use that tool when asked this question.
> A single human can easily manage this variety
Curious, how do humans learn to manage the variety and navigate newly encountered portals or processes when they start doing this work? Is it a "prompt", i.e. a very detailed SOP or set of instructions, or "learn on the job" where they are paired with a team-mate / supervisor until they reach a certain success rate, or something else?
Good q - my guess is the answer is different by domain and SLA
I think the big difference is humans can usually encounter a new surface and navigate it with only a high level objective and be close to right on the first try without having seen that interface before. This is mostly tribal knowledge which in LLM context would be prompt context most likely, but have yet to see an agent architected that can hit the mark on the first try regardless of context provided. Just my 2c
This is a bit like asking LLMs to count r's in strawberry, where they've provided the LLM a tool to count letters in a word (often just the ability to write a quick python script) and trained it to use that tool when asked this question.
> A single human can easily manage this variety
Curious, how do humans learn to manage the variety and navigate newly encountered portals or processes when they start doing this work? Is it a "prompt", i.e. a very detailed SOP or set of instructions, or "learn on the job" where they are paired with a team-mate / supervisor until they reach a certain success rate, or something else?
Yeup- I’m coming to the same conclusion
same obviously. took me a while