fenkam

F
fenkam
2 posts
Evaluating Infra AI Agents: Seven Questions to Ask
How is an AI agent’s success rate measured? What does that figure include, and what might remain outside the evaluation? In a previous experiment, I examined LLM execution across hundreds of infrastru
Sep 24, 20267 min read8
LLM as sysadmin: 59,349 commands, 2,355 VMs, and the illusion of done
LLM as sysadmin: 59,349 commands, 2,355 VMs, and the illusion of done Teams are already using LLMs to operate systems, with or without a human in the loop. Yet there's very little public data on the f
Sep 15, 202619 min read1.1K