I hadn’t heard of Dan Guido till just a few months in the past, once I got here throughout the video of a chat he gave at [un]prompted, an AI safety practitioners’ convention. Dan is the CEO and cofounder of Path of Bits, a software program safety analysis and growth agency that works with firms in tech, protection, and finance. However Dan wasn’t speaking about safety. He was speaking about what it takes to make an organization AI native, which is near the middle of the bullseye for many people proper now.
We’ve been attempting to determine how to do this at O’Reilly, however till I got here throughout Dan’s discuss, we didn’t have a structured course of. We’ve been constructing alongside the strains he laid out ever since. So for this episode of Reside with Tim I requested Dan to reprise the discuss earlier than we obtained to the dialog. He was purported to take twenty minutes, like his unique convention discuss, however he took thirty-five, and I needed to lower him off barely earlier than the top to make room for questions. That was a troublesome alternative, since every part he needed to say was golden.
Dan opened by reminding us of the present state of play in enterprise AI adoption. In February, Fortune reported on a Nationwide Bureau of Financial Analysis examine during which practically 90% of some 6,000 executives stated AI had produced no measurable change in employment or productiveness at their corporations over three years. Individuals began calling it the brand new Solow paradox, after Robert Solow’s 1987 line that “you’ll be able to see the pc age all over the place besides within the productiveness statistics.”
Dan’s perception is that this isn’t proof that AI doesn’t work. It’s proof that almost all firms are deploying AI fallacious. They hand out ChatGPT and Claude licenses, after which management waits for the magic to occur. It doesn’t.
Dan began out by describing three ranges of AI adoption.
- AI assisted is the place everybody begins: “You give folks entry to ChatGPT, it drafts emails, it summarizes paperwork. It’s only a productiveness instrument, and your group doesn’t change. Your workflows are the very same as they had been earlier than. You simply have a bit of buddy that helps you with a few duties.”
- AI augmented is the place you begin redesigning workflows, in order that AI does the primary cross on a code assessment and a human does the second.
- AI native is structural: “That’s the place you’ve redesigned the corporate and its workflows from the bottom up, assuming the AI goes to be there and that it’s a core participant. That’s probably not a instrument. That’s extra eager about AI as teammates.”
In his framing, the primary of the three is a instrument and the final is an working system. For Path of Bits, he stated that “working system” has a particular function:
“I need our safety experience to compound as code. Each engagement we do, all the abilities, the workflows, every part that we construct makes the following engagement sooner and higher.”
Worker resistance is the primary downside
Dan confessed how arduous it was to get began on the ladder from AI Assisted to AI Native:
“After I introduced final 12 months that we had been all in on AI, that we had been going to be utilizing it throughout all of our workflows and redesigning the way in which the corporate operates, I’d say solely about 5% of the corporate was with me. 95% was resistant.” About 20% was actively resisting. The opposite 75% had been resisting extra passively. “They’ll go together with it in public, however in course of they’ll sabotage it. They’ll hope that in the event that they maintain their head low, it will cross over them, and that three months from now administration’s focus will change and it received’t be an issue anymore, and we are able to get again to doing what we had been doing. That’s the place the vast majority of folks land when these initiatives occur.”
Somewhat than argue along with his staff, Dan studied the literature on why folks reject new expertise and determined he wanted to deal with 4 biases in opposition to AI: self-enhancing bias, id menace, opacity, and intolerance for imperfection.
Self-enhancing bias is the behavior of crediting your wins to your personal judgment and your losses to circumstance, which is a selected downside for senior people who find themselves strongly connected to the years of expertise and instinct that obtained them to their current place. Opacity isn’t with the ability to see how a choice obtained made. Dan’s commentary is that you simply don’t perceive your physician’s reasoning both, however one way or the other you belief the physician however get suspicious of the machine. Dan didn’t point out this work particularly, however intolerance for imperfection appears to discuss with Dietvorst, Simmons, and Massey’s work on algorithm aversion, which discovered that individuals abandon an algorithm after watching it err as soon as, even when it outperforms the human various. Their follow-up paper discovered that giving folks even a slight capacity to switch the algorithm’s output is sufficient to overcome the aversion.
Dan spent essentially the most time on id menace. He described a examine during which the identical kitchen equipment was marketed in two methods: “On one hand, it does the cooking for you. Then again, it helps you prepare dinner higher. It’s the identical system. The individuals who recognized as cooks rejected the primary model and accepted the second.”
Most information work, Dan argued, and safety auditing specifically, is what he referred to as symbolic slightly than instrumental. That’s, it carries that means about who you’re. “So I’ve to border AI as one thing that makes you a extra harmful auditor,” he stated. “Not that it does the audit for you.”
In his work at Path of Bits, he intentionally constructed a countermeasure for every bias.
- Self-enhancing bias is addressed by “an AI maturity matrix” with seen ranges, as a result of you’ll be able to’t declare you’re already adequate when there’s a broadcast ladder that identifies a special set of expertise as essential.
- Id menace will get expertise repositories, the place an engineer who writes a tough plugin will get credit score for encoding their experience. Hackathons additionally change the dynamic from resistance to exploration. I’m placing phrases in Dan’s mouth right here, however I believe he’d agree that when skilled builders are referred to as on as mentors in a hackathon, that additionally reduces their expertise of AI as an id menace.
- Intolerance for imperfection will get a curated market, sandboxing, and hardened defaults, so everybody’s first expertise of AI isn’t a catastrophe.
- Opacity will get a written AI handbook that clarifies the utilization coverage and the chance mannequin slightly than simply saying “belief us.”
Right here’s Dan’s slide on “the cures that really labored”:
Returning to one among my pastime horses, this can be a type of mechanism design. In my latest piece on the lacking mechanisms of the agentic economic system, I argued that we have to begin with desired outcomes and ask ourselves what mechanisms will assist to provide them. Dan’s strategy appears to be actually good at this. Most enterprises are treating AI adoption as a procurement downside or a communications downside. Dan handled it as a query of what incentives, defaults, and standing ladders produce the habits you need, given how folks truly reply.
The final treatment on Dan’s listing is that the CEO has to guide by instance. He famous, “I used to be the primary particular person by way of the door. My voice because the CEO issues much more than folks assume. The passive 50% of the corporate that isn’t positive if this initiative goes to achieve success, they’re watching to see what management truly does, not what it says.”
A ladder, not a mandate
Path of Bits already tracked about 50 engineering expertise for efficiency assessment, issues like Python, git, Rust, and numerous safety auditing capabilities. Dan pulled AI expertise out into their very own matrix, with 4 ranges, from not engaged by way of succesful and adoptive to transformative. Every of those ranges is detailed individually and extra particularly for assurance, engineering, gross sales, and challenge administration.
He famous that “The best stage of the maturity matrix isn’t anyone who makes use of AI essentially the most. It’s anyone who invents new methods to work and builds instruments with AI. So the id of the professional shifts from ‘I don’t want AI’ to ‘I’m the one who makes AI helpful for the corporate.’” This was his first vital design alternative.
The second is what stage zero means. He stated “In the event you’re at stage zero, in case you’re not engaged, which means you’re combating again in opposition to the corporate. In the event you dismiss AI as hype, in case you refuse to make use of AI for safety work, this can be a disagreement on rules, not on expertise. For individuals who had been caught within the not engaged class, we had arduous conversations, and there have been individuals who left the corporate.” Ranges one by way of three are a talent challenge, and the treatment is time with the instruments.
Whereas the slide describing the potential matrix is proven within the previous video clip, right here’s the place you’ll find the total deck so you’ll be able to examine it in additional element.
Driving adoption and expertise with hackathons
Among the best methods Path of Bits developed to maneuver folks up the ladder was to carry a hackathon each two months. Dan runs them with clear targets slightly than as a free-for-all. The main target space and studying targets are outlined prematurely and introduced every week forward, with separate directions for engineers and non-engineers. Individuals work in pairs so every part will get reviewed. There’s a demo session on the finish, after which follow-through. (It’s an vital a part of Dan’s large concept, that it’s a must to construct a system by which, in his phrases, organizational information and functionality compounds.) He famous that “Within the days afterward we maintain one or two folks round, and so they acquire all of the reusable artifacts, construction them, and put them into the locations they have to be.”
I requested what folks outdoors of product and engineering truly work on, because the reply for an accountant at a hackathon was not apparent. Dan’s response is that the hackathon isn’t measured in artifacts shipped however in the place folks sit on the potential ladder the next week. Primarily, he’s working a coaching program that occurs to provide helpful output, slightly than a manufacturing dash that occurs to show folks one thing.
The primary hackathon, he advised me, was the equal of a seashore cleanup: “It’s like these firms that ship everyone to the seashore with a giant stick and say, let’s go decide up a bunch of trash and put it away, and then you definately get the massive workforce photograph after with all of the contractor luggage of rubbish. That’s what we did with our public supply code repositories.”
He picked it as a result of open supply upkeep is the a part of the job that looks like a grind. No new options, simply closing points and rancid dependencies on public code the place nothing was in danger. “As an open supply maintainer, you simply get overwhelmed down by the general public. This doesn’t work, I can’t use it, this factor sucks. Dozens of points stating flaws you already knew about. It feels burdensome. We wished folks to see that adopting AI would relieve burden.”
The second hackathon was about transport impactful product updates, however it was additionally designed to maneuver everybody up the potential ladder by giving up management. Engineers needed to run Claude Code in bypass permissions mode, totally autonomous, on public repositories, inside sandboxes the corporate had ready prematurely. The one they’re working now could be about persistent background brokers that may be handed a job throughout an audit and are available again with a proof of idea exploit or a draft discovering.
Right here’s a take a look at Dan’s slack message saying the hackathon:
Every thing the hackathons produce will get harvested into artifacts.
Path of Bits runs three expertise repositories: an inside one for firm workflows, a public one that anybody can use, and a curated one that vets third-party expertise earlier than they’re allowed in.
Publishing expertise to the general public repository isn’t just a advertising train. “It retains us sincere, and it forces us to put in writing issues that different folks can use, not simply folks outdoors the corporate however inside too,” Dan stated. “It actually helps us take into consideration the tribal information that’s baked into the instrument.”
The curated repository exists as a result of Path of Bits is aware of how dangerous the provision chain is. They’ve printed analysis on find out how to write malicious expertise, and so Dan isn’t going to inform 130 staff to begin downloading code from strangers and working it on their laptops. “If you would like adoption, you want a secure provide chain.”
Turning scar tissue into infrastructure
Maybe much more vital than the abilities repository is, as Dan put it, “turning scar tissue into infrastructure.”
“Each single time Claude Code didn’t do one thing we wished, we’d bake it right into a set of world, copy-pasteable defaults. Recognized good settings, really useful patterns. I name it scar tissue. If I rent anyone new tomorrow, I don’t need them to must undergo your entire discovery means of the final 12 months of Path of Bits to determine find out how to use the instrument.”
The configuration repository, claude-code-config, is the place the accrued classes dwell.
Dan constructed the primary model himself after which opened it to tug requests from the entire firm, assigning somebody after every hackathon to go acquire what folks hadn’t contributed on their very own. “It’s simpler to place out one thing that’s unpolished than it’s to get it good on the primary attempt.”
In brief, a giant a part of the Path of Bits “enterprise AI working system” strategy is a set of standardized instruments and hardened defaults. Standardization isn’t a straitjacket. It’s a basis.
On sandboxing, Path of Bits intentionally didn’t decide a single most well-liked answer. There’s a devcontainer for builders, dropkit for disposable DigitalOcean droplets, COOP for remoted VMs, and the sandboxing now constructed into Claude Code for informal customers. “The purpose isn’t that everyone makes use of the identical sandbox,” Dan stated. “The purpose is that everybody has a secure sandbox to make use of, and that it’s simple for them to do it.”
One other of the hardened defaults is procedural. Path of Bits enforces a seven day cooldown on each bundle their builders set up:
“There are dozens of safety firms scanning the web looking for a brand new cool weblog put up they will write about malicious code hiding on PyPI or npm, and so they normally determine on the market’s a provide chain challenge inside hours. So we simply delay all of the packages that Path of Bits makes use of. Typically the malicious stuff will get picked up earlier than we ever get an opportunity to run it.”
That’s free-riding on a aggressive marketplace for safety analysis, and given the pace of at this time’s market, it’s a sublime answer. There’s an entire class of defenses like this ready to be discovered, the place the mechanism isn’t a technical system however a well-chosen delay.
Information, and DJ Patil’s “Tidy Home”
The issue we run into most frequently as we construct AI workflows at O’Reilly isn’t the mannequin or the tooling. It’s information. Who has entry to which system, which system does that information dwell in, and who do I ask? In a 500 particular person firm that’s annoying. I’m wondering what it’s like at an organization with 50,000 staff.
I advised Dan about DJ Patil’s Tidy Home framing. He agreed that information entry for AI is a giant downside. His reply begins with permissions:
“The permissions debt is invisible till an agent hits it. Making information agent legible is a compelled permission audit. You must truly undergo and work out who can entry what…. It additionally raises the stakes for permissions errors. In the event you overshare data, now an agent inside your organization goes to seek out it immediately. There are quite a lot of these technical debt kind of issues the place, with brokers, all of it’s changing into due on the identical time.”
Each shortcut a company took with its information over the previous twenty years is being referred to as directly, and the businesses that may run the audit, make quick selections about boundaries, after which truly share their information are those that may get a pressure multiplier.
Dan is in opposition to letting a thousand flowers bloom, as a result of uncoordinated groups create overlap slightly than compounding. He’d slightly have one centralized basis, with innovation taking place on high of that. He advised a helpful metric for making that work throughout workforce boundaries is what fraction of your workforce’s information did you make reusable for everybody else, and the way a lot of it’s being utilized by groups outdoors your personal.
What post-AI jobs appear like
Earlier than the primary hackathon, Path of Bits ran hands-on periods to show its operations and go-to-market workers the fundamentals of git and the command line. Not mastery, simply sufficient to be a shopper of the factor. Right here we’re fifty years into my profession and the Unix command line nonetheless issues. Dan’s non-technical workers principally work inside Claude Cowork or Codex Desktop now, however he thinks the command line expertise was price it as a result of they know what’s taking place beneath the hood.
What occurs to a job when the instrument can do quite a lot of what people used to do? Dan gave the instance of his personal technical editors. His editors used the hackathons to construct the instruments that obtained them out of line enhancing, together with one which turns a public presentation right into a weblog put up within the firm’s voice. What the writers do now could be seek the advice of on find out how to body a narrative so it’s efficient with a selected viewers.
I agree. Human jobs aren’t going away any time quickly. This will get heard as optimism when it’s actually simply commentary. AI goes to interchange quite a lot of what we used to do, however it’s also going at hand us a considerable amount of new work, and far of that work hasn’t been understood but. High quality assurance for agent methods is likely one of the new jobs. So is expertise product administration, which is a job that didn’t exist eighteen months in the past and now has a headcount at a 130 particular person safety agency.
I requested a query in the direction of the top about how we’re going to know which expertise and brokers are any good. What Dan has to this point is telemetry pulled from builders’ dot recordsdata by way of the corporate’s system administration system, which tells him what will get used and what breaks, plus one AI methods engineer whose job is product administration for the abilities repository, reviewing incoming pull requests and deprecating overlapping expertise.
What Dan thinks comes subsequent is analysis. He says: “When you make investments quite a bit into these agent methods, you want proof that they do the job. The way in which you do that’s you give everyone a efficiency assessment. You give them an analysis information set, a benchmark.”
Path of Bits is now constructing benchmarks for its core expertise. How effectively can we discover bugs on this language? How effectively can we write an announcement of labor? Developing these datasets is actual work, with optimistic and adverse circumstances, and comparisons in opposition to the algorithmic instruments that exist already.
Put the reps in
I requested Dan for the highest 5 errors he made. He stated there was just one. “You should allocate an applicable quantity of FAFO time. (That’s F Round and Discover Out.) A product comes out on Friday. There’s no documentation for it. There’s no coaching steering for it. There’s no course on it. You may’t wait till anyone systematizes the information. You simply must do it.”
Then he gave an analogy to going to the gymnasium.
The recipe for fulfillment
Dan has a replicable recipe, which he summarized as follows:
- Standardize on one agent workflow which you could help.
- Write an AI handbook in order that danger selections aren’t advert hoc, and that everybody is enjoying the identical sport.
- Create a functionality ladder that makes clear that enchancment is anticipated.
- Run brief adoption sprints that pressure hands-on utilization.
- Seize every part as reusable artifacts: expertise + configs + a curated provide chain.
- Make autonomous brokers secure with sandboxing + guardrails + hardened defaults.
The Path of Bits expertise repository is public. So is the curated market, the configuration repository, the devcontainer, dropkit, and COOP (Continuity of Operations planning). He wrote up the entire playbook on The Path of Bits Weblog and gave a model of it to tl;dr sec. He thinks publishing makes the work higher as a result of it forces the tribal information out into the open the place it may be checked.
Which brings me again to the Solow paradox, which appeared to vanish by the late 90s, when US combination productiveness did lastly go up. That didn’t occur as a result of computer systems obtained sooner. It disappeared as a result of firms discovered find out how to reorganize themselves round what computer systems may do, and ultimately these organizational recipes unfold extensively sufficient to indicate up in combination statistics. The identical has to occur at this time. The present AI discourse is obsessive about mannequin functionality and largely tired of diffusion. The issue isn’t that the fashions are oversold. It’s that nearly no person has performed the mandatory organizational work, and the few who’ve are principally holding it to themselves.
If you wish to transcend the spotlight movies proven above, watch Dan’s complete discuss right here. His slide deck is right here. And you should definitely try the Path of Bits Github repository.
