Will Larson's Blog, page 8

Staff-Plus

How to create software quality.

I’ve been reading Steven Sinofsky’s Hardcore Software, and particularly enjoyed this quote from a memo discussed in the Zero Defects chapter:

You can improve the quality of your code, and if you do, the rewardsfor yourself and for Microsoft will be immense.The hardest part is to decide that you want to write perfect code.

If I wrote that in an internal memo, I imagine the engineering team would mutiny, butsoftware quality is certainly an interesting topic where I continue to refine my think...

Video of Using LLMs in your product.

A month ago, I wrote up some notes onusing LLMs in your product,and yesterday I got to present an iteration on those notes tothe folks at the Sapphire Venture’s 2024 Hypergrowth Engineering Summit.

If you’re interested, you can watch a recording of my talk on Youtube.There’s a lot of overlap with the notes, but I also go into Carta’s approach thus-far to incorporating LLMs into our product.(Note that it’s a recording of a practice run I did earlier in the week, not a recording from the ven...

No Wrong Doors.

Some governmental agencies have started to adopt No Wrong Door policies, which aim to provide help–often health or mental health services–to individuals even if they show up to the wrong agency to request help. The core insight is that the employees at those agencies are far better equipped to navigate their own bureaucracies than an individual who knows nothing about the bureaucracy’s internal function.

For the most part, technology organizations are not complex bureaucracies, but sometimes the...

Making engineering strategies more readable

As discussed in Components of engineering strategy,a complete engineering strategy has five components: explore, diagnose, refine (map & model), policy, and operation.However, it’s actually quite challenging to read a strategy document written that way.That’s an effective sequence for creating a strategy, but it’s a challenging sequencefor those trying to quickly read and apply a strategy without necessarily wanting to understandthe complete thinking behind each decision.

This post covers:

...

How should you adopt LLMs?

Whether you’re a product engineer, a product manager, or an engineering executive, you’ve probably been pushed to consider using Large Language Models (LLM) to extend your product or enhance your processes. 2023-2024 is an interesting era for LLM adoption, where these capabilities have transitioned into the mainstream, with many companies worrying that they’re falling behind despite the fact that most integrations appear superficial.

That context makes LLM adoption a great topic for a strategy c...

Load-bearing / Career-minded / Act Two rationales

One of the common conceits in leadership is that nobody is truly essential for a company’s continuity. I call it a conceit, but I do mostly agree with it: I’ve felt literally sick after hearing about some peer’s unexpected departure, but I’m continually amazed at how resilient companies are to departures, even of important people. About two-thirds of Digg’s team left in layoffs in 2010, but we found ways to amble on. Much of Uber’s leadership team turned over in the 2017 era, and it was chaotic,...

Constraints on giving feedback.

Back when I was managing at Digg and Uber, I spent a lot of time delivering feedback to my management chain about issues in our organization. My intentions were good, but I alienated my management chain without accomplishing much. I also shared my concerns with my team, which I thought would help them understand the organization, but mostly isolated them in a Values Oasis or demoralized them instead.

Those experiences taught me that pushing your organization to improve is essential leadership wo...

Notes on how to use LLMs in your product.

Pretty much every company I know is looking for a way to benefit from Large Language Models. Even if their executives don’t see much applicability, their investors likely do, so they’re staring at the blank page nervously trying to come up with an idea. It’s straightforward to make an argument for LLMs improving internal efficiency somehow, but it’s much harder to describe a believable way that LLMs will make your product more useful to your customers.

I’ve been working fairly directly on meanin...

Ex-technology companies.

One of the most interesting questions I got after joining Calm in 2020 was whether Calm was a technology company. Most interestingly, this question wasn’t coming from friends or random strangers on the internet, it was coming from the engineers working there! In an attempt to answer those questions, I wrote up some notes, which summarize two perspectives on “being a technology company.”

The first perspective is Ben Thompson’s “Software has zero marginal costs.” You’re a technology company if add...