The portfolio review is the least useful part of evaluating a software development partner. Past projects tell you what a partner has built for other clients, in other contexts, at other moments. They tell you almost nothing about whether this partner can navigate the specific complexity of your situation.
What Portfolios Don't Tell You
A portfolio shows finished products. It does not show the conversations that shaped those products, the decisions that were made under pressure, the pivots that were navigated, or the moments where the right recommendation was to do less, not more. It does not show whether the partner pushed back when the client's instincts were wrong, or whether they built what they were told and sent an invoice.
The Questions That Reveal Real Capability
- "Tell me about a project where you told a client they were wrong about something important." — A partner who has never done this is a vendor, not an advisor.
- "What does your process look like for the first 30 days of an engagement?" — Vague answers reveal process debt. Specific answers reveal operational maturity.
- "How do you handle technical disagreements within your team, and how do those get resolved?" — This reveals the intellectual culture and decision-making process.
- "What is your approach when scope needs to change mid-engagement?" — This is where partnerships succeed or fail.
- "How do you ensure knowledge transfer so we are not dependent on you indefinitely?" — This separates partners from vendors.
The Complexity Navigation Test
Every software development engagement encounters unexpected complexity. The question is not whether your partner handles clean, well-scoped work — everyone does that adequately. The question is how they behave when requirements are ambiguous, when technical constraints reveal that the original plan was wrong, and when the business context changes mid-engagement.
“The best indicator of how a partner will handle your complexity is how they handled complexity in their past engagements. Ask for the hard stories, not the success stories.”
The Commercial Structure Question
The commercial structure of an engagement reveals the partner's incentives. Fixed-price contracts incentivize the partner to minimize scope. Time-and-materials contracts incentivize the partner to maximize hours. Neither is inherently right. The structure you choose should align the partner's incentives with your outcomes — which usually means some combination of milestone-based delivery and flexible scope, with clear governance for scope changes.