Most legal services pilots are judged on one question: "did the work get done?" It's a fair question, but we think it's the lowest standard. A provider can turn every contract around on time and still leave you unsure whether they're the right long-term partner, with little to show for the months you spent working together.
A pilot is the best chance you'll get to see how a provider works before you commit. It should show you how quickly they move, how well they learn your business, and whether they make you function more effectively. Whatever you decide at the end, it should also leave something behind.
Here are eight things we think a good pilot should give a General Counsel, grouped by stage:
Use them to set expectations with any provider, including us.
Once you've agreed which agreement types are in scope, the main thing setting the pace should be your own information security review. Onboarding, system access and team allocation can run alongside it.
If a provider needs what feels like an unreasonable amount of time to get going, ask why.
A long lead time usually means the team hasn't been assembled yet, or the process has to be built from scratch. Neither bodes well for how quickly they'll respond once the work is live.
You need one person who owns the relationship and learns your business: how decisions get made, who signs off what, and which issues matter.
That person should be named before the pilot starts, not found once it's under way, and around them, you want a wider team with relevant experience.
A pilot staffed by whoever happens to be free gives you neither.
Good pilots begin with simpler, lower-value agreements and work up. NDAs, standard supplier terms and low-risk renewals let your team see the provider's work without much exposure.
This isn't only about managing risk. Starting small gives your team time to build confidence in the provider, and gives the provider time to learn how decisions get made in your organisation.
This way, by the time more complex agreements arrive, each side knows how the other works.
Legal teams come to pilots with different goals, and the pilot should reflect yours.
If you know what you need, the pilot should start building assets for your higher-volume, more complex work: the playbooks, templates and escalation rules that will carry the service once it scales.
Either way, agree the objectives at the start, so you measure the pilot against the right thing.
Your team may hold a lot of knowledge that has never been written down. Some of it will be captured in templates and playbooks. Much of it is likely in people's heads and old email threads.
A good provider turns that into documented positions in the first weeks of the pilot and asks you to confirm them. You get one agreed view of where you stand on key issues, and the provider works to your positions rather than its own defaults.
No playbook? That's common, and it isn't a barrier. Your previous negotiations and marked-up supplier paper are enough to start one.
The legal team rarely holds all the requirements for a contract. Procurement, finance, sales and operations know what the business needs from a deal, and what has gone wrong before.
A good provider asks to meet those commercial stakeholders early, because that's where the real requirements sit.
A pilot run through the legal team alone tells you how well the provider drafts - it won't tell you whether they understand your business, or whether they can work with the people who will rely on them every day.
You should see how the pilot is performing while it runs, not only at the final review. That means regular reporting on:
Seeing this as you go lets you correct course early. It also means your decision at the end rests on evidence, not an impression formed in the last few weeks.
Whatever you decide at the end of the pilot, you should leave with more than you started with. At a minimum, that means:
These belong to you. They make your team more effective whether you continue with the provider, choose someone else or bring the work back in-house.
Before a pilot starts, to agree with your provider what good looks like. Then again at the end, to check what you got. A provider who is confident in their approach will be glad you asked. If they aren't, that tells you something too.
You might be wondering what your next steps should be. Let us guide you with three easy options: