PILOT

 
 

Ava is Thomson Reuters first customer service chatbot pilot for lawyers. The design process faced daunting obstacles, including internal resistance to automation, but the outcome was worth it.

Ava answers questions about legal content lawyers have access to on Westlaw (the company’s legal search tool), expiration dates, account balances and payment deadlines. Instantly, the virtual assistant redirects users to requested online content, updates contact details and displays invoices through the chat window, keeping users in the context of their work.

Project Highlights

  • Prototyped 4 solutions to gain insight

  • Designed an intelligent bot based on keyword and phrase recognition

  • Published conversational UI design best practices

Team

Lead, UX designer, Interaction Designer, User Researcher, Engineer

My Role

  • Project leadership and presentation to CEO

  • User research, content strategy, workshop facilitation

  • Identified a market opportunity and operational cost savings

 
 

What We Built into a Pilot (short demo videos)

 

Do I have access to this content?

16 seconds

I want a copy of my invoice.

21 seconds

Can you update my address?

46 seconds

I’d like to upgrade. (quote)

52 seconds

 
 
Why is Thomson Reuters not using chatbot technology today?
— Jim Smith, CEO - Thomson Reuters
 

The Challenge

A corporate-wide challenge questioned how chatbots could improve how the company serves its customers. It required identifying a use case and a target customer, as well as researching the perceived internal and customer barriers to automation. The use case and insights would be pitched to the CEO and the Innovation Office for potential funding.

My design team and I won the challenge.

A problem-solving approach

I chose to apply a Design Thinking framework to fit the ambiguous nature of the challenge, gain deep user empathy and explore lots of ideas. I planned a design roadmap of 4 design sprints over 2 months for research and ideation, that would conclude into rich insights on customer and business attitudes towards virtual assistants, and a viable solution. This Design roadmap later evolved into a Product roadmap for a pilot development and trial launch to a subset of customers.

 
4 Design sprints
 
 

Using my relationships across functions, I found our project sponsor in the Head of Customer Success for the Legal business, directing our choice of target customers to attorneys and small law firms who use Thomson Reuters flagship Legal search product, Westlaw.

How can we support lawyers as they purchase and use Westlaw?

The Westlaw product team was already looking for innovative ways to support these customers as they purchase and use the tool online. This became our starting point for research.

 
 
 

Customer behaviors and attitudes

Along with the senior UX researcher, I interviewed customers and internal functions.

A total of 28 attorney customers were interviewed one on one over the course of the project to understand their sentiment vis-a-vis chatbots and where painpoints arose in the course of their online purchase and use of Westlaw. Internally, both Technical Support and Customer Service were solicited to share where the painpoints were in their operations, and what were the most frequent and costly phone calls they answered from customers.

Key findings from customers:

I don’t like to call support, they’re biased and try to upsell when I just want a quick answer to get back to my work.
— Martin, Attorney
  • Lack of product usage history to inform the license renewal process

  • Calling support or customer service is cumbersome and takes time away from working

  • Login always causes problems (lost password, username)

 

Key findings from internal Tech Support:

Quotes_bg_TechSupport.png

I guess we’ll cut jobs if our work is automated.

Steve, Technical Support

 
  • Login issues are the top and most costly calls within Tech Support

  • Subscription-related questions (read “what do I have access to?”) are among the most frequent within Customer Service

  • Account management calls are also most expensive within C.S.

 

Feedback from internal Customer Service:

We waste a majority of our time answering basic customer questions and lack time to attend other critical customer issues.
— Barbara, Customer Service

This important comment from Barbara was a key opportunity for an automated solution to support both the team and the customer. This led to digging deeper into the most common and repetitive questions customers call about, the operational cost of these calls, and designing related conversations between a chatbot and a customer.

 
 
 

Ideation & Prototyping

We brainstormed all the above painpoints and identified where the biggest impact was. We explored the human language by mapping out various patterns of human-to-machine dialogue and patterns. Finally, we mapped out all the conversation paths for a customer service chatbot, based on the most common questions customers call agents about.

 


understanding the complexities of human dialog

dialog Mapping of a customer service chatbot

 
 

4 design sprints leading to a viable solution: a chatbot that automates simple and repetitive customer service tasks

We ran 4 design sprints, each exploring a unique solution that was prototyped and tested. This cycle of experimentation guided us to a final and viable solution: Ava, a customer service virtual assistant that answers attorneys’ questions on their subscription and account management in Westlaw. Technically, the chatbot capability communicates to an SAP database that contains customers’ subscriptions and account details, retrieves data to answer questions, uploads documents like invoices, and updates the data on the database.

 
 
 

Design

We designed over 60 iterations of conversational flows throughout the 4 solutions that we explored, eventually working closely with the customer service team to craft human dialogs based on the most frequent questions customers contact C.S. about.

Our design activities included:

  • Identifying the chatbot personality

  • Defining conversational design patterns to enable transactions and answers

  • Stitching together multiple flows into a coherent experience

  • Defining tone, design language and performance standards

 
 
 
 
 
 
 
 

Pilot Launch

Customer Adoption, Operational Efficiency, Cost and Time Saving

Ava saved $500,000 in operational cost and 30% of Customer Service agents time in the Legal business the first year, forecasting at least 25% increase in savings the following year as more customers adopt the feature. Another benefit to be seen was the positive result of customer service agents increased attendance to strategic customer issues.

Customers saved valuable time (and money) in getting answers that no longer required calling a human agent. On the business side, customer service agents were able to focus their time on more critical customer inquiries, leading to fewer customer calls and higher service efficiency.

Finally, we handed the designs over to the engineering team that subsequently built and launched a pilot to 200 beta users of Thomson Reuters WestLaw.

Bonus: We published conversational UI best practices!