Tweaking elastic, building sentences and show & tells have been the order of this sprint – as it probably has been on a playgroup somewhere as well – though that’s where the similarity with my project stops 😉
Unpicking elastic search
The initial implementation saw us using match query which literally searches any of the words entered in the search box, exactly as typed. It’s configured to search titles, summary and description (weighted in that order) of each opportunity and while the results that came back were ‘right’, it wasn’t immediately clear to the user why they were right (in instances where the match is in the depths of the opportunity or generic words such as ‘management’ in ‘waste water management’ would therefore return all sorts.
This sprint, we’ve worked up two instances for usability testing side by side: fuzzy (to allow for typos) and phrase matching (to consider the proximity of words to each other).
A few of the team are of to Venturefest Manchester and New Scientist Live for some pop up testing for us to gauge which, if any, instances bring back more useful results.
Last sprint highlighted the confusion users faced when starting a search by seeing the full list to then refine.
I suppose it’s not unlike walking into a supermarket which shows everything on offer, and you walk around to pick what you want. Everyone’s used to that, products are consistently laid out; fruit and veg at the front, bakery somewhere near the back etc. But online search is a hugely different kettle of fish.
We’re trying a concept of building a sentence which is akin to how an advisor would help a client search the database if face to face.
We’ve got two routes: one which is more form-like and this one which is more like building a sentence.
We’ll test both this coming sprint, but alternating which one tests first, to avoid skewing the result. While the team is in Manchester, I’ll nip off to Bolton to meet a user who has assisted digital needs to see how she gets on with them. Before we get too excited with our creation we need to work up whichever one performs best at testing for all our audiences with their varying needs.
Show and tells
Each sprint retrospective, I record and 10-ish minute screen/audio canter through what the team has done, and send it to stakeholders for their information and comment. The format is working well and this last sprint I had a healthy slot at the all staff webinar.
The objective was to inform a wider group of stakeholders (✓) kick the tyres on a few things and test the reaction (✓) and to run a couple of web environment / Salesforce / GovDelivery hack ideas I had by then to see if there’s sufficient advisor (user) need to add them to the backlog (✓).
Those hack ideas went down well…
Make the website the end point for the user after a first meet with an advisor.
- Scenario: Often after a first advisor/client meet, an advisor would follow up with an email pointing to a few relevant opportunities for the client. Advisor colleagues won’t know the detail nor will anyone know opens or clicks.
- The advisor searches the database in the backend to select a couple of things.
- An email button opens up the things which the advisor can write a message
- Click send which transports through GovDelivery which therefore adds the email to the contact on Salesforce as well as any engagement stats.
Segmenting the audience by keywords we know they’re interested in
- Scenario: Advisor is running an event about the circular economy, so wants to invite clients in that field
- Again searching the backend for relevant keywords – stuff like ‘recyclable, environment, waste water – brings up all the clients subscribed to those words and clients sent opportunities with those words in, perhaps from different keywords.
- Advisor can select users to add to a GovDelivery topic which then
- is visible in GovDelivery where the email template is created
- Engagement stats are then passed back to each Salesforce contact.
This would be even cooler if the clients results showed number of clicks for the searched subject, should we need to be selective on which clients we sent to. But, first thing first. There’s a huge organisational task of cleansing the data we have: currently 1/3 of our clients receiving these alerts do so with optimised the keywords, the rest receive everything which is a legacy thing on our side.
It’ll pay dividends though. Conversions from that 1/3 is twice as effective.