Case Studies | Retail

Turning voicemail orders into structured data

Phone Automation

About

A Retail business working with Cloud Combinator on AWS. The client is anonymised at their request.

Challenge

The challenge had four focus areas, each central to a proof of concept the client could trust with real orders.

Extracting orders from messy audio

Voicemails are recorded in noisy kitchens. The system had to transcribe each recording and reliably extract the items ordered into a structured list the team could confirm at a glance.

Judging recording quality

Not every recording is usable. The pipeline needed to distinguish clearly captured orders from those degraded by background noise or other issues, so only clean, valid orders flowed through and questionable ones were flagged.

Sense-checking against history

An order that departs from a customer's usual pattern is worth a second look. The system had to compare each new order with that customer's historical orders and flag discrepancies or unusual items for review.

Keeping the reference data current

The historical data used for comparison had to stay up to date, which meant the search index behind it needed to be refreshed automatically every day rather than by hand.

Solution

An user requests a pre-signed URL through Amazon API Gateway and a Lambda function, then uploads the voicemail recording directly to an Amazon S3 bucket. The upload triggers an AWS Step Functions workflow: a Lambda function places the event on an Amazon SQS queue for controlled processing, retrieves the audio and sends it to Amazon Transcribe, respecting service limits by returning the message to the queue if too many files are already in flight.

200

Voicemail orders per day at design scale (projected)

Daily

Automatic reindex of the historical-order vector store

2 regions

Cross-region replication for data redundancy

By the numbers:

  • 200 - Voicemail orders per day at design scale (projected)
  • Daily - Automatic reindex of the historical-order vector store
  • 2 regions - Cross-region replication for data redundancy
Changes

The proof of concept met its success criteria: a pipeline that accurately extracts ordered items from real voicemail recordings, assesses their quality, validates them against historical data and returns a structured JSON output, deployed into the client's own AWS environment.

  • Orders extracted automaticallyAmazon Transcribe converts each voicemail to text and a Bedrock model extracts the items into a structured list ready for confirmation.
  • Quality flaggedThe system assesses each recording and distinguishes clear orders from those affected by noise or other issues.
  • Grounded in historyA Bedrock Knowledge Base backed by OpenSearch compares each order with the customer's past orders and recommends whether it should be checked.
  • Resilient and cost-awareCross-region replication protects the data, and lifecycle policies move inactive files to Glacier to keep storage costs down.
  • Fully traceableEvery stage of the pipeline is logged in DynamoDB, with CloudWatch monitoring across the workflow.
  • HandoverLive demonstrations, recorded walkthroughs and all code in source control left the client's team able to operate and extend the service.

With a proven, serverless pipeline in place, the client has a foundation it can extend across more of its order intake, moving from a proof of concept towards automated, AI-assisted order capture at scale.

AWS Stack

Amazon Transcribe

For converting voicemail recordings into text.

Amazon OpenSearch Service

As the vector store for retrieving and comparing historical orders.

AWS Step Functions

And AWS Lambda for orchestrating the event-driven processing pipeline.

Amazon SQS

For throttling the flow between stages within service limits.

Amazon RDS

For MySQL for the historical order data used in validation.

YOU MIGHT LIKE

Related success stories

View all case studies

Case Studies | Insights

Utilising Language Recognition, Speed, and Enhanced Security to Make Social Media a Force for Good

  • Here, we take a detailed look at how the Cloud Combinator team collaborated with another cutting-edge AI service provider that provides intelligent systems to “make social media more social” for brands and users alike.
  • Arwen AI is a UK-based startup specialising in AI solutions to manage and enhance brands’ social media interactions. Founded in 2020 by Matt McGrory, Dr. David Cole, and Joel Bailey, Arwen. AI focuses on using AI to automatically detect and remove spam, toxic comments, and other unwanted content from social media platforms.
  • The team at Arwen have three core products. ‘Moderate’ is focused on identifying and removing toxic content from social media channels. ‘Engage’ helps brands identify and engage with meaningful conversations on social media, and ‘Customize’ allows brands to apply bespoke algorithms to their channels - creating an even more effective moderation and engagement.
Read more
CONTACT US

Ready to turn AI into impact?

We'll help you spot the highest-value opportunities, reduce risk around your first AI initiative, and define a clear path to results from day one.

Why talk to us:

Outcome-driven recommendations

AWS-recognised delivery expertise

Risk-aware AI adoption

Clear next step, not a sales pitch

Start with a focused 20-minute conversation about your goals — no pressure, no commitment.

This website uses cookies to enhance user experience and to analyze performance and traffic on our website.

See our Privacy Policy for details.