Amazon
Web Services, Inc. (AWS)
announced the general availability of Amazon Lookout for Metrics, a new
fully managed service that detects anomalies in metrics and helps
determine their root cause. Amazon Lookout for Metrics helps customers
monitor the most important metrics for their business like revenue, web
page views, active users, transaction volume, and mobile app
installations with greater speed and accuracy. The service also makes it
easier to diagnose the root cause of anomalies like unexpected dips in
revenue, high rates of abandoned shopping carts, spikes in payment
transaction failures, increases in new user sign-ups, and many more-all
with no machine learning experience required. With Amazon Lookout for
Metrics, there is no up-front commitment or minimum fee, and customers
pay only for the number of metrics analyzed per month. To get started
with Amazon Lookout for Metrics, visit https://aws.amazon.com/lookout-for-metrics/
Organizations
of all sizes and across industries gather and analyze metrics or key
performance indicators (KPIs) to help their businesses run effectively
and efficiently. Traditionally, business intelligence (BI) tools are
used to manage this data across disparate sources (e.g. structured data
stored in a data warehouse, customer relationship management data
residing on a third party platform, or operational metrics kept in local
data stores) and create dashboards that can be used to generate reports
and alerts if anomalies are detected. But effectively identifying these
anomalies is challenging. Traditional rule-based methods are manual and
look for data that falls outside of numerical ranges that have been
arbitrarily defined (e.g. provide an alert if transactions per hour fall
below a certain number), which results in false alarms if the range is
too narrow, or missed anomalies if the range is too broad. These ranges
are also static, and don't change based on evolving conditions like the
time of the day, day of the week, seasons, or business cycles. When
anomalies get detected, developers, analysts, and business owners can
spend weeks trying to identify the root cause of the change before they
can take action. Machine learning offers a compelling solution to the
challenges posed by rule-based methods because of its ability to
recognize patterns in vast amounts of information, quickly identify
anomalies, and dynamically adapt to business cycles and seasonal
patterns. However, developing a machine learning model from scratch
requires a team of data scientists that can build, train, deploy,
monitor, and fine tune a machine learning model over time. Furthermore, a
single algorithm rarely serves all of the needs of a business, which
causes businesses to expend meaningfully more time and expense creating
and maintaining multiple algorithms to solve different use cases.
Ultimately, few organizations possess the experienced data scientists
and necessary resources to successfully move past rule-based methods and
realize the full potential of machine learning for detecting anomalies
in their metrics.
Amazon
Lookout for Metrics is a new machine learning service that
automatically detects anomalies in metrics and helps customers quickly
identify the root cause. Lookout for Metrics puts the same technology
used by Amazon internally to detect anomalies in its business metrics
into the hands of every developer. Customers can connect Amazon Lookout
for Metrics to 19 popular data sources, including Amazon Simple Storage
Solution (S3), Amazon CloudWatch, Amazon Relational Database Service
(RDS), and Amazon Redshift, as well as SaaS applications like
Salesforce, Marketo, and Zendesk, to continuously monitor metrics
important to the business (e.g. total revenue, gross margin, average
purchase frequency, return on advertising spend, etc.). Amazon Lookout
for Metrics automatically inspects and prepares the data, selects the
best suited machine learning algorithm, begins detecting anomalies,
groups related anomalies together, and summarizes potential root causes.
For example, if a customer's website traffic dropped suddenly, Amazon
Lookout for Metrics can help them quickly determine if an unintentional
deactivation of a marketing campaign is the cause. The service also
ranks the anomalies by predicted severity so that customers can
prioritize which issue to tackle first. Amazon Lookout for Metrics
easily connects to notification and event services like Amazon Simple
Notification Service (SNS), Slack, Pager Duty, and AWS Lambda, allowing
customers to create customized alerts or actions like filing a trouble
ticket or removing an incorrectly priced product from a retail website.
As the service begins returning results, customers also have the ability
to provide feedback on the relevancy of detected anomalies via the AWS
console or the Application Programming Interface (API), and the service
uses this input to continuously improve its accuracy over time.
"From
marketing and sales to telecom and gaming, customers in all industries
have KPIs that they need to be able to monitor for potential spikes,
dips, and other anomalies outside of normal bounds across their business
functions. But catching and diagnosing anomalies in metrics can be
challenging, and by the time a root cause has been determined, much more
damage has been done than if it had been identified earlier," said
Swami Sivasubramanian, Vice President of Amazon Machine Learning for
AWS. "We're excited to deliver Amazon Lookout for Metrics to help
customers monitor the metrics that are important to their business using
an easy-to-use machine learning service that takes advantage of
Amazon's own experience in detecting anomalies at scale and with great
accuracy and speed."
Lookout
for Metrics is available directly via the AWS console as well as
through supporting partners in the AWS Partner Network to help customers
implement customized solutions using the service. The service is also
compatible with AWS CloudFormation and can be used in compliance with
the European Union's General Data Protection Regulation (GDPR). Lookout
for Metrics is available today in US East (N. Virginia), US East (Ohio),
US West (Oregon), EU (Ireland), EU (Frankfurt), EU (Stockholm), Asia
Pacific (Singapore), Asia Pacific (Sydney), and Asia Pacific (Tokyo),
with availability in additional regions in the coming months.
DevFactory
is a Dubai-based provider of software and services solutions for global
enterprises. "Our flagship product, Quantum Retail, offers intelligent
retail-focused supply chain management and inventory optimization
solutions to thousands of retail customers. Our customers have volatile
sales data that is affected by millions of daily events across
categories like stores, products, and departments which fluctuates
according to yearly, monthly, and daily seasonality. Understanding the
sales patterns and separating anomalous sales from seasonal variations
is critical to accurate forecasting and downstream inventory planning,"
said Rahul Subrananiam, CEO, DevFactory. "Our existing solution relied
on statistical models and often failed to detect anomalous sales
behaviors across stores, leading to over or under allocation of
inventory to stores, which in turn significantly impacted the overall
revenue and customer satisfaction. With Lookout for Metrics, we are able
to automatically monitor data across all the important categories with a
few clicks and identify anomalous events in nearly 40% of cases that we
missed earlier. By quickly identifying such cases, we are able to
adjust our inventory planning and distribution across all stores in an
optimal way."
Digitata
intelligently transforms pricing and subscriber engagement for mobile
operators, empowering operators to make better and more informed
decisions to meet and exceed business objectives. "At Digitata, what
really matters is getting everyone connected at an affordable price.
This requires a deep understanding of economics, specifically supply and
demand and customer behavior according to changes in either," said Nico
Kruger, Chief Technology Officer, Digitata. "Using Lookout for Metrics
we were able to discover an issue that was negatively impacting pricing
for a Mobile Network Operator customer within minutes. We were able to
instantly identify the culprit and roll out a fix within two hours.
Without Lookout for Metrics, it would have taken us approximately a day
to identify and triage the issue, and would have led to a 7.5% drop in
customer revenue. Lookout for Metrics allows us to act quickly and
ensure the optimal performance of our pricing models, leaving us to
focus on what really matters-getting everyone connected."
Marcaide
founded Flywire, a startup that aims to ensure high-value international
payments go through fast and friction free-both for individuals and for
institutions across many industries, including healthcare, education,
and travel. "At Flywire, our engineers rely on comprehensive monitoring
systems, and as we grow, they have become bombarded by false positive
alerts that rob them of time as they chase down these bad leads," said
Omar Lopez, Tech Lead of Infrastructure, Flywire. "By leveraging Amazon
Lookout for Metrics to parse events from CloudWatch, we were able to go
to production in an afternoon and reduce our false positive rate by 7x.
This lets our Site Reliability Engineers focus on alerts with confidence
and gives us the tools to tackle even more complex operational and
business issues in the future."
More
Retail is the pioneer in omni-channel Food and Grocery Retail in India
and is pursuing its mission to be Indian consumers' most preferred
choice for food and grocery needs. More has 22 hyper markets and 624
super markets across India, supported by a network of 13 distribution
centers, 7 fruits and vegetables collection centers and 6 staples
processing centers. "Very often, across the 4 million+ SKU-Location
combinations, MRPL comes across a decline in stock which had prior
indicators. These can be a specific SKU not being produced by vendors, a
specific vendor facing issues across SKUs, or stress in the regional
supply chain," said Supratim Banerjee, Chief Transformational Officer,
More Retail. "Our initial evaluation of Amazon Lookout for Metrics to
capture these incidents looks very promising. We are able to capture 20%
of incidents before they actually impact our stores and our customers.
It was exciting that we were able to see the results in a matter of
hours and not weeks or months. I highly appreciate how Lookout for
Metrics makes it easy for my team to quickly implement AI/ML-driven
workloads and allows us to dynamically support our operations people
even in the most challenging times."
Since
its founding in 2001, Slalom has grown into a $1 billion company with
over 5,000 employees. Its clients include more than half the Fortune
100, along with startups, nonprofits, and innovative organizations of
all kinds. "By leveraging Amazon Lookout for Metrics, our clients will
be able to unlock critical data insights quickly and accurately," said
David Frigeri, Senior Director of Data and Analytics, Slalom. "Giving
our clients the ability to respond to near real-time anomaly detection,
adapt rapidly, and anticipate future disruptions and opportunities is a
key step towards embracing a modern culture of data."
Wipro
is a global IT consulting and system integration services firm that
develops and implements solutions for enterprises across the globe in
industries such as financial services, retail, consumer goods, and more.
"For us, Amazon Lookout for Metrics is
an autonomous service that provides customers with critical insights
into security and business data, helping them excel in the cloud," said
Dr. Manish Govil, General Manager and Global Head, Wipro AWS Business
Group. "Lookout for Metrics has not only reduced our development
efforts, but also significantly lowered the time it takes to employ
anomaly detection on customer workloads. It has also empowered us to
analyze historical and continuous data streams in near real time,
enabling us to find and eliminate anomalies from our customer's
operational and business data. We are excited to bring this AWS service
to our customers to help them achieve AI driven business outcomes in the
cloud at scale."