Skip to content
  • Products

      Products

      ignio AIOps

      Redefining IT Operations with AI and Automation

      ignio AI.Workload Management

      Enabling Predictable, Agile and Silent Batch Operations in a Closed-loop solution

      ignio AI.ERPOps

      End-to-end automation for incidents and service requests in SAP

      ignio AI.Digital Workspace

      Autonomously Detect, Triage and Remediate Endpoint issues

      ​ignio Cognitive Procurement

      AI-based analytics to improve Procure-to-Pay effectiveness

      ignio AI.Assurance

      Transform software testing and speed up software release cycles

      Let us demonstrate the power of Automation to transform your enterprise.
      Request a Demo
  • Solutions

      Solutions

      Business Health Monitoring

      Proactively Monitor Retail and eCommerce Health to deliver optimal customer experiences

      IDoc Management for SAP

      Monitor, Prioritize and Resolve IDoc issues to ensure business continuit

      IT Event Management

      Prevent outages with Predictive Intelligence and Autonomous Event Management

      Business SLA Prediction

      Never miss a business SLA with AI-powered monitoring and predictions

      Artificial Intelligence and Machine Learning
      Read More
  • Resources

      Resources

      Analyst Reports

      Discover what the top industry analysts have to say about Digitate

      Blogs

      Explore Insights on Intelligent Automation from Digitate experts

      ROI

      Get Insights from the Forrester Total Economic Impact™ study on Digitate ignio

      Case Studies

      Learn how Digitate ignio helped transform the Walgreens Boots Alliance

      Trust Center

      Digitate policies on security, privacy, and licensing

      e-Books

      Digitate ignio™ eBooks Provide Insights into Intelligent Automation

      Infographics

      Discover the Capabilities of ignio™’s AI Solutions

      White Papers and POV

      Discover ignio White papers and Point of view library

      Webinars & Events

      Explore our upcoming and recorded webinars & events

  • About

      About Us

      Leadership

      We’re committed to helping enterprise companies realize autonomous operations

      Newsroom

      Explore the Latest News and information about Digitate

      Partners

      Grow your business with our Elevate Partner Program

      Academy

      Evolve your skills and get certified

      Contact Us

      Get in Touch or Request a Demo

      Let us demonstrate the power of Automation to transform your enterprise.
      Request a Demo
Request a Demo
Search
Close
BLOG

The Gamble of Large Numbers

By Siddartha Kshirsagar
“Without mathematics, there’s nothing you can do. Everything around you is mathematics. Everything around you is numbers.”

Shakuntala Devi, Indian mathematician and calculating prodigy

The way of doing business has continuously evolved over the last few decades, and one of the most prominent factors affecting it is data. Data is being generated in enormous quantities, while at the same time it’s becoming much cheaper to store and process. Many organizations are unearthing their past data to identify patterns and generate insights that help them to estimate their future positions.

While the organizations are discovering their hidden potential through the language of data, can we be certain that the data is speaking the absolute truth? What if the data is telling only the pseudo-truth? What if our estimates are based on some false equivalences which might never hold true again? How can we be sure of the patterns/insights generated by our data? Well, this is where good old mathematics can come to our rescue!

The Law of Large Numbers

The Law of Large Numbers is a key concept whenever you want to make predictions based on patterns you observe in data. This mathematical “law” basically means that as we perform some experiment “n” number of times, the probability of the expected outcome gets closer to its theoretical probability as n approaches infinity.

Let’s take an example of tossing a coin (the mathematician’s favorite). Tossing an unbiased coin can have two possible outcomes: heads or tails, each having a probability of 0.5. Here, the law states that if we toss a coin a large number of times – say 100 or 1,000 – the probability of getting heads will be close to 0.5, which is its theoretically expected probability.

Easy, right? Almost… with a catch!

The Law of Large Numbers does not guarantee that a given sample will always reflect the true characteristics of a population. If a given sample deviates from the expected mean, you can’t expect that subsequent observations will bring the observed average nearer to the expected mean.

Let’s continue with tossing a coin.

If you toss the coin three times and get heads all three times, the probability of getting heads in those tosses now becomes 1. However, we expect that in the next three tosses, the coin must come up tails three times in a row to reflect the true probability of 0.5. But can we guarantee that tails will show up three consecutive times? No!

The Gambler’s Fallacy

The Gambler’s Fallacy is a phenomenon in which an individual erroneously believes that a certain random and independent event is less or more likely to occur based on the outcome of a previous event. This is not true. The outcome of previous events does not affect the probability of future random and independent events.

Continuing with tossing the coin, if we get three heads in a row after tossing the coin three times, the individual might predict that next time the coin will definitely land on tails. However, the actual probability of getting “tails” still remains at 0.5. This is a how an individual commits a Gambler’s Fallacy.

A classic example of the Gambler’s Fallacy occurred at the Monte Carlo Casino in 1913. The roulette wheel’s ball fell on black several times in a row. This led people to believe that the ball would soon fall on red, and they started placing their bets with this assumption. However, the ball only fell on red after 27 spins of the wheel. Millions of francs were lost by then!

Impact on Business

We humans have a tendency to find patterns in all events. We are uncomfortable with ambiguity and randomness. This is what makes us find patterns that simply do not exist in the actual world. With businesses today still being run by humans (pre-Terminator, at least), decisions that don’t take into account the Law of Large Numbers and the Gambler’s Fallacy can prove disastrous. These mathematical concepts are applicable to every domain of business. Let’s look at some:

Insurance

Insurance companies need some mechanism to estimate the value and frequency of all their future claims. With a good foresight of the future claims, the companies can fix their premium rates at levels that let them stay profitable while making advantageous offers to customers Here is where the Law of Large Numbers can help. The law states that the actual total of compensation claims will eventually equal the expected total in the long run as the number of policyholders keeps increasing. Thus, insurance companies have basic confidence that their calculations are reliable models for future outcomes.

However, when a pandemic like COVID looms, all these models crumble because the probability itself changes significantly; the number and amount of compensation claims can mount much higher than the expected average. This can lead to large potential losses.

Startups

The technology industry is famous for startup companies that become incredibly valuable. India alone has 80 unicorns (startups worth more than $1 billion). An early investment in one of these companies would have paid off handsomely. But what about a similar investment now? It’s important to know whether the startup that interests you will continue to grow just as fast in the long run.

This is where the Law of Large Numbers kicks in. It says that eventually, the growth rate of these unicorns will level off from a steep growth curve to a more predictable, slower-rising line, approaching the average growth of other big organizations. Thus, the law can prevent the unicorns from estimating their growth rate based on some false equivalences.

Stock prices

Speaking of investments, how often have you heard a comment like this? “Equity funds are hitting the upper limit from the last three trading sessions. Let’s not invest – it will surely fall now.” But what often gets unnoticed is that many external factors can affect a stock price. Probability does play a role in overall stock price movement, but gravity doesn’t. It isn’t true that if a stock keeps moving up, then it has to come down eventually. Thus, knowing about the Law of Large Numbers and the Gambler’s Fallacy can also save you from bad investments.

Using mathematical fundamentals to guide our work

At Digitate, we have built our flagship product, ignio™, as the “perfect” data scientist. It has been trained to distinguish events with a definite pattern from those that are merely random. Moreover, it avoids letting its “judgment” get biased, using statistical de-biasing techniques that highlight independent events and their inability to affect each other. The patterns and correlations that ignio generates are structured and well-defined – ignio’s “Spidey sense”! Well, not really; these results are not based on tingling intuition but guided by mathematical concepts.

Parting Thoughts

The Law of Large Numbers continues to present mysteries to unravel. Can we use historical macro-trends and patterns to infer micro-behavior? How should the recent past influence the prediction of future micro-events? To continue the coin toss analogy, if for 100 tosses, all we get is heads, should the prediction for the next toss be skewed towards heads since we have had 100 out of 100 so far?

Or should the future be more skewed towards tails, since we need to catch up with the law of averages? Well… ignio knows. Do you?

Related

Share

Recent Posts

Pareto principle: the law of the vital few

February 2, 2023

We’re not bluffing: Poker and other games are good models of the autonomous enterprise

January 31, 2023

The curse and cure of dimensionality

January 23, 2023

IDoc Management Helping Organizations Achieve Flawless ERP Communication- In Depth

December 15, 2022

How ignio uses ML to take the tediousness out of tech support

December 6, 2022

How to make an elephant fly

November 7, 2022
Author

Siddartha Kshirsagar

Senior Engineer | Digitate
Contacts
Head Office

5201 Great America Parkway Suite 522
Santa Clara, CA 95054 USA

Twitter Linkedin Youtube Facebook Instagram
Company
  • About Digitate
  • Partner With Us
  • Newsroom
  • Blogs
  • Contact Us
Support
  • Data Privacy Notice
  • Website Use Terms
  • Cookie Policy Notice
  • Trust Center
  • Cookies Settings
Stay Connected
© Tata Consultancy Services Limited, 2022. All rights reserved
Products

ignio AIOps

Redefining IT Operations with AI and Automation

ignio AI.Workload Management

Enabling Predictable, Agile and Silent Batch Operations in a Closed-loop solution

ignio AI.ERPOps

End-to-end automation for incidents and service requests in SAP

ignio AI.Digital Workspace

Autonomously Detect, Triage and Remediate Endpoint issues

​ignio Cognitive Procurement

AI-based analytics to improve Procure-to-Pay effectiveness

ignio AI.Assurance

Transform software testing and speed up software release cycles

Solutions

Business Health Monitoring

Proactively Monitor Retail and eCommerce Health to deliver optimal customer experiences

IDoc Management for SAP

Monitor, Prioritize and Resolve IDoc issues to ensure business continuit

IT Event Management

Prevent outages with Predictive Intelligence and Autonomous Event Management

Business SLA Prediction

Never miss a business SLA with AI-powered monitoring and predictions

Resources

Analyst Reports

Discover what the top industry analysts have to say about Digitate

Blogs

Explore Insights on Intelligent Automation from Digitate experts

ROI

Get Insights from the Forrester Total Economic Impact™ study on Digitate ignio

Case Studies

Learn how Digitate ignio helped transform the Walgreens Boots Alliance

Trust Center

Digitate policies on security, privacy, and licensing

e-Books

Digitate ignio™ eBooks Provide Insights into Intelligent Automation

Infographics

Discover the Capabilities of ignio™’s AI Solutions

White Papers and POV

Discover ignio White papers and Point of view library

Webinars & Events

Explore our upcoming and recorded webinars & events

About Us

Leadership

We’re committed to helping enterprise companies realize autonomous operations

Newsroom

Explore the Latest News and information about Digitate

Partners

Grow your business with our Elevate Partner Program

Academy

Evolve your skills and get certified

Contact Us

Get in Touch or Request a Demo

Request a Demo
Products

ignio AIOps

Redefining IT Operations with AI and Automation

ignio AI.Workload Management

Enabling Predictable, Agile and Silent Batch Operations in a Closed-loop solution

ignio AI.ERPOps

End-to-end automation for incidents and service requests in SAP

ignio AI.Digital Workspace

Autonomously Detect, Triage and Remediate Endpoint issues

​ignio Cognitive Procurement

AI-based analytics to improve Procure-to-Pay effectiveness

ignio AI.Assurance

Transform software testing and speed up software release cycles

Solutions

Business Health Monitoring

Proactively Monitor Retail and eCommerce Health to deliver optimal customer experiences

IDoc Management for SAP

Monitor, Prioritize and Resolve IDoc issues to ensure business continuit

IT Event Management

Prevent outages with Predictive Intelligence and Autonomous Event Management

Business SLA Prediction

Never miss a business SLA with AI-powered monitoring and predictions

Resources

Analyst Reports

Discover what the top industry analysts have to say about Digitate

Blogs

Explore Insights on Intelligent Automation from Digitate experts

ROI

Get Insights from the Forrester Total Economic Impact™ study on Digitate ignio

Case Studies

Learn how Digitate ignio helped transform the Walgreens Boots Alliance

Trust Center

Digitate policies on security, privacy, and licensing

e-Books

Digitate ignio™ eBooks Provide Insights into Intelligent Automation

Infographics

Discover the Capabilities of ignio™’s AI Solutions

White Papers and POV

Discover ignio White papers and Point of view library

Webinars & Events

Explore our upcoming and recorded webinars & events

About Us

Leadership

We’re committed to helping enterprise companies realize autonomous operations

Newsroom

Explore the Latest News and information about Digitate

Partners

Grow your business with our Elevate Partner Program

Academy

Evolve your skills and get certified

Contact Us

Get in Touch or Request a Demo

Request a Demo
 

Loading Comments...