The Future of Everything

December 31, 2025

The q-variance challenge

Filed under: Economics, Quantum — Tags: , , — David @ 4:54 pm

Can any continuous-time model, using no more than three free parameters, reproduce what may be the most clear-cut empirical property of variance, namely the parabolic relationship known as q-variance?

The competition was launched on 8 December 2025 by Wilmott magazine.

Prize: One-year subscription to WILMOTT magazine and publication of the technique.

Competition details: See the GitHub site.

Further model information: Q-Variance: or, a Duet Concerning the Two Chief World Systems. Wilmott 2025 (138)

Challenge update 30 January 2025 from Wilmott magazine

Watch Bloomberg presentation on their attempt at the challenge

August 12, 2025

Qvar, an online app to explore q-variance

Filed under: Economics, Quantum Economics and Finance — Tags: , — David @ 8:47 pm

The Qvar Shiny app is now live at:
https://david-systemsforecasting.shinyapps.io/qvar/

The app provides an interactive way to explore q-variance – a property that links price changes and volatility in a way not anticipated by traditional models. It draws on ideas from quantum probability to test whether a universal variance relationship holds across major stocks.

What Is Q-Variance?
In the q-variance framework, the annualized variance over a period T follows to good approximation the formula

V(z)=σ0^2+z^2/2

where z=x∕√T, x is log return over the period corrected for drift, and σ0 is a minimum volatility parameter that is estimated from the data.

This formula implies that variance grows quadratically with the scaled price displacement z, in contrast to classical models where it is constant (e.g. Black–Scholes) or varies randomly. The app illustrates this for a range of assets including 355 S&P 500 stocks that have been in the index for at least 75% of trading days between 1992-01-02 and 2025-04-17.

What You Can Do in the App

📊 Pick any of 355 S&P 500 stocks
⏳ Choose time periods from 1 to 26 weeks
📈 Compare actual market behaviour to the q-variance prediction
🌐 Download the raw data to analyse yourself

Why It’s Worth a Look

  1. Reveals patterns hidden in noisy financial data
  2. Helps test whether the quantum-inspired model matches reality
  3. Useful for researchers, students, and anyone curious about volatility

How to Use the App
Plots tab – Choose a stock ticker and range of periods T (1–26 weeks).
The upper plot shows variance vs z for selected periods. Blue line is average variance as a function of z, red line is the q-variance curve.
The lower plot shows the average density (blue) compared with the quantum model (red).
Data tab – View/download the time series for the selected asset(s), including prices and computed variables.

📍 Try it now:
https://david-systemsforecasting.shinyapps.io/qvar/


See also: QEF15 – A quantum oscillator model of stock markets 2: q-variance and the q-distribution

June 22, 2025

QEF16 – A quantum jump model of option pricing

As seen in QEF15, stock market data follows q-variance and the q-distribution. Q-variance refers to the property that the expected variance of log returns x, corrected for drift, over a period T follows to good approximation the formula V(z)=σ^2+z^2/2 where z=x∕√T. This property follows because we model price change as the displacement of a quantum harmonic oscillator, so a larger displacement is associated with higher energy and therefore higher volatility.

The probability distribution associated with q-variance is a Poisson-weighted sum of Gaussians known as the q-distribution. The Poisson rate parameter is λ=0.5 and the standard deviation for each term is σ_n=σ√(1+2n).

The q-distribution can be used to calculate the price of a call option. We can also use it to calculate the q-implied volatility σ_q, which is the volatility to be used in the Black-Scholes model for this distribution. The answer is seen to be

σ_q^2=q^2 σ^2+(1-q^2 ) z^2   

where q≅0.95.

We can therefore compare three kinds of volatility. Q-implied volatility is the number suggested by quantum model. Implied volatility is the number used by traders. Payout-implied volatility is the number which corresponds to average payouts.

Plots show q-implied (left), implied (middle), and payout-implied (right) volatility as a function of x and T (top row) and z only (bottom row).

To summarise, the q-distribution can be used to calculate the expected payout of a call option. The q-implied volatility (the volatility suggested by the quantum model) is quite close to both implied volatility (the volatility used by traders) and payout-implied volatility (the volatility which reflects average payout)

This suggests that markets follow a quantum distribution, and traders are using a quantum model to price options – they just don’t know it

For further reading, see:

Orrell D (2025) A Quantum of Variance, and the Challenge for Finance. Wilmott 2025(138).

Orrell D (2025) A Quantum Jump Model of Option Pricing. Journal of Derivatives 33(1).

Previous: QEF15 – A quantum oscillator model of stock markets 2: q-variance and the q-distribution

Playlist: Quantum Economics and Finance

QEF15 – A quantum oscillator model of stock markets 2: q-variance and the q-distribution

Q-variance refers to the property, described previously in QEF14, that the expected variance of log returns x, corrected for drift, over a period T follows to good approximation the formula

V(z)=σ^2+z^2/2

where z=x∕√T.

Q-variance follows because we model price change over a period as the displacement of a quantum harmonic oscillator (here we are not explicitly modelling the market maker).

A corollary is that the price change distribution follows a Poisson-weighted distribution of normal curves, where the Poisson rate parameter is λ=0.5, and the standard deviation of the n’th term is σ_n=σ√(1+2n). This distribution, known as the q-distribution, looks like the figure below.

The q-distribution (solid line) is composed of a Poisson-weighted sum of Gaussians. The first three terms are shown by the thin lines.

The q-distribution can be derived in a number of ways. One is to note that the volatility of the perturbed oscillator is computed by measuring the energy level n. The result follows a Poisson distribution, with σ_n being the standard deviation associated with each level. An ensemble of oscillators, representing separate transactions over the period, then gives the q-distribution. Another way to derive the distribution is by demonstrating that the value λ=0.5 is consistent with q-variance.

The test of course is whether q-variance and the associated q-distribution are consistent with data. The figure below shows variance as a function of z=x∕√T for 355 stocks for the period January 1992 to April 2025. For each stock, the results are compiled over periods T of one to 50 weeks. Companies included are currently in the S&P 500 index and have data for at least 75 percent of the period. Blue line is the mean, red line is the quantum model with a small shift to account for effects such as skew.

Q-variance

The left panel in the figure below shows the distribution of z for the same 355 stocks. Blue line is the mean. The right panel shows the same, after the results for each stock are scaled to bring them in line with the mean. The q-distribution, shown by the red dashed line, is almost indistinguishable from the mean.

To summarise, the quantum oscillator model predicts that variance will show the property of q-variance, and price changes will follow the q-distribution. These are connected because the q-distribution is consistent with q-variance. The predictions have been tested against stock market data and are in excellent agreement with results. However neither q-variance nor the q-distribution are consistent with a classical random walk, which is probably why they have not previously been used in finance

For further reading, see:

Wilmott P and Orrell D (2025) Q-Variance: or, a Duet Concerning the Two Chief World Systems. Wilmott 2025(138).

Orrell D (2025) A Quantum of Variance, and the Challenge for Finance. Wilmott 2025(138).

Previous: QEF14 – Is the volatility smile real or imaginary?

Next: QEF16 – A quantum jump model of option pricing

Playlist: Quantum Economics and Finance

October 2, 2024

Gaia, or how to write the perfect eco-thriller

Filed under: Books — Tags: , , , , , — David @ 1:22 pm

Back in 2021 I heard about a new film out of South Africa called Gaia. According to the plot synopsis, the story starts with two characters Gabi and Winston exploring a forest in South Africa. When they leave, Gabi tells Winston that “we can’t just leave our trash here.” It then turns out that Winston has been infected by a lethal fungus, similar to a mutated version of cordyceps (see below), which Gabi later links to a Gaia-worshipping survivalist cult. 

The movie didn’t achieve wide release, however the reviews were quite good. According to Roger Ebert, “Gaia has a lot to say about humanity’s destruction of the environment, about the ‘tipping point’ we have collectively reached in the Anthropocene, but the film says it with creativity, mad flights of imagination, and even humor.”

My interest though was due to the fact that in 1999 I wrote a screenplay that was also called Gaia. In my version, the story starts with two sisters Sandra and Anne exploring a forest in Venezuela. When they leave, Anne tells Sandra “We shouldn’t leave behind any trace that we were here.” It then turns out that Anne has been infected by a mutated version of cordyceps, which Sandra later links to a Gaia-worshipping survivalist cult.

At the time I found an agent with an address on Sunset Boulevard, and had some interest in the screenplay from a (now-defunct) UK production firm, but it didn’t go anywhere. (Twenty-five years ago, before anyone had heard of Covid and global warming was just a theory, the idea that the Earth might try to rid itself of us through a disease might have seemed a little … fanciful.) So I adapted the screenplay into a novel (represented this time by the Robert Lecker Agency) and switched my focus to writing books on science and economics.

Now, leaving aside the question of whether the South African team had come across my book during their research (available in self-published form at Amazon since 2009, and cited e.g. here); noting that the stories do take very different turns (mine moves to the city and has a much bigger scale, different style etc.); and acknowledging my own limitations as a fiction writer (as one editor politely informed my agent, “David’s strength is in non-fiction”); I think that the initial premise which the two stories share is in some ways pretty optimal for an eco-thriller about our relationship with the living planet.

When I wrote my screenplay, the logic of the story was that if the Earth is alive, and humanity is harming it, then the Earth will produce an antibody to counter us, which we will perceive as a disease. The Earth doesn’t make a very good antagonist in a story though, so as a human stand-in I used the leader (Angel) of an Earth-worshipping cult who plans to spread the disease to save Gaia.

The nature of the disease – a variant of the fungus cordyceps – was inspired by an article on the Venezuelan tepuis (where Anne contracts the disease) in the May 1989 edition of National Geographic. The article included the macabre image of an ant whose body has been taken over by the fungus. The same disease was used later in another apocalyptic drama The Last of Us, based on a video game of the same name. The one in the South African film is unnamed, but as one review wrote it bears an “eerie resemblance” to a “mutated cordyceps infection.”

In the South African film the protagonist Gabi is a forest ranger, while in my version the main protagonist Sandra is an oil company PR executive. For me, this choice of profession was important. As a recent Nature review of a book on James Lovelock, of Gaia theory fame, wrote: “If you wanted to be spiritual about it, you could argue that Gaia chose Lovelock as her messenger, despite – or perhaps because of – his evident personal failings. You’d expect a tree-hugger to tell you that the planet is one vast interconnected system powered by life. But when a scientist paid by Shell and Dow Chemical delivers the message, you believe it.” So in my story, it is Anne the environmentalist who dies, and the oil company executive who must stop the disease and save the world (or at least the human part).

The similarities between the stories are impossible to ignore, from the initial set-up in an isolated forest, to the specific nature of the disease, to the role of a survivalist Gaian cult, and even in echos of dialogue (we can’t leave our trash here). To be clear, I don’t think the issue is direct plagiarism – it is more about ideas than words.1 Indeed, I congratulate the South African team for bringing Gaia to life through story, which was the main aim of my screenplay. The success of their film serves as a proof-of-principle that the central premise of the story works.

Also, I learned more recently that there is yet another Gaia-related movie from 2021, called In the Earth. One article described it as “uncannily similar” to the South African film, another said “the similarities between the two films are as clear as day”, while an academic review from 2023 described them as “twin films”. Common elements naturally include a fungal disease based on cordyceps, and a cult. The similarity is put down to synchronicity, and the influence of the pandemic. Maybe it’s just an idea whose time has maybe not quite come, but is on its way.

Of course there are many other ways to write a story about the living Earth (see for example David Brin’s Earth). And as mentioned, my screenplay is far from being perfect. But if anyone is planning another version (and every good horror film needs a sequel), then please get in touch.

  1. Though it wouldn’t be the first time. One author helped themselves to an entire chapter (I ended up receiving a portion of the royalties), another copied an essay for their book (the subject coincidentally was Gaia theory, they were surprised to learn that we shared the same agent), and on a number of occasions academics have lifted sections of my books for their articles (in one case over 2000 words).

February 23, 2024

The quantum implied volatility model

The quantum implied volatility (QIV) model is a minimalistic model of an implied volatility surface. The aim is to capture the main features of implied volatility using a small number of parameters.

The model is derived by assuming that the implied volatility is the volatility which, when used as input to the Black-Scholes model, will produce the correct option price under the quantum model of asset price. Let x be log price change over a period T, and set z=x/√T. If we ignore the drift term, the quantum model then says that the price distribution can be modelled as a Poisson-weighted sum of Gaussians in z. If we now calculate the volatility which gives the correct option price for that distribution, then we find it satisfies

where again z=x/√T but now x represents log moneyness (see here for derivation). The only parameters are a base volatility s, and the number q which has a typical value of about 0.95.

The QIV model was tested against SPX options during the period 2004-2020. The results are shown in the figures below. The left panel shows implied volatility as a function of T and z=x/√T (chosen because the quantum model is expressed in terms of z). The option prices are averaged over each strike and expiration (from five days to one year), and the implied volatility is then computed. Put options are used for x<0 and calls for x≥0. The quantum model is shown by the red line. The right panel is an end view of the same data, which shows that the surface is independent of the period T when plotted in this way.

The results are not perfect, especially for at-the-money options, which is not surprising given that implied volatility is complicated by a number of behavioural and other effects. For example, for z near zero, put options (to the left) attract a higher price than call options (to the right). However the quantum model correctly predicts the overall V-shaped configuration that appears when the data is plotted in this way, and does a better job at more extreme strikes. Results could obviously be improved by adding more parameters, but the aim here is to show that the surface can be fit quite well using only the basic model with q=0.95.

Also, it should be noted that the QIV model is a prescriptive model, in the sense that it calculates the correct volatility to use given a quantum price distribution. If traders are using a significantly different implied volatility, then that may suggest a degree of mispricing, and therefore an opportunity for arbitrage.

For details and other applications of the model, see the paper “A quantum model of implied volatility” in the May 2024 issue of Wilmott. A pre-publication draft is also available here.

November 2, 2023

June 15, 2023

CQF talk on a quantum view of Black-Scholes

Filed under: Quantum Economics and Finance, Talks — Tags: , — David @ 1:21 pm

It was a pleasure speaking yesterday at the Quant Insights conference marking the 50th anniversary of the Black-Scholes model. My talk presented nine predictions which came out of the quantum model – things that I had not been aware of, but that were suggested by the model and proved correct after empirical tests. And they all had implications for option pricing and the Black-Scholes model.

1. Before starting to work with the model, I didn’t know that price change and volatility for index data such as the S&P 500 or DJIA scale inversely with the square-root of time, even though the price change data is not normal, and volatility is not constant.

Density plots of log price changes, normalized by the square-root of time in years, for the S&P 500 over the years 1992-2021. The solid lines, from darkest to lightest shades of grey, are for periods of 1, 2, 4 and 8 weeks (measured in days). Dashed line is the quantum model.

2. I had heard of the square-root law of price impact, which says that the price change induced by a large order scales with the square-root of the order size, but didn’t know that the numerical coefficient was approximately one, as predicted by the quantum model.

Plot of price change versus order size Q over average daily volume V follows a square-root law with coefficient near unity.

3. I certainly didn’t know that the variance followed a simple equation that contradicted a published result.

Variance plotted against imbalance Q/(VT) where Q is order size, V is daily volume, and order time T ranges from 3.5 minutes (black) to 345 minutes (light grey). The single parameter sigma estimates the volatility.

The drawbacks of the neoclassical model of supply and demand have long been pointed out by critics such as Steve Keen. A basic one is that what counts is not supply and demand separately, but the ratio of demand to supply for available units. The quantum price impact model therefore gives an alternative model with only a single parameter, that has been rigorously tested for stock market data.

Plot of log price against imbalance, which is the ratio of demand to supply per available unit.

4. I had heard of the implied volatility smile in options trading, but didn’t know that actual volatility showed an even more pronounced smile, that followed a simple relationship with price change and time (and is related to price impact). I’m sure I am not the first person to notice this fact, but I haven’t seen it, or the connection with implied volatility, reported in the literature.

RMS annualized volatility for the S&P 500, plotted against normalized price change, for periods of 1, 2, 4 and 8 weeks (dark to light). Dashed line is the quantum prediction.

5. Implied volatility is not the same as actual volatility, because it is found by fitting a lognormal option pricing model to data that is not actually lognormal, and is affected by trader behaviour. So it was interesting to find that the quantum model produced an implied volatility surface very similar to what is found in the wild.

The quantum implied volatility surface is a somewhat flattened version of actual volatility.

6. The VIX index is an estimate of future volatility based on implied volatility, which is in turn used to price other options. The VIX is often described as being model independent, but its formula is based on two things: that volatility is independent of strike, and that the relevant growth rate is the risk-free rate. The former is an assumption of the Black-Scholes model, while the latter is its key finding. The VIX is therefore Black-Scholes in another guise. The quantum model predicted that the VIX substantially over-estimates both implied volatility and actual volatility, because its formula adds up the contributions of options in the wrong way. The results agree.

The VIX is produced using a formula which assigns weights to options (grey line) and produces a single volatility (dashed line) which is supposed to represent the implied volatilities (blue points). The quantum model (red) is a version of the smile curve.

7. Given that the Black-Scholes model assumes constant volatility, it makes sense that it should misprice options. However I for one was surprised to find that, according to the quantum model, it misprices at-the-money straddle options by a factor about equal to the square-root of two.

Comparison of straddle option pay-in for Black-Scholes model (blue) and quantum model (red), with expected pay-out (dashed). The Black-Scholes model misprices at-the-money straddles by about 40 percent.

8. Since the Black-Scholes model is the industry-standard pricing model, it makes sense that model error will lead to mispricing in option markets. This prediction was verified by Larry Richards who analyzed CBOE data for over 25,000 1-month SPX option prices from 2004 to 2017. So much for efficient markets. See our paper published in the March 2023 issue of Wilmott.

9. Finally, a logical consequence of this is that one can devise options-trading strategies to exploit this mispricing – for example, by selling at-the-money straddles (with appropriate protection to cover potential losses).

To summarise, the main difference between the classical random walk model traditionally used in quantitative finance, and the quantum model, is that the former assumes markets are at equilibrium and volatility is constant, while the latter treats markets as a dynamical system where price change and volatility are linked. The quantum model therefore does a better match of fitting and predicting market behaviour, without relying on additional made-up parameters of the sort so common in traditional quant finance.

In a panel discussion in which quants Emanuel Derman and Robert Litterman reminisced about the history of the Black-Scholes model, a viewer asked Derman whether “quantum economics and finance was too much of a stretch.” He agreed (again, predictably) that yes it was, without giving specific reasons (though he added that he would be willing to reconsider). And yet it’s strange that previous studies of implied volatility – including Derman’s own book The Volatility Smile – didn’t pick up on the obvious fact that the implied volatility smile is a weaker version of a smile seen in the actual asset price data (see my article The Black-Scholes Magic Trick in the July 2023 issue of Wilmott). Or that this would lead to a significant mispricing of commonly-traded options.

Models aren’t just tools to analyze systems, they also affect what we do and don’t see. And in finance, the quantum model isn’t too much of a stretch – it’s a perfect fit. For details of the quantum model, see here. And for more work along these lines, please follow our new journal Quantum Economics and Finance.

Update: A video of the talk is now available for members (free) at the CQF Institute website (see Part 3). See also the related paper “Quantum Uncertainty and the Black-Scholes Formula” available at SSRN.

April 14, 2023

The uncertainty principle, finance version

Filed under: Economics, Quantum — Tags: , — David @ 3:58 pm

I’m a big fan of uncertainty. I’m more interested in what we don’t know than what we do know. In physics, that obviously leads naturally into quantum … where the idea of uncertainty is baked into the theory itself.
Shohini Ghose

In a Perimeter Institute podcast, quantum physicist Shohini Ghose discussed the role of uncertainty, applying it not just to physics, but to “questions around identity and society.” As she notes, “there is power to uncertainty, that the universe itself is telling us, stop with all of this precision measurements and stop with trying to know it all.” Despite the fact that quantum mechanics was developed over a century ago, “only recently have we really started exploring and digging deeply into the stranger properties of superposition, entanglement, all of which have quantum uncertainty underlying them.”

According to Ghose, there is a quantum revolution in the works which rivals the Industrial Revolution. The latter was shaped by a quest for precision and certainty in everything from production at scale to mass marketing. In contrast, “this whole new revolution with new quantum technologies” will reshape the way we think and behave. “Just like we move away in science from zero or one and go to zero and one, perhaps in society too, we will naturally start expanding our choices … and we will get to newer ways and newer approaches, which can influence so many aspects of our behavior.” (Listen to the full podcast here.)

While Ghose doesn’t discuss economics and finance, there is an interesting parallel with the world of quantitative finance.

This year marks the fiftieth anniversary of the Black-Scholes model, which is used to price financial options. The model has been described as “the most widely used formula, with embedded probabilities, in human history.” It is even more famous, though, for kickstarting the development of large-scale derivatives trading, by appearing to banish uncertainty from the pricing of options.

The Nobel-winning theory accomplished this by assuming that you can constantly buy and sell options and the underlying stock in such a way that the growth rate has to equal the rate of a risk-free instrument such as a government bond (so-called “dynamic hedging”). It was therefore unnecessary to make subjective and uncertain estimates of future growth. Key to the argument was that all the buying and selling will not incur excessive costs, and also that the volatility (standard deviation) of the price is a known constant.

In quantum economics, however, the bid/ask spread between buy and sell prices is not a technical detail, it is a fundamental level of uncertainty, and the main driver of volatility. The dynamic hedging proof therefore breaks down.

In a recent study that I carried out with hedge fund CTO Larry Richards, we showed that the key assumptions behind the Black-Scholes model do not hold up. Growth rates do matter, and they are uncertain. The volatility is not constant but depends on the degree of market imbalance, which affects the price change over an interval. The (empirically verified) result of all this is that, for commonly traded options, the Black-Scholes model is out by a factor about equal to the square-root of two.

The reason the Black-Scholes model has been so influential therefore is not because of its accuracy, but because it appeared to banish uncertainty from options trading, and transform it from what used to be considered a slightly disreputable form of gambling, into scientific risk management. In contrast, the new results came out of a quantum model of asset price behaviour which puts price uncertainty at its core.

In a sense, the two models therefore represent a different version of what we consider to be science. The Black-Scholes model appears to be rational and logical and certain. The quantum model takes uncertainty as its starting point. And the empirical evidence backs the latter.

So maybe, to borrow Ghose’s words, “the universe itself is telling us, stop with all of this precision measurements and stop with trying to know it all.” Finance is uncertain, and we can’t banish risk with an equation.

April 12, 2023

Older Posts »

Blog at WordPress.com.

Create your own website, free on WordPress.com.Create your own website.
Start free