Before you begin, remember that you have an index with the newsletter content organized by clicking below.

INDEX

From trading signals to deployable quantitative strategies

Diary of a Quant – Notebook II presents a broad collection of methods for turning quantitative trading concepts into strategies. It moves from statistical arbitrage and relative value through microstructure, cross-sectional signals, directional trading, and finally portfolio construction, hedging, leverage, drawdown control, and capacity. The emphasis is on testing whether they remain viable after execution costs, liquidity, changing regimes, and portfolio constraints are introduced.

What’s inside:

1. Building statistical arbitrage and relative-value strategies: Nonlinear cointegration, synthetic-control baskets, functional data analysis, SINDy dynamics, survival models, latent clustering, lead–lag transmission, and event-gated residuals provide alternative ways to identify and trade temporary dislocations while monitoring whether the relationship remains stable.

2. Modeling microstructure, liquidity, and execution: Order-flow normalization, Level-2 imbalance, fill probabilities, execution-cost shifts, reinforcement-learning execution, VWAP/TWAP switching, passive-order management, venue selection, and post-trade markouts connect theoretical alpha with the mechanics of getting trades filled.

3. Trading volatility and market structure: Variance, skew, VIX structure, overnight gaps, dealer gamma, and volatility-regime effects are used to formulate strategies around option-implied information, convexity, crash behavior, and changes in the market’s volatility state.

4. Exploiting cross-sectional, corporate-event, and crowding effects: ETF flows, index reconstitutions, short interest, squeeze risk, earnings drift, analyst revisions, buybacks, insider activity, seasonality, residual momentum, and turnover-aware momentum transform stock-specific information into market- and sector-controlled portfolios.

5. Designing trend, breakout, futures, and macro signals: Volume-node acceptance, liquidity vacuums, range compression, failed gaps, market breadth, carry–momentum interactions, volatility-confirmed breakouts, policy pressure, and inventory conditions provide systematic ways to distinguish persistent directional moves from false breaks.

6. Constructing portfolios and controlling risk dynamically: Pareto optimization, factor neutrality, inverse-volatility sizing, risk parity, correlation stress, volatility targeting, drawdown-based leverage, regime allocation, hedge baskets, hierarchical clustering, and diversification methods determine how individual signals should be combined and scaled.

7. Accounting for robustness, costs, and capacity: Liquidity matching, covariance instability, capacity-aware allocation, drawdown parity, transaction costs, slippage, financing, and position limits force promising backtests to confront the constraints of live deployment. Each method is intended as a research building block whose assumptions and parameters must be estimated and validated for the specific market and trading horizon.

Physical Book

Sample

417KB ∙ PDF file

Download

Download

Read more

Before you begin, remember that you have an index with the newsletter content organized by clicking below.

INDEX

From market intuition to testable quantitative research

Diary of a Quant — Notebook I presents 100 compact mathematical methods for transforming trading ideas into measurable research specifications. It covers robust estimation, dependence, portfolio construction, information geometry, regime detection, machine learning, and empirical validation. Each entry connects the mathematics to a practical research decision, exposing the assumptions and constraints required to code, compare, test, reject, or refine an idea.

What’s inside:

1. Stabilizing covariance and precision estimates: Robust estimators, shrinkage, factor models, random-matrix cleaning, structured priors, and geometric techniques reduce estimation noise and prevent unstable covariance matrices from distorting hedges and portfolios.

2. Measuring dependence beyond correlation: Copulas, tail co-movement, partial-correlation networks, mutual information, HSIC, and distributional distances reveal relationships that conventional linear correlation may fail to detect.

3. Allocating capital under uncertainty: Regularized optimization, risk parity, volatility targeting, factor-neutral projection, bootstrap diagnostics, and distribution-based risk budgets produce allocations that are more stable and interpretable.

4. Using information geometry and entropy: Fisher–Rao distance, Bregman projections, geodesics, divergence measures, entropy constraints, and manifold methods describe how market distributions evolve, separate, and deteriorate through time.

5. Detecting regimes and monitoring edge decay: State-conditioned models, entropy rates, sequential likelihood ratios, optimal transport, and geometric stopping rules identify structural changes and determine when an existing signal is no longer reliable.

6. Applying machine learning to market structure: Self-supervised embeddings, contrastive learning, neural SDEs, normalizing flows, adversarial training, domain adaptation, and contextual bandits model complex relationships while accounting for changing environments.

7. Validating and operationalizing research: Off-policy evaluation, doubly robust estimation, knockoff filters, block-permutation tests, structural simplicity, and execution-aware design help distinguish genuine predictive value from overfitting and convert promising formulations into testable strategies.

Physical Book

Sample

446KB ∙ PDF file

Download

Download

Read more

Before you begin, remember that you have an index with the newsletter content organized by clicking below.

INDEX

From research question to testable hypothesis

Quantitative trading research begins with market intuition, but it becomes empirically useful only when the researcher defines the instruments, market state, activation trigger, response window, expected price path, and causal mechanism. Strong hypothesis fixes these elements before testing, separates the source of the edge from its execution, and establishes the conditions under which the claim remains valid or expires.

What’s inside:

1. Narrowing the phenomenon: The researcher reduces a broad market observation to a specific inefficiency by defining the relevant instruments, environmental state, and natural time horizon.

2. Selecting instruments, states, and horizons: Assets should be close to the source of the market force, conditions should support the proposed mechanism, and the holding period should match the speed at which the effect unfolds.

3. Defining the expected effect: The hypothesis specifies the direction, shape, magnitude, duration, and decay of the anticipated response, including mean reversion, continuation, spread compression, or ranking changes.

4. Connecting price action to economic meaning: Expected returns require a causal explanation based on information diffusion, liquidity recovery, forced order flow, institutional execution, funding constraints, or another identifiable market process.

5. Defining the trade lifecycle: Entry conditions activate the claim, maintenance conditions verify that its mechanism remains present, and breakdown conditions identify when the original hypothesis has expired.

6. Separating observation from explanation: Similar chart patterns can emerge from different forces. Research must look beyond visual geometry to identify participants, incentives, liquidity constraints, venues, and transmission channels.

7. Separating idea, hypothesis, and execution: A trading idea provides intuition, the research hypothesis identifies the source of predictive value, and the execution method determines how to capture it. Each portfolio component must possess its own causal foundation.

Sample

1.92MB ∙ PDF file

Download

Download

Read more

Before you begin, remember that you have an index with the newsletter content organized by clicking below.

INDEX

From market observation to research question

The process begins with visible market behavior, but it becomes useful only when the researcher defines the phenomenon, classifies the market setting, identifies the mechanism, specifies the scope, and formulates a testable claim. Strong research moves from intuition toward measurable, comparable, and falsifiable market processes.

What’s inside:

1. Market observation. Trading ideas begin with repeated contact between price, volume, liquidity, time, events, and relative asset behavior.

2. Phenomenon classification. The researcher separates observations into single-instrument responses, delayed adjustments, event-driven reactions, and cross-sectional or relative-value behavior.

3. Reversal and continuation patterns. Price responses are studied through their lifecycle: initial pressure, dislocation, liquidity return, continuation path, or movement back toward balance.

4. Delayed adjustment. Some opportunities arise when one instrument reacts first and another follows later because of market clocks, venues, liquidity pools, or transmission delays.

5. Event-driven research. Earnings, macro releases, order-flow shocks, scheduled events, and surprise events create clean windows for studying price discovery, liquidity withdrawal, drift, dispersion, and repricing.

6. Cross-sectional and relative-value behavior. We study how dispersion, peer-group misalignment, and linked-instrument spreads reveal hidden capital migration and market friction beneath index-level returns.

7. Research question formation. A raw idea becomes research-ready when it defines the trigger, asset universe, market state, response window, expected path, and comparison benchmark.

8. Existence, conditional, and mechanism questions. Research asks whether the effect appears, when it strengthens or weakens, and why it exists through identifiable forces, transmission channels, and sustaining agents.

Sample

1.93MB ∙ PDF file

Download

Download

Read more

Before you begin, remember that you have an index with the newsletter content organized by clicking on the image below.

INDEX

Quality standards of a strong trading hypothesis

A strong trading hypothesis turns a market idea into an research object. It defines what is claimed, where the claim applies, how the effect appears in data, and how evidence improves the hypothesis over time. Precision, measurability, and falsifiability give the hypothesis structure and make the research process coherent, testable, and repeatable.

What’s inside:

1. Precision. A strong hypothesis defines the exact claim, the market setting, and the expected response.

2. Precise wording. Clear wording transforms broad ideas such as pressure, stress, momentum, or dislocation into specific market processes.

3. Precise scope. The hypothesis identifies the asset universe, market state, event type, time horizon, and environment where the effect belongs.

4. Precise outcome definition. The research defines the empirical object used to judge the effect, such as return, spread compression, rank shift, abnormal movement, path behavior, or persistence.

5. Measurability. The hypothesis enters the data through observable variables, classifiable states, and outcomes that can be scored consistently.

6. Observable variables and classifiable states. Market concepts such as crowding, hidden demand, liquidity pressure, or absorption become defensible proxies and coherent state definitions.

7. Falsifiability. The hypothesis exposes the claim to evidence by defining the conditions that weaken, contradict, or challenge the proposed mechanism.

8. Revision after contradiction. Evidence improves the hypothesis by narrowing the trigger, refining the state filter, adjusting the horizon, improving the outcome, or replacing the mechanism when needed.

Sample

1.92MB ∙ PDF file

Download

Download

Read more

Before you begin, remember that you have an index with the newsletter content organized by clicking on the image below.

INDEX

Internal anatomy of a good hypothesis

A genuine hypothesis has an internal structure. It defines when the claim begins, what market response should appear, and why that response should emerge. Its value comes from connecting activation, response, mechanism, and evidence into one coherent research object that can be tested, challenged, refined, and extended.

What’s inside:

1. Internal anatomy of a good hypothesis. The lecture presents a hypothesis as an organized structure whose parts must fit together.

2. The condition that activates the claim. A hypothesis begins by identifying the market state in which the effect should appear.

3. Trigger variable. The trigger translates pressure, dislocation, surprise, imbalance, or regime transition into a variable that can select relevant episodes.

4. State filter. The state filter places the trigger inside the right market environment.

5. Eligibility rule. The eligibility rule protects the empirical sample and decides which observations belong to the same research object by controlling for trading session, liquidity, data quality, structural breaks, and special distortions.

6. The response that defines the effect. A hypothesis must specify what should happen after activation.

7. Sign, magnitude, and timing. Sign defines direction, such as continuation, reversal, convergence, or divergence. Magnitude defines economic substance after costs and frictions. Timing defines the internal path of adjustment after the trigger appears.

8. The mechanism that explains the effect. The final part explains why the trigger should lead to the response.

Sample

1.96MB ∙ PDF file

Download

Download

Read more

Before you begin, remember that you have an index with the newsletter content organized by clicking on the image below.

INDEX

What a trading hypothesis is not

The lecture explains that charts, indicators, and backtests can all be useful, but none of them are complete hypotheses on their own. Their value appears only when they are connected to mechanism, scope, timing, variable design, and evidence, so the researcher can move from surface regularity to a claim that can be tested, challenged, and refined.

What’s inside:

1. What a trading hypothesis is not. The lecture begins by separating a genuine hypothesis from three incomplete objects (a chart pattern, an indicator, and a backtest result).

2. A chart pattern without explanatory content. A visual formation may reveal tension, compression, rupture, or recovery, but it remains only an empirical clue until the researcher explains what market process could have produced it.

3. Visual regularity without mechanism. Repeated shapes on a chart can create the impression of structure, but research begins only when those shapes are translated into participants, frictions, information, liquidity, or structural relations.

4. Repetition without causal interpretation. A pattern that appears many times does not automatically become a hypothesis. Repetition gains research value only when it is linked to a stable cause and a clear condition under which it should persist or disappear.

5. Description without research value. Statements such as “price tends to bounce after strong declines” are useful starting observations, but they need scope, variables, comparison design, and evidence criteria before they become researchable.

6. An indicator without market logic. Indicators compress data into signals, thresholds, scores, or ratios, but they matter scientifically only when they represent a real market condition such as crowding, strain, dislocation, liquidity withdrawal, or delayed adjustment.

7. A backtest result without a prior claim. A good historical result is not enough. The lecture emphasizes that a backtest should examine a claim stated in advance, rather than becoming a machine for discovering attractive performance and inventing explanations afterward.

8. The importance of forward logic. Strong research moves from observation to mechanism, from mechanism to formal claim, and from claim to evidence. This order gives meaning to both success and failure, allowing the researcher to learn from the market rather than simply collect historical artifacts.

Sample

1.9MB ∙ PDF file

Download

Download

Read more

Before you begin, remember that you have an index with the newsletter content organized by clicking on the image below.

Why a trading hypothesis?

A trading hypothesis is presented as the first scientific form of a market idea, one that transforms intuition into a structured claim with an activating condition, an expected response, a time horizon, and a proposed mechanism. The lecture develops this framework as the bridge between market logic and empirical evidence, and explains how restriction, precision, and coherence turn a vague observation into a research object that can be tested, challenged, and refined.

What’s inside:

1. Why a trading hypothesis matters. A trading hypothesis is the first formal research object in quantitative trading because it gives direction, causal meaning, and empirical consequences to an otherwise informal market observation.

2. Hypothesis as a conditional claim about market behavior. The lecture defines a genuine hypothesis as a structured conditional statement that specifies when a market condition appears, what response should follow, over what horizon, and because of what underlying process.

3. The activating condition. A hypothesis begins with a trigger that identifies when the market enters a meaningful state, such as a volatility expansion, spread dislocation, order flow imbalance, or liquidity shock, so the sample becomes selective in a principled way.

4. The expected market response. The claim must state what should happen after activation by defining the object of movement, the direction of adjustment, and the scale or relevance of that movement, so the idea acquires a clear empirical identity.

5. The horizon over which the response should emerge. Time is treated as part of the hypothesis itself because different mechanisms operate on different clocks, and the validity of the research depends on matching the response window to the real rhythm of the market process.

6. A bridge between market logic and empirical evidence. The lecture shows that a good hypothesis connects two domains at once, the logic of participants, frictions, and structural forces on one side, and the language of variables, samples, outcomes, and comparisons on the other.

7. Empirical signature and supporting evidence. A strong hypothesis does not predict profitability alone, but a specific patterned trace in the data, including direction, structure, timing, conditional strength, and comparative contrast, so support comes from alignment rather than from one backtest statistic.

8. The hypothesis as a restricted object. The lecture explains that every valid hypothesis must be restricted to a coherent asset universe, a defined market state, and a proper time horizon, because restriction is what gives the claim scientific shape and protects it from vague breadth.

Sample

1.87MB ∙ PDF file

Download

Download

Read more

Before you begin, remember that you have an index with the newsletter content organized by clicking on the image below.

INDEX

Sufficient statistics and minimal signals

This lecture defines a trading signal through sufficiency rather than through a rule, threshold, or pattern. A signal is a compression of the decision-time information set that preserves the conditional law of the declared outcome, so predictive meaning remains tied to the future law rather than to a single backtest metric. The lecture then develops minimality, bottleneck design, and representation stability as the conditions that make that compressed state usable under finite data, drift, and noise.

What’s inside:

1. Sufficiency as the definition of signal. A signal is a representation that preserves the conditional distribution of the outcome, which separates signal from strategy and makes feature relevance a property of conditional-law preservation rather than raw correlation.

2. Signal as compression with law preservation. Compression becomes signal construction when the reduced state carries the same predictive content as the full decision-time information set, which lets the system operate on a smaller and more stable representation without changing the law it conditions on.

3. Approximate sufficiency in practice. Exact sufficiency appears as the ideal case, while practical sufficiency is defined through a declared tolerance using divergence, proper-score regret, and the residual predictive content that remains outside the bottleneck.

4. Minimal sufficient sets. The lecture shows that a minimal signal is the smallest representation that still preserves the full conditional law, removes nuisance variation, lowers selection pressure, and keeps the signal portable across operators and model classes.

5. Non-uniqueness of sufficient representations. Many different representations can preserve the same predictive law, so the scientific question is whether preservation exists, while the engineering question is which representation remains most stable under noise, drift, and deployment constraints.

6. Bottleneck trade-offs. Bottleneck design becomes an information-budget problem that balances relevance against representational capacity, because too little compression increases variance and selection pressure, while too much compression removes predictive fragments the outcome still needs.

7. Overcompression and undercompression. The lecture explains that overcompression distorts the conditional law by blending distinct regimes, while undercompression creates a high-capacity overfitting surface where sharp in-sample structure often fails under recurrence and proper scoring.

8. Representation stability. A minimal signal must retain stable meaning under measurement noise, drift in state occupancy, and regime mixtures, so conditional beliefs, calibration, and divergence structure remain coherent when the signal moves from research into live deployment.

Sample

1.93MB ∙ PDF file

Download

Download

Read more

Before you begin, remember that you have an index with the newsletter content organized by clicking on the image below.

INDEX

Calibration and scoring under uncertainty

This chapter turns an inefficiency claim into a measurable probabilistic object. A model earns credibility when its output remains a truthful conditional description of the future under the same decision-time information that defines the claim. Proper scoring rules provide that bridge. They test whether probabilities, quantiles, or densities align with realized outcomes, and they do so inside the exact state regions where the strategy intends to deploy capital.

What’s inside:

1. Scoring for conditional evidence. The chapter defines prediction as a conditional statement about the future and explains why scoring must reward truthful reporting of the conditional law rather than flattering in-sample behavior.

2. Proper scoring fundamentals. It establishes the role of strict propriety and separates probabilistic description from downstream action, so learning targets the conditional mechanism itself rather than the trade rule built on top of it.

3. Log score and likelihood geometry. Full conditional densities are evaluated through log score, which measures how much probability mass the model assigns to realized outcomes and turns distributional mismatch into an empirical cost.

4. Brier score and probability geometry. Binary event probabilities are scored through squared probability error, which makes calibration visible and tests whether reported event likelihoods match realized frequencies.

5. Pinball loss and quantile geometry. Conditional quantile boundaries are evaluated through asymmetric loss that checks whether reported boundaries retain the correct crossing behavior under the declared state and horizon.

6. Calibration under state selection. The chapter shows why a model can look acceptable on pooled data while failing in the narrow states where capital is actually deployed, so calibration must be checked on the same conditional sample that drives execution.

7. Conditional calibration. Local inefficiency claims require local validation, so probabilities and quantiles must retain their interpretation inside the same state regions where divergence suggests conditional structure.

8. Miscalibration as false inefficiency. The chapter explains how overconfident outputs can manufacture the illusion of edge when threshold-based decision rules amplify extreme signals that lack stable probabilistic meaning.

9. Decision-aware scoring. Evaluation is aligned with the architecture of risk, exposure, and constraints, so errors matter most where the portfolio carries the highest operational sensitivity.

Sample

1.94MB ∙ PDF file

Download

Download

Read more

Before you begin, remember that you have an index with the newsletter content organized by clicking on the image below.

INDEX

Local predictability via divergence

This chapter treats an inefficiency claim as a statement about distributional separation. Fix an outcome variable R and a horizon at which R is measured. The future becomes the probability law of R at decision time. The object of interest is the gap between the baseline future and the state-conditioned future, where X is a declared state variable. A divergence measures this gap by quantifying how much the predictive law of R changes when we move from “no state” to “state x,” and it keeps the research claim separate from the execution layer that turns structure into PnL.

What’s inside:

1. What divergence is for in trading research. Divergence serves as a dependence detector that lives in conditional laws, so the claim stays tied to how the future distribution changes across states.

2. Scope and limits of divergence. The chapter draws a boundary between divergence evidence and realized profit, and it frames the inefficiency claim inside a declared horizon, state region, and environment class.

3. Local divergence maps. The workflow treats R and X as design objects, then compares P(R|X≈x) to P(R) across state domains to build a field of separations over the state space.

4. Local inefficiency domains. A local inefficiency corresponds to a state domain that supports a stable statement across repeated visits, with an activation domain and a transition zone where the conditional law returns toward the baseline mixture.

5. Tail divergences. The chapter introduces tail-focused separation to target structure that lives inside extremes, where distributional shape changes matter most for constraint-relevant outcomes.

6. Divergence stability under perturbation. Evidence is checked under perturbations of the measurement lens (domain rules, estimation choices) and recomputed on held-out path segments to verify persistence.

7. Predictability has geometry. The chapter treats predictability as a geometric object with locality, boundaries, and transitions, so the research claim becomes measurable along the market’s movement through state regions.

Sample

2MB ∙ PDF file

Download

Download

Read more

Before you begin, remember that you have an index with the newsletter content organized by clicking on the image below.

INDEX

Mutual information as evidence of structure

This chapter treats quantitative trading research as a sequence of testable dependence claims, not as an automatic story about why markets move. The goal is to separate what the data actually supports—a conditional advantage linking X to R—from what remains underdetermined—any single structural narrative we might want to attach to it. The workflow moves from defining what it means to have information, to checking that claim against what exists in raw data, to identifying when structure appears (state conditions S), and finally to compressing the feature set without introducing leakage or manufacturing evidence through selection.

What’s inside:

1. What mutual information is for in trading research. Mutual information is used to detect and quantify dependence without committing to a particular functional form.

2. Separating dependence from functional form. Different decision rules can exploit the same underlying dependence. Dependence is the object; the specific rule is only a vehicle.

3. Quantifying the strategy’s implied information. Realized performance can be read as an information claim per decision.

4. Orthogonality to utility. Dependence is not monetization. A pattern can be real and still fail to generate PnL under a given execution scheme.

5. Dependence is the object, not the model. This reverses the usual pipeline where a backtest creates belief and justification is constructed afterward.

6. Information is not edge. The section distinguishes layers: (i) existence of dependence, (ii) robustness under refuters, (iii) translation into executable edge.

7. Incremental information. The practical question is whether X adds anything beyond a baseline information set Z that is already available, already priced, or already captured by your stack.

8. Conditional dependence, sample size, and non-circular boundaries. Dependence is not uniform; it often concentrates when the market enters a configuration S.

9. Why feature sets behave differently than single features. Weak variables can become informative in combination (gating/synergy), and apparently strong variables can become redundant once others are known.

10. Dependence can move across time scales. A pattern can exist at one horizon and disappear at another, or shift with regime.

11. The smallest information set that preserves structure. Compression is an active process: reduce while verifying that the evidence you care about remains intact and that the compression introduces no leakage.

12. Mutual information is a target, not a number you trust by default. I(X;R) depends on estimation choices, regularization, and temporal dependence.

Check a sample of what you will find inside:

Sample

1.88MB ∙ PDF file

Download

Download

Read more

Before you begin, remember that you have an index with the newsletter content organized by clicking on the image below.

INDEX

When evidence has many explanations

This chapter reframes a trading result as an evidence-backed prediction claim, not as an automatic explanation of why markets move. The goal is to separate what the data supports (a conditional advantage) from what remains underdetermined (a single structural story). The workflow moves from stating the claim, to testing it under refuters, to writing conclusions that match the limits imposed by partial observability, finite samples, and market adaptation.

What’s inside:

1. Prediction is not explanation. A backtest can validate a mapping from information to outcomes without validating the narrative used to motivate it.

2. Predictive equivalence. Different model forms can produce the same predictive distribution and the same trading decisions.

3. Non-uniqueness of latent structure. Hidden regimes, factors, and state sequences admit multiple equivalent representations.

4. Non-uniqueness under misspecification. In finance, parameters often act as compensators for structural gaps.

5. Identical scores, different failure modes. Scalar metrics compress behavior into one number and create large equivalence classes.

6. Partial observability and the hidden state. Public data provides a compressed view of market state.

7. Leakage as false observability. Small violations of decision-time causality can create apparent structure and strong backtests.

8. Noise, finite samples, and adaptation limits. Measurement error, sampling variation, and approximation error shrink observable information. Small effects remain hard to resolve, rare-state effects create sample starvation, and adaptive markets shift conditional relationships.

Check a sample of what you will find inside:

Sample

1.85MB ∙ PDF file

Download

Download

Read more

Before you begin, remember that you have an index with the newsletter content organized by clicking on the image below.

INDEX

Inefficiency as an Information Claim

This chapter reframes market inefficiency as a falsifiable information claim: observing X must change the law of a future outcome R. The goal is to separate what is informationally true (structure in conditional laws) from what is merely tradable (edge after constraints). The workflow goes from defining the claim to testing it against strong nulls, and only then deciding whether it deserves execution and portfolio complexity.

What’s inside:

1. Regression-free bedrock: Why research must begin by defining the object of the claim—not by proposing entries, sizing rules, or backtests.

2. Prior vs posterior: The core statement: seeing X changes the distribution of R. A signal is any law shift, not just a higher average return.

3. Predictability as conditional advantage: Predictive value means improvement versus a declared baseline, under a declared scoring rule—not vibes, not anecdotes.

4. Mean vs distributional predictability: Mean-shift, quantile-shift, and tail-shift claims—and why they are not interchangeable in trading research.

5. Horizon is part of the claim: The time scale is not a tuning knob: it changes the data-generating process, the noise floor, and what constraints dominate.

6. Three non-equivalent propositions: Information can exist yet be unextractable, or be extractable but still fail to become edge once constraints are applied.

7. Falsifiability in information space: Refuters via sign/block/label permutations, invariance checks across regimes and universes, and “null-compressibility” tests.

8. The claim template: A strict tuple that locks the hypothesis before evidence is examined—and a clear statement of what this framework intentionally does not do.

Check a sample of what you will find inside:

Sample

1.91MB ∙ PDF file

Download

Download

Read more

Before you begin, remember that you have an index with the newsletter content organized by clicking on the image below.

INDEX

Strategy evaluation & statistical validation

This chapter turns performance measurement into a falsification engine. Instead of staring at a single Sharpe Ratio, you’ll dissect every layer of a strategy: trade-by-trade behaviour, path dependency, benchmark-relative risk, tail losses, and the probability that an apparent edge survives both non-normal returns and selection bias. The workflow runs from simple trade-level ratios to benchmark metrics, tail- and drawdown-risk measures, block-bootstrap resampling, purged / embargoed cross-validation and walk-forward analysis—ending in probabilistic tests like PSR, DSR and CPCV that charge you for every backtest you’ve ever run.

What’s inside:

1. Event-based diagnostics. Open the black box of trades: move from smoothed portfolio returns to the discrete sequence of wins and losses that actually generates P&L, and use this to check whether the data matches your narrative about the strategy.

2. Core profitability ratios. Use Profit Factor, Awal Ratio (Average Win / Average Loss), and Win Rate to characterise the payoff profile—high-probability nickel-picking vs low-hit-rate trend following—and to see whether total gains truly dominate total losses.

3. Expectancy engine. Build the expectancy identity linking Win%, Avg Win and Avg Loss; compute per-trade expectancy and the implied break-even win rate so you can tell whether a broken system needs better signals, better payoffs, or both.

4. Economic vs statistical expectancy. Translate statistical edge into economic edge by subtracting commissions, fees and slippage—showing when a “significant” backtest is still worthless once real-world frictions are included.

5. Path, risk & duration profile. Connect the trade engine to the equity curve via Rina Index, trade-level volatility, holding periods for winners vs losers, streak lengths and time-under-water—metrics that capture both variance drag and psychological pain.

6. Benchmark comparison metrics. Evaluate performance in context using the Information Ratio (alpha per unit of tracking error) and Treynor Ratio (excess return per unit of beta) to judge whether a strategy deserves capital next to simple benchmark exposure.

7. Distribution- and tail-risk ratios. Go beyond volatility with the Omega Ratio, Value-at-Risk, Conditional VaR and Calmar/MAR ratios, including coherent CVaR-based alternatives and drawdown-focused metrics that separate genuine tail risk from one-path anecdotes.

8. Probabilistic Sharpe Ratio (PSR). Replace “Sharpe = 1.4” with “There’s an X% probability the true Sharpe exceeds SR*,” using skewness- and kurtosis-adjusted standard errors to penalise negative skew and fat tails.

9. Deflated Sharpe Ratio (DSR). Pay a statistical price for data mining: estimate the Sharpe you’d get from the luckiest of N random trials and use it as the hurdle inside PSR, yielding the probability that your best backtest survives multiple-testing and selection bias.

10. Resampling for dependent returns. Fix IID bootstrap myths by using moving, circular and stationary block bootstraps that respect autocorrelation and clustered P&L; build empirical distributions and asymmetric confidence intervals for Sharpe, max drawdown and path-shape metrics, plus randomisation and block sign-flip tests for streaks and equity curves.

11. Purged & embargoed cross-validation (CPCV). See why standard K-fold fails on time series, then use label purging and temporal embargo to break leakage; scale up to Combinatorial Purged CV to approximate the full distribution of out-of-sample error and turn “one equity curve” into a family of realistic futures.

12. Walk-Forward Analysis (WFA). Design rolling train/validate/test schedules with sliding or expanding windows, track parameter drift and regime-dependent configurations, and stitch OOS slices into a single equity curve—then compare WFA vs CPCV in terms of bias, variance and computational cost to decide which gatekeeper guards your production capital.

Sample

658KB ∙ PDF file

Download

Download

Read more

Before you begin, remember that you have an index with the newsletter content organized by clicking on the image below.

INDEX

Alpha & Factor Decomposition

This chapter frames factor analysis as a decision tool: use regression to separate true edge (α) from systematic risk premia (β), diagnose hidden exposures, and turn findings into concrete hedges and portfolio rules. The workflow runs from simple/ multiple regression foundations to multi-factor models, statistical significance of α, rolling diagnostics, and implementation.

What’s inside:

1. Regression bedrock. Simple OLS, estimator properties, and how to form CIs for slope/intercept, mean response, and prediction intervals.

2. From one factor to many. Build multi-factor regressions to explain returns with partial betas.

3. Isolating true alpha. Regress excess returns on factors; the intercept (α) is the skill component.

4. Hidden risk exposures. Find “beta leaks,” factor crowding, sector concentration, liquidity sensitivity, and style drift via rolling betas and CIs.

5. Actionable applications. Neutralize unintended betas with minimum-variance hedges; construct factor-neutral, residual-Sharpe-oriented blends and keep betas in check over time.

6. Model adequacy & transforms. Residual checks, R2 and transformations (log/Box-Cox) to stabilize variance and linearize relations.

7. Multiple Linear Regression (MLR). Extend to many predictors; diagnostics for influential points, polynomial terms, and the dummy-variable trap.

8. Risk-aware inference. Use mean-response CIs vs. wider prediction intervals for trading decisions (stops/targets/position sizing) and report robust stats alongside fit.

Again, I have decided to devide this chapter in several parts because it’s pretty long.

Check a sample of what you will find inside:

Chapter Sample

747KB ∙ PDF file

Download

Download

Read more

Before you begin, remember that you have an index with the newsletter content organized by clicking on the image below.

INDEX

Statistical Tests for Trading Systems

This chapter turns strategy evaluation into a decision process: a toolkit that separates repeatable edge from noise and diagnoses how a strategy makes money, how much risk it takes, and which market dependencies it exploits. It moves beyond eyeballing equity curves to falsifiable tests with clear hypotheses and interpretable outcomes.

What’s inside:

1. Profitability & consistency (central tendency). Robust t-tests for mean return alongside the Wilcoxon Signed-Rank to detect period-by-period consistency vs. outlier-driven gains—yielding diagnostic profiles like “lottery ticket,” “insurance seller,” “gold standard,” or “no edge.”

2. Risk targeting (single-variance χ² test). A formal check that realized variance meets a risk cap/target—and why normal-return assumptions make the classic χ² fragile under fat tails.

3. Distributional fit (GoF). K–S, Lilliefors, and χ² GoF tests to validate return-distribution assumptions; pros/cons including tail sensitivity and binning pitfalls.

4. Comparing strategies/regimes: means. Tests for difference in means across strategies or periods and a paired t-test for before-and-after changes.

5. Comparing strategies/regimes: variances. F-tests for the ratio of two variances to assess volatility changes across approaches or regimes.

6. Dependence in returns. Serial-correlation tests to detect trend-following or mean-reversion footprints.

7. Long-run relations. Cointegration tests to uncover equilibrium links for pairs/spread trading.

8. Categorical structure. Contingency-table for relationships between discrete states (e.g., regimes, events) and outcomes.

Check a sample of what you will find inside:

Sample Chapter

713KB ∙ PDF file

Download

Download

Read more

Before you begin, remember that you have an index with the newsletter content organized by clicking on the image below.

INDEX

The Hypothesis-Testing Framework

This chapter turns estimation into a decision process: from a single backtest path to a formal, falsifiable test that separates repeatable edge from noise and supports real capital decisions. It adopts a skeptical starting point (“no edge”) and advances with robust test statistics, defensible p-values/alphas, confidence-interval thinking, and explicit power analysis.

What’s inside:

1. From estimation to decision. Why measuring uncertainty (point & interval estimates) isn’t enough—and how hypothesis testing supplies the courtroom-style procedure for a go/no-go verdict.

2. Defining the claims. How to state precise null vs. alternative hypotheses for traders: mean excess return, Sharpe, regression alpha, correlations, and model comparisons (including costs via “µ ≤ friction”).

3. Test statistics done right. Distilling performance into “signal ÷ noise,” using HAC/Newey–West errors and joint tests (F-tests) when factors are assessed together.

4. From numbers to evidence. Mapping a test statistic to a p-value and choosing α as a business threshold; what p-values are—and aren’t.

5. Intervals as decisions. Duality between tests and confidence intervals; using bootstrap CIs (e.g., Sharpe) and deciding on the lower bound vs. a cost-aware hurdle.

6. Errors and power. Type I (false edge) vs. Type II (missed edge), their costs, and the levers that set statistical power: α, effect size, variance, and sample size.

7. Backtest length trade-off. Long samples boost power but threaten stationarity; short samples fit regime but risk underpowered conclusions—plus ways to balance the tension.

8. Advanced testing via Likelihood Ratio. A general, nested-model framework (with χ² reference) to test structural breaks, factor redundancy, and justified model complexity.

A disciplined path from “looks good” to statistically defensible—and economically relevant—deployment decisions.

Check a sample of what you will find inside:

Chapter Sample

676KB ∙ PDF file

Download

Download

Read more

Before you begin, remember that you have an index with the newsletter content organized by clicking on the image below.

INDEX

Estimation and Quantifying Performance

This chapter shifts from describing data to extracting knowledge from it. The focus is on estimation—building point values, intervals, and diagnostics that quantify the strength of a trading edge while accounting for noise, dependence, and structural breaks. Rather than treating a backtest as deterministic, we reframe it as one draw from an uncertain process. The tools covered here help separate true skill from random variation, ensure reported metrics are statistically defensible.

What’s inside:

1. From backtest to inference: Why a single equity curve is just one draw from a process, and how sampling distributions let you separate edge from luck. Learn the two trader takeaways: quantify uncertainty and do it correctly for time-series data.

2. Uncertainty that respects dependence: Practical fixes for serial correlation and heteroskedasticity—effective sample size intuition, Newey–West (HAC) standard errors, and block bootstrap resampling for robust standard errors and CIs.

3. Point-estimation toolbox: Method of Moments (with a scaled-Beta daily-range example), Least Squares (factor exposure, hedge ratios, alpha testing), and GMM moment-condition thinking used across empirical asset pricing.

4. Interval estimation that matters to traders: Build intervals for the strategy mean, risk-adjusted metrics (e.g., Sharpe with Lo’s autocorrelation-aware annualization), and interpret uncertainty in drawdowns.

5. Estimator properties under market stress: Move beyond textbook bias/variance—contrast MSE vs. MAE for outlier-heavy data, use asymmetric (quantile/pinball) loss when under- vs over-prediction costs differ.

6. Robust distributional characterization: L-moments (location, scale, skew, kurtosis) as outlier-resistant summaries of returns, with clear Python to compute them from scratch.

7. Operational diagnostics & governance: Rolling and EW error monitoring, simple CUSUM break detection, and bootstrap CIs for Lo-corrected Sharpe—turning statistics into live risk controls and de-risking triggers.

Check a sample of what you will find inside:

Chapter Sample

700KB ∙ PDF file

Download

Download

Read more

Before you begin, remember that you have an index with the newsletter content organized by clicking on the image below.

INDEX

Data Types, Structures, and Preliminary Analysis

This chapter distinguishes between what is being measured (data types) and how it’s organized in memory (data structures), guiding researchers through a systematic exploration to ensure integrity, prevent hidden biases, and lay the groundwork for robust, reproducible models.

What’s inside:

1. Core data types and structures: Explore the fundamental classifications of data as either univariate or multivariate and as quantitative or categorical. Learn the three primary data structures in finance: time-series , cross-sectional , and panel data.

2. Specialized financial data: Discover the specific types of data used in algorithmic trading, from traditional market data (tick and OHLCV) and fundamental data to derived features and modern alternative data sources.

3. Statistical data organization: Understand the computational structures used to hold and manipulate data for analysis. This includes high-performance arrays and matrices , versatile and context-rich DataFrames , specialized time-series objects , and hierarchical structures for complex panel data.

4. Data quality and auditing: Treat data as a product of a complex manufacturing process that requires forensic auditing. Learn to establish data governance policies , conduct independent reanalysis to find subtle flaws , and guard against structural data contamination like lookahead bias.

5. Data screening and preparation: Understand the initial analytical assessment of a dataset's characteristics. This involves investigating data pedigree , using robust summary statistics to find outliers , analyzing patterns of missing data , and addressing multicollinearity between predictor variables.

6. Graphical and tabular analysis: Employ a continuous visual dialogue with the data using a wide array of plots—from histograms and scatter plots to network graphs—to build intuition and diagnose models. Use the precision of tabular analysis to dissect multidimensional relationships, test for data sparsity, and present results with clarity.

7. Advanced measurement concepts: Delve into the challenges of using data from complex systems, where the data itself is the output of a model. Understand the role of unobservable latent variables (e.g., "market sentiment") and learn to model different types of measurement error that can bias backtested results.

Check a sample of what you will find inside:

Chapter Sample

572KB ∙ PDF file

Download

Download

Read more