…

Before you begin, remember that you have an index with the newsletter content organized by clicking below.

INDEX

From macroeconomic releases to executable trading signals

Macroeconomic event trading depends on the information available when a decision is made and the price movement still accessible after execution. Using economic calendars, forecast surprises, macroeconomic state factors, and central bank communications, this framework connects incoming news to conditional return forecasts and feasible positions.

What’s inside:

1. Risks and limitations: Examines sparse release histories, changing policy regimes, unreliable liquidity, and text-processing errors. Explains why statistical regularization cannot replace independent evidence, and how feed interruptions, imperfect timestamps, and optimistic execution assumptions can undermine an otherwise coherent research framework.

2. The information clock: Separates economic reference periods, publication, data receipt, feature completion, decisions, and fills. Covers calendar snapshots, forecasts frozen before publication, and field-level availability to reconstruct what a strategy could know at each decision point.

3. Economic levels versus forecast surprises: Distinguishes the economic state, deviations from consensus, internal-model innovations, revisions, and forecaster disagreement. Shows why an indicator can improve while disappointing expectations, and why substituting a previous observation for a missing forecast changes the signal being tested.

4. Daily macroeconomic states: Combines asynchronous activity, employment, and inflation releases into continuously available factors using recursively estimated principal components. Addresses historical scaling, changing indicator coverage, and factor-update attribution, while explaining why repeated daily values do not create additional independent observations.

5. Information age and uncertainty: Models how uncertainty grows between releases and contracts when new observations arrive. Separates publication age from the age of the measured economic period, compares state-space updates with age-weighted composites, and distinguishes uncertainty about economic conditions from asset-return volatility.

6. Joint releases and incremental news: Treats payrolls, unemployment, wages, and revisions as related components of a release package. Uses covariance shrinkage, multivariate surprise measures, and conditional residuals to assess unusual combinations and incremental information, while preserving the timing and historical versions of each component.

7. Policy narratives and text versions: Incorporates central bank statements and news through separate growth, employment, inflation, and policy-stance scores. Tracks document revisions, duplicate passages, model versions, and processing times so repeated reporting does not inflate the evidence and later interpretations do not enter earlier decisions.

8. Conditional forecasts and position sizing: Models how the same surprise can produce different price responses across economic environments and holding horizons. Combines surprises, the pre-release state, and selected regularized interactions, then sizes exposure using expected costs, return risk, model uncertainty, and market impact.

9. Execution and achievable returns: Measures performance from attainable fills and calculates cash results using executable bid and ask prices. Covers latency, spread widening, slippage, financing, partial fills, and broker constraints, including situations where minimum contract sizes make zero exposure the appropriate allocation.

10. Chronological validation: Builds training samples from fully observed outcomes, removes overlapping labels, and keeps related release components together. Uses chronological model selection, simple benchmarks, and portfolio accounting to assess whether additional complexity improves unseen forecasts and net returns within available capital.

Sample

2.08MB ∙ PDF file

Download

Download

Read more

Before you begin, remember that you have an index with the newsletter content organized by clicking below.

INDEX

From a core hypothesis to research framework

To begin with, quantitative trading research develops through related hypotheses organized around a shared economic mechanism. Following this concept, a hypothesis family defines the central claim and its expected market signature, adds supporting predictions, and narrows the idea into testable formulations. Furthermore, specification variants examine how the same mechanism appears across different market states, response measures, and samples. In fact, researchers assess whether the evidence remains coherent while identifying the conditions under which the proposed effect strengthens, weakens, or disappears.

What’s inside:

1. Defining the core hypothesis: The researcher specifies what should happen, why it should happen, and which observable footprint should appear in prices, order flow, and temporal dynamics. This foundation anchors every subsequent refinement and test.

2. Building auxiliary hypotheses: Supporting predictions define where the effect should be strongest, how it should unfold and decay, and which intermediate market traces should accompany the proposed mechanism. These predictions give the core claim additional diagnostic depth.

3. Organizing nested hypotheses: Broad, intermediate, and narrow claims connect a general economic explanation to asset groups, market regimes, and precise trading rules. Each level preserves the mechanism while clarifying the boundaries of its applicability.

4. Testing alternative state definitions: Volatility, liquidity, and event-based rules provide different representations of the operating environment. Comparing them reveals whether the expected signature persists across plausible definitions or depends on particular market conditions.

5. Testing alternative response definitions: Mean returns, distributional features, and price paths capture different aspects of the same effect. Direction, tails, skewness, dispersion, adjustment speed, excursions, and decay help assess whether observed behavior matches the proposed mechanism.

6. Testing alternative sample definitions: Broad, theoretically filtered, and mechanism-pure samples examine the balance between generality and signal clarity. These comparisons assess portability, isolate the mechanism’s expected operating conditions, and show how its signature changes in broader, noisier data.

7. Interpreting evidence across specifications: Comparing direction, strength, and internal structure helps assess support for the hypothesis family. Coherent signature can survive changes in magnitude, while divergences help identify specification dependence, refine the claim’s boundaries, or reject unsupported explanations.

Sample

1.81MB ∙ PDF file

Download

Download

Read more

START WITH BOOKS

In this episode of House of Quants, listeners will discover:

1. The trading clock defines the opportunity: One company reports bad earnings on Monday, the signal becomes available on Wednesday, and the strategy enters on Thursday. The episode walks through that sequence to show where the actual trading opportunity begins. Earlier price movements help build the signal, while the strategy earns its return from what happens after execution.

2. Genuine alpha is what remains after exposures and costs: Think of a stock that rises five percent after an encouraging announcement. Part of that move may come from the market, its sector, or a broader rally in small caps. The discussion explains how researchers separate those exposures and subtract borrowing fees, financing, spreads, slippage, and market impact to identify the return attributable to the event.

3. Institutional decisions and mandatory flows create delayed adjustments: Analysts revise their models, committees debate the conclusions, and portfolio managers gradually act on those decisions. That process can spread the market’s response across days or weeks. Spinoffs introduce another mechanism, funds sell distributed shares to comply with their mandates, creating concentrated selling pressure that other investors may absorb in exchange for a potential liquidity premium.

4. Each event has its own economic mechanism and trading phases: A buyback authorization gives a company permission to repurchase shares, while actual purchases create executed demand. Equity issuance takes on a different meaning depending on whether it finances expansion or addresses financial distress. Index rebalancing adds another layer, with separate opportunities and risks in pre-event positioning, liquidity provision at the closing auction, and post-event mean reversion.

5. Macroeconomic releases put execution speed at the center of the trade: Around inflation reports, GDP releases, and employment figures, the opportunity can shrink to a fraction of a second. The episode explores how network latency and order arrival determine the price a strategy can capture. In this setting, profitability depends on translating the information into an executed position while the opportunity remains available.

6. Merger arbitrage connects the spread to completion risk, downside, and time: Take a stock trading at $48 after a $50 cash acquisition offer. In the episode’s example, completion delivers a $2 gross gain, while failure sends the stock back to $40 and produces an $8 loss. That asymmetry puts regulatory approvals, financing conditions, and the expected closing date at the heart of the analysis.

7. A short position depends on both the signal and the ability to maintain the trade: Borrowing fees consume part of the expected return, and share availability determines whether the position can remain open. So a lender’s recall can force the trader to buy back shares, while simultaneous covering by several short sellers can create intense upward pressure. The discussion brings these mechanics together to show how implementation shapes the final outcome of an event-driven strategy.

TRADING PLATFORM

Before you begin, remember that you have an index with the newsletter content organized by clicking below.

INDEX

From corporate catalysts to tradable event-driven alpha

Event-driven alpha depends on the return still available after a signal becomes observable and a trade executes. Using earnings surprises, pre-event momentum, and contrarian retail order flow, this framework separates historical event patterns from forward-looking forecasts and executable portfolios. The emphasis is on information timing, and incremental predictive value.

What’s inside:

1. What event-driven alpha means: Separates gross event returns from alpha by accounting for systematic exposures and execution costs. Explains why post-earnings drift, deal-completion risk, and mandatory index flows represent different economic opportunities rather than variations of one universal trading rule.

2. Risks and limitations: Examines the trade-off between waiting for clearer signals and losing the remaining opportunity. Covers noisy retail classification, clustered announcements, and specification search, alongside borrow fees, illiquidity, and short squeezes that can undermine attractive historical patterns.

3. Methods for extracting event-driven alpha: Reviews earnings drift, mergers, buybacks and issuance, spin-offs, restructurings, index changes, and macroeconomic releases. Connects each catalyst family to its own economic mechanism, modeling approach, and execution constraints, from continuous price adjustment to binary transaction outcomes and scheduled liquidity demand.

4. From hypothesis to trading rules: Turns a catalyst into an auditable signal by fixing the observation cutoff and attainable entry before testing thresholds. Requires retail flow to improve forecasts beyond earnings surprise, momentum, and the initial price reaction under comparable universe rules, trading costs, and execution assumptions.

5. Earnings news and conditional opportunities: Combines earnings surprise, prior momentum, and retail response to isolate specific post-announcement states. Historical patterns among prior losers with bad earnings and heavy retail buying motivate a short-focused hypothesis, while the weaker long-side evidence requires independent validation rather than assumed symmetry.

6. The information clock: Aligns observation, execution, and return measurement to prevent crediting the strategy with unavailable gains. The daily example observes flow through day +1, enters at the day +2 close, and exits on day +22, producing twenty daily return observations—not a fresh twenty-two-session holding period.

7. Early signals and predictive models: Demonstrates how completed-window retail flow can absorb information from the outcome being predicted. One synthetic example illustrates this leakage, while fixed quintile rules and compact interaction models provide alternative ways to express the early-flow hypothesis without treating retrospective classifications as executable signals.

Sample

3.61MB ∙ PDF file

Download

Download

Read more

Before you begin, remember that you have an index with the newsletter content organized by clicking below.

INDEX

From trading signals to deployable quantitative strategies

Diary of a Quant – Notebook II presents a broad collection of methods for turning quantitative trading concepts into strategies. It moves from statistical arbitrage and relative value through microstructure, cross-sectional signals, directional trading, and finally portfolio construction, hedging, leverage, drawdown control, and capacity. The emphasis is on testing whether they remain viable after execution costs, liquidity, changing regimes, and portfolio constraints are introduced.

What’s inside:

1. Building statistical arbitrage and relative-value strategies: Nonlinear cointegration, synthetic-control baskets, functional data analysis, SINDy dynamics, survival models, latent clustering, lead–lag transmission, and event-gated residuals provide alternative ways to identify and trade temporary dislocations while monitoring whether the relationship remains stable.

2. Modeling microstructure, liquidity, and execution: Order-flow normalization, Level-2 imbalance, fill probabilities, execution-cost shifts, reinforcement-learning execution, VWAP/TWAP switching, passive-order management, venue selection, and post-trade markouts connect theoretical alpha with the mechanics of getting trades filled.

3. Trading volatility and market structure: Variance, skew, VIX structure, overnight gaps, dealer gamma, and volatility-regime effects are used to formulate strategies around option-implied information, convexity, crash behavior, and changes in the market’s volatility state.

4. Exploiting cross-sectional, corporate-event, and crowding effects: ETF flows, index reconstitutions, short interest, squeeze risk, earnings drift, analyst revisions, buybacks, insider activity, seasonality, residual momentum, and turnover-aware momentum transform stock-specific information into market- and sector-controlled portfolios.

5. Designing trend, breakout, futures, and macro signals: Volume-node acceptance, liquidity vacuums, range compression, failed gaps, market breadth, carry–momentum interactions, volatility-confirmed breakouts, policy pressure, and inventory conditions provide systematic ways to distinguish persistent directional moves from false breaks.

6. Constructing portfolios and controlling risk dynamically: Pareto optimization, factor neutrality, inverse-volatility sizing, risk parity, correlation stress, volatility targeting, drawdown-based leverage, regime allocation, hedge baskets, hierarchical clustering, and diversification methods determine how individual signals should be combined and scaled.

7. Accounting for robustness, costs, and capacity: Liquidity matching, covariance instability, capacity-aware allocation, drawdown parity, transaction costs, slippage, financing, and position limits force promising backtests to confront the constraints of live deployment. Each method is intended as a research building block whose assumptions and parameters must be estimated and validated for the specific market and trading horizon.

Physical Book

Sample

417KB ∙ PDF file

Download

Download

Read more

Before you begin, remember that you have an index with the newsletter content organized by clicking below.

INDEX

From market intuition to testable quantitative research

Diary of a Quant — Notebook I presents 100 compact mathematical methods for transforming trading ideas into measurable research specifications. It covers robust estimation, dependence, portfolio construction, information geometry, regime detection, machine learning, and empirical validation. Each entry connects the mathematics to a practical research decision, exposing the assumptions and constraints required to code, compare, test, reject, or refine an idea.

What’s inside:

1. Stabilizing covariance and precision estimates: Robust estimators, shrinkage, factor models, random-matrix cleaning, structured priors, and geometric techniques reduce estimation noise and prevent unstable covariance matrices from distorting hedges and portfolios.

2. Measuring dependence beyond correlation: Copulas, tail co-movement, partial-correlation networks, mutual information, HSIC, and distributional distances reveal relationships that conventional linear correlation may fail to detect.

3. Allocating capital under uncertainty: Regularized optimization, risk parity, volatility targeting, factor-neutral projection, bootstrap diagnostics, and distribution-based risk budgets produce allocations that are more stable and interpretable.

4. Using information geometry and entropy: Fisher–Rao distance, Bregman projections, geodesics, divergence measures, entropy constraints, and manifold methods describe how market distributions evolve, separate, and deteriorate through time.

5. Detecting regimes and monitoring edge decay: State-conditioned models, entropy rates, sequential likelihood ratios, optimal transport, and geometric stopping rules identify structural changes and determine when an existing signal is no longer reliable.

6. Applying machine learning to market structure: Self-supervised embeddings, contrastive learning, neural SDEs, normalizing flows, adversarial training, domain adaptation, and contextual bandits model complex relationships while accounting for changing environments.

7. Validating and operationalizing research: Off-policy evaluation, doubly robust estimation, knockoff filters, block-permutation tests, structural simplicity, and execution-aware design help distinguish genuine predictive value from overfitting and convert promising formulations into testable strategies.

Physical Book

Sample

446KB ∙ PDF file

Download

Download

Read more

Before you begin, remember that you have an index with the newsletter content organized by clicking below.

INDEX

From model estimation to production-ready feature sets

Embedded feature selection integrates variable selection into model training. Rather than ranking inputs beforehand or testing separate subsets, embedded methods decide which features survive while estimating coefficients, decision boundaries, tree structures, or stochastic gates. This connects feature selection to the model’s actual objective while controlling redundancy, instability, and implementation frictions.

What’s inside:

1. Lasso regression: Produces compact linear models by shrinking weak coefficients to zero. Its simplicity makes the selected support easy to interpret, although strongly correlated predictors can lead to unstable winner-takes-all choices.

2. Elastic Net: Combines sparse selection with ridge-style stabilization, allowing groups of correlated predictors to remain in the model. This makes it better suited to feature libraries containing similar signals across multiple horizons or transformations.

3. Group and sparse-group Lasso: Selects economically related feature families together while preserving sparsity within each family. The approach aligns model structure with predefined groups such as momentum, volatility, or event-driven variables.

4. Penalized Logistic regression: Selects inputs according to their contribution to a regularized probabilistic decision boundary. Its usefulness depends on aligning probability calibration with the confidence thresholds and asymmetric costs used during execution.

5. Sparse Support Vector Machines: Combines margin-based classification with coefficient sparsity, retaining variables that help separate classes. Feature survival depends on observations near the decision boundary rather than on overall fit alone.

6. Tree-induced feature selection: Builds nonlinear and conditional support through split selection, depth restrictions, minimum leaf sizes, and pruning. Out-of-sample permutation tests are needed because impurity-based importance can favor noisy variables with many possible split points.

7. SCAD and MCP: Apply nonconvex penalties that preserve sparsity while reducing the excessive shrinkage imposed on large coefficients by Lasso. They can recover stronger signals with less bias, but introduce initialization sensitivity and more difficult optimization.

8. Stochastic feature gates: Learn probabilistic switches that approximate an explicit feature budget inside differentiable models. They support nonlinear interactions and operational constraints, but require stable gate selection and deterministic deployment rules.

Subscribe now

Sample

675KB ∙ PDF file

Download

Download

Feature Selection Embedded Methods

1.14MB ∙ PDF file

Download

Download

Before you begin, remember that you have an index with the newsletter content organized by clicking below.

INDEX

What changed this month

From now on, I will regularly share the evolution of two systematic portfolios built around very different market behaviours. Rather than focusing on individual securities in the commentary, each update will concentrate on the portfolio process, its current state and how the strategy is behaving over time.

The accompanying reports will show the latest performance, drawdowns, positioning, signals, and scheduled actions.

Short-term mean reversion

The first system is a short-term mean-reversion strategy designed to capture temporary price dislocations. After each completed market session, the model reviews its eligible universe and applies a series of market-quality filters before considering a new opportunity.

Rather than entering immediately, the strategy waits for price to move sufficiently below the signal close. The required entry level is determined relative to recent volatility, allowing the definition of a meaningful short-term dislocation to adapt to changing market conditions.

Monthly momentum rotation

The second portfolio follows a slower-moving momentum approach designed to capture persistent relative strength. The portfolio is reviewed monthly. Eligible securities must remain above their long-term trend and rank among the strongest positive-momentum candidates in the investment universe.

Portfolio weights are then adjusted through a volatility-targeting framework, allowing overall exposure to respond to changing market conditions rather than remaining permanently fixed. Positions are maintained until the next scheduled rebalance changes the allocation or the broader market regime shifts away from risk exposure.

Together, the two reports provide a complete view of how the portfolios are behaving across different market conditions. Momentum seeks to remain exposed to persistent relative strength, while mean reversion looks for shorter-term dislocations within a filtered Nasdaq universe.

Portfolios

Read more

In this episode of House of Quants, listeners will discover:

1. My personal perspective: The episode traces the journey from engineering, statistics, data science, and algorithmic trading toward quantitative research, explaining how each field contributed to a deeper understanding of uncertainty, validation, execution, and risk.

2. Why long-term market forecasting often is useless: It examines the limitations of predicting returns through valuation ratios, macroeconomic variables, and historical relationships that can break when monetary policy, geopolitics, investor positioning, or market structure changes.

3. What separates informational moves from structural inefficiencies: Listeners will learn the difference between price changes driven by new fundamental information and movements caused by institutions that must trade because of mandates, contracts, risk limits, or operational constraints.

4. How structural trading hypotheses are researched: It presents a workflow based on studying rulebooks, regulatory filings, clearinghouse specifications, execution windows, affected order books, and the barriers that prevent arbitrage capital from immediately eliminating a mispricing.

5. Why researchers must try to destroy their own strategies: The discussion explains how execution delays, wider spreads, higher transaction costs, disappearing liquidity, limited capacity, and adverse market conditions are used to test whether an apparent edge is robust or merely the result of overfitting.

6. How professional quants manage capacity, decay, and model retirement: The central lesson is that every inefficiency has limited capacity and can weaken as more participants discover it. A credible research process therefore requires monitoring live slippage, fill rates, changing execution patterns, and knowing when the original mechanism has disappeared.

7. Why forced behavior can be more predictable than market direction: The episode concludes that exploitable predictability often comes from identifying what institutions are required to do, rather than attempting to forecast economic variables, investor sentiment, or an asset’s future value.

Send me a copy

Before you begin, remember that you have an index with the newsletter content organized by clicking below.

INDEX

From research question to testable hypothesis

Quantitative trading research begins with market intuition, but it becomes empirically useful only when the researcher defines the instruments, market state, activation trigger, response window, expected price path, and causal mechanism. Strong hypothesis fixes these elements before testing, separates the source of the edge from its execution, and establishes the conditions under which the claim remains valid or expires.

What’s inside:

1. Narrowing the phenomenon: The researcher reduces a broad market observation to a specific inefficiency by defining the relevant instruments, environmental state, and natural time horizon.

2. Selecting instruments, states, and horizons: Assets should be close to the source of the market force, conditions should support the proposed mechanism, and the holding period should match the speed at which the effect unfolds.

3. Defining the expected effect: The hypothesis specifies the direction, shape, magnitude, duration, and decay of the anticipated response, including mean reversion, continuation, spread compression, or ranking changes.

4. Connecting price action to economic meaning: Expected returns require a causal explanation based on information diffusion, liquidity recovery, forced order flow, institutional execution, funding constraints, or another identifiable market process.

5. Defining the trade lifecycle: Entry conditions activate the claim, maintenance conditions verify that its mechanism remains present, and breakdown conditions identify when the original hypothesis has expired.

6. Separating observation from explanation: Similar chart patterns can emerge from different forces. Research must look beyond visual geometry to identify participants, incentives, liquidity constraints, venues, and transmission channels.

7. Separating idea, hypothesis, and execution: A trading idea provides intuition, the research hypothesis identifies the source of predictive value, and the execution method determines how to capture it. Each portfolio component must possess its own causal foundation.

Sample

1.92MB ∙ PDF file

Download

Download

Read more

Before you begin, remember that you have an index with the newsletter content organized by clicking below.

INDEX

From candidate features to validated trading models

Wrapper-based feature selection evaluates predictive inputs through the exact model and validation framework intended for live deployment. Unlike statistical filters that judge variables in isolation, wrappers score candidate subsets by repeatedly training the target algorithm under purged cross-validation. This structure ties feature value directly to net economic performance, accounting for turnover, execution fees, and collinearity risks.

What’s inside:

1. Defining the wrapper paradigm: The framework wraps a search algorithm around a target model, scoring subsets on out-of-sample performance to capture joint feature interactions that univariate statistical filters miss.

2. Accounting for market frictions: Objective functions must penalize execution friction, turnover, and subset dimension, ensuring statistical predictive power translates into net strategy returns.

3. Sequential Forward Selection: Building compact feature sets from zero limits latency and operational pipeline fragility, though greedy forward steps risk missing variables that only add value in specific pairs.

4. Sequential Backward Selection: Starting with the complete feature matrix preserves joint interaction structures, but early pruning steps require regularization to manage matrix instability from collinear market inputs.

5. Exhaustive Feature Selection: Evaluating all possible subsets guarantees locating the global in-sample optimum, but exponential search spaces create massive computational costs and high selection bias under noise.

6. Sequential Floating Selection: Integrating conditional backward passes into forward search paths dynamically purges early variable additions that become redundant as complementary features enter the model.

7. Recursive Feature Elimination: Pruning variables based on standardized coefficients or block-permutation scores directly leverages internal model weights, requiring grouped evaluations when features share underlying market drivers.

Sample

575KB ∙ PDF file

Download

Download

Read more

Before you begin, remember that you have an index with the newsletter content organized by clicking below.

INDEX

From market observation to research question

The process begins with visible market behavior, but it becomes useful only when the researcher defines the phenomenon, classifies the market setting, identifies the mechanism, specifies the scope, and formulates a testable claim. Strong research moves from intuition toward measurable, comparable, and falsifiable market processes.

What’s inside:

1. Market observation. Trading ideas begin with repeated contact between price, volume, liquidity, time, events, and relative asset behavior.

2. Phenomenon classification. The researcher separates observations into single-instrument responses, delayed adjustments, event-driven reactions, and cross-sectional or relative-value behavior.

3. Reversal and continuation patterns. Price responses are studied through their lifecycle: initial pressure, dislocation, liquidity return, continuation path, or movement back toward balance.

4. Delayed adjustment. Some opportunities arise when one instrument reacts first and another follows later because of market clocks, venues, liquidity pools, or transmission delays.

5. Event-driven research. Earnings, macro releases, order-flow shocks, scheduled events, and surprise events create clean windows for studying price discovery, liquidity withdrawal, drift, dispersion, and repricing.

6. Cross-sectional and relative-value behavior. We study how dispersion, peer-group misalignment, and linked-instrument spreads reveal hidden capital migration and market friction beneath index-level returns.

7. Research question formation. A raw idea becomes research-ready when it defines the trigger, asset universe, market state, response window, expected path, and comparison benchmark.

8. Existence, conditional, and mechanism questions. Research asks whether the effect appears, when it strengthens or weakens, and why it exists through identifiable forces, transmission channels, and sustaining agents.

Sample

1.93MB ∙ PDF file

Download

Download

Read more

Before you begin, remember that you have an index with the newsletter content organized by clicking below.

INDEX

From raw market data to scalable statistical filters

Filter-based feature selection evaluates the intrinsic statistical properties of candidate variables independent of downstream model training. By screening out noisy inputs before fitting complex algorithms, statistical filters reduce dimensional overreach, limit execution friction, and protect systematic strategies from temporal leakage.

What’s inside:

1. Defining the filter paradigm: Filters evaluate features through direct statistical tests against target labels outside the model training loop, providing a fast screening layer against high-dimensional noise.

2. Controlling selection risks: Ranking variables on statistical scores can mislead researchers if a feature increases turnover, inflates execution costs, or relies on unavailable forward bar data.

3. Measuring Information Gain: Discretizing continuous metrics into quantile bins isolates entropy reduction, revealing non-linear regime thresholds that standard linear filters overlook.

4. Class separation with Fisher Score and ANOVA: Comparing between-class variance against within-class dispersion highlights features with distinct conditional distributions, while Welch’s ANOVA corrects for fat tails and non-constant variance.

5. Capturing non-linear signals through Mutual Information: Applying continuous nearest-neighbor estimators detects non-linear dependencies, preserving valuable predictive signals such as U-shaped volume reversals.

6. Uncovering joint dependencies with ReliefF: Evaluating instances against their nearest hits and misses in multi-dimensional space isolates localized feature interactions without training a full model.

7. Preventing collinearity with mRMR: Optimizing target relevance against pairwise mutual information keeps feature sets diverse and stops models from clustering around identical risk drivers.

Subscribe now

Sample

386KB ∙ PDF file

Download

Download

Feature Selection Filter Methods

789KB ∙ PDF file

Download

Download

Before you begin, remember that you have an index with the newsletter content organized by clicking on the image below.

INDEX

Quality standards of a strong trading hypothesis

A strong trading hypothesis turns a market idea into an research object. It defines what is claimed, where the claim applies, how the effect appears in data, and how evidence improves the hypothesis over time. Precision, measurability, and falsifiability give the hypothesis structure and make the research process coherent, testable, and repeatable.

What’s inside:

1. Precision. A strong hypothesis defines the exact claim, the market setting, and the expected response.

2. Precise wording. Clear wording transforms broad ideas such as pressure, stress, momentum, or dislocation into specific market processes.

3. Precise scope. The hypothesis identifies the asset universe, market state, event type, time horizon, and environment where the effect belongs.

4. Precise outcome definition. The research defines the empirical object used to judge the effect, such as return, spread compression, rank shift, abnormal movement, path behavior, or persistence.

5. Measurability. The hypothesis enters the data through observable variables, classifiable states, and outcomes that can be scored consistently.

6. Observable variables and classifiable states. Market concepts such as crowding, hidden demand, liquidity pressure, or absorption become defensible proxies and coherent state definitions.

7. Falsifiability. The hypothesis exposes the claim to evidence by defining the conditions that weaken, contradict, or challenge the proposed mechanism.

8. Revision after contradiction. Evidence improves the hypothesis by narrowing the trigger, refining the state filter, adjusting the horizon, improving the outcome, or replacing the mechanism when needed.

Sample

1.92MB ∙ PDF file

Download

Download

Read more

Before you begin, remember that you have an index with the newsletter content organized by clicking below.

INDEX

From market endpoints to research-ready data

Quantitative trading strategies depend on the historical records that feed them. Acquiring free market data through custom web scrapers lowers upfront capital costs and expands research flexibility, but it introduces operational risks like protocol shifts, rate limits, and missing fields. Building a transparent pipeline around raw WebSocket connections ensures data transformations remain visible and verifiable before strategy testing begins.

What’s inside:

1. Data trade-offs: Free feeds provide rapid experimentation and broad market access, but lack the service-level guarantees, corporate-action histories, and delisting data typical of institutional vendors.

2. Managing protocol fragility: Relying on unofficial endpoints exposes pipelines to breakage when vendors adjust message headers, change packet envelopes, or enforce stricter rate limits.

3. Maintaining a tight dependency envelope: Constructing sockets and HTTP requests using standard library modules keeps data transformations visible and prevents third-party wrappers from hiding parsing errors.

4. Handling raw WebSocket transport: Direct management of TCP connections, TLS handshakes, frame masking, and ping-pong liveness maintains link stability across large multi-symbol requests.

5. Parsing TradingView message envelopes: Reading length-prefixed packet markers prevents buffer corruption, while explicit session and adjustment flags document whether prices reflect raw or split-adjusted trades.

6. Enforcing structured schema validation: Formatting raw bars into typed NumPy arrays preserves missing volume as unallocated values rather than zero, protecting liquidity filters from distortion.

7. Harvesting and de-duplicating universes: Paginating scanner endpoints allows researchers to build multi-asset ticker lists, though static current-day universes carry survivorship bias that requires explicit research controls.

Sample

429KB ∙ PDF file

Download

Download

Read more

Before you begin, remember that you have an index with the newsletter content organized by clicking on the image below.

INDEX

Internal anatomy of a good hypothesis

A genuine hypothesis has an internal structure. It defines when the claim begins, what market response should appear, and why that response should emerge. Its value comes from connecting activation, response, mechanism, and evidence into one coherent research object that can be tested, challenged, refined, and extended.

What’s inside:

1. Internal anatomy of a good hypothesis. The lecture presents a hypothesis as an organized structure whose parts must fit together.

2. The condition that activates the claim. A hypothesis begins by identifying the market state in which the effect should appear.

3. Trigger variable. The trigger translates pressure, dislocation, surprise, imbalance, or regime transition into a variable that can select relevant episodes.

4. State filter. The state filter places the trigger inside the right market environment.

5. Eligibility rule. The eligibility rule protects the empirical sample and decides which observations belong to the same research object by controlling for trading session, liquidity, data quality, structural breaks, and special distortions.

6. The response that defines the effect. A hypothesis must specify what should happen after activation.

7. Sign, magnitude, and timing. Sign defines direction, such as continuation, reversal, convergence, or divergence. Magnitude defines economic substance after costs and frictions. Timing defines the internal path of adjustment after the trigger appears.

8. The mechanism that explains the effect. The final part explains why the trigger should lead to the response.

Sample

1.96MB ∙ PDF file

Download

Download

Read more

Before you begin, remember that you have an index with the newsletter content organized by clicking below.

INDEX

From raw text streams to market trading signals

Text preprocessing in quantitative trading acts as an active signal-shaping operator rather than a passive data-cleaning routine. Splitting tokens, stripping punctuation, or deleting words directly alters the geometry of the feature space, changing the conditional expectation of forward returns and impacting strategy execution.

What’s inside:

1. Evaluating preprocessing as a signal operator: Preprocessing logic directly modifies input vectors, meaning every string transformation parameterizes the feature space and dictates what the classifier can observe.

2. Preventing semantic and structural failure modes: Unaligned text rules introduce structural risks, including semantic inversion from deleted negations, unstable feature representations across vendor feeds, and collapsed entity definitions.

3. Preserving entity meaning through canonicalization: Universal lowercasing acts as a destructive projection operator, merging distinct ticker symbols, corporate entities, and ordinary nouns into identical feature coordinates.

4. Defining typed token boundaries: Protected regular expressions preserve specialized financial spans, keeping currency pairs, percentages, and execution log values intact before standard tokenizers shatter them.

5. Protecting logical sign with targeted stopword filters: Retaining direction-governing terms like “not,” “under,” and “without” prevents semantic inversion in sentiment classification and stops false trade signals.

6. Validating morphological reduction under economic loss: Naive stemming merges distinct temporal and probabilistic risk states, making it necessary to distill contextual language model insights into deterministic lookup tables.

7. Combining multi-channel sparse and dense representations: Ensembling deterministic sparse vectors with dense contextual embeddings balances explicit, auditable feature attribution against abstract semantic interpretation.

Subscribe now

Sample

759KB ∙ PDF file

Download

Download

Text Preprocessing

1.29MB ∙ PDF file

Download

Download

Download

Before you begin, remember that you have an index with the newsletter content organized by clicking on the image below.

INDEX

What a trading hypothesis is not

The lecture explains that charts, indicators, and backtests can all be useful, but none of them are complete hypotheses on their own. Their value appears only when they are connected to mechanism, scope, timing, variable design, and evidence, so the researcher can move from surface regularity to a claim that can be tested, challenged, and refined.

What’s inside:

1. What a trading hypothesis is not. The lecture begins by separating a genuine hypothesis from three incomplete objects (a chart pattern, an indicator, and a backtest result).

2. A chart pattern without explanatory content. A visual formation may reveal tension, compression, rupture, or recovery, but it remains only an empirical clue until the researcher explains what market process could have produced it.

3. Visual regularity without mechanism. Repeated shapes on a chart can create the impression of structure, but research begins only when those shapes are translated into participants, frictions, information, liquidity, or structural relations.

4. Repetition without causal interpretation. A pattern that appears many times does not automatically become a hypothesis. Repetition gains research value only when it is linked to a stable cause and a clear condition under which it should persist or disappear.

5. Description without research value. Statements such as “price tends to bounce after strong declines” are useful starting observations, but they need scope, variables, comparison design, and evidence criteria before they become researchable.

6. An indicator without market logic. Indicators compress data into signals, thresholds, scores, or ratios, but they matter scientifically only when they represent a real market condition such as crowding, strain, dislocation, liquidity withdrawal, or delayed adjustment.

7. A backtest result without a prior claim. A good historical result is not enough. The lecture emphasizes that a backtest should examine a claim stated in advance, rather than becoming a machine for discovering attractive performance and inventing explanations afterward.

8. The importance of forward logic. Strong research moves from observation to mechanism, from mechanism to formal claim, and from claim to evidence. This order gives meaning to both success and failure, allowing the researcher to learn from the market rather than simply collect historical artifacts.

Sample

1.9MB ∙ PDF file

Download

Download

Read more

Before you begin, remember that you have an index with the newsletter content organized by clicking on “Read the newsletter index” in this image.

INDEX

From raw price paths to structurally aligned features

Data-shape transformation represents the first structural choice in model construction rather than a routine cleanup step. Every transformation operator selects specific variations in a market path while suppressing others, determining whether a model observes genuine economic signals or sample-specific noise. Aligning these operators with the strategy’s target holding period prevents false statistical stability and preserves the underlying alpha.

What’s inside:

1. Reframing data transformations: Treating transformations as active structural choices ensures the mathematical shape of the input feature matches the economic mechanism behind the trade.

2. Recognizing transformation risks: Indiscriminate differencing or scaling can amputate trend signals, introduce causality leakage through full-sample parameters, or distort high-dimensional distance geometry.

3. Extracting state-space surprises: Applying local linear trend models yields one-step-ahead forecast errors, isolating orthogonal price surprises from predictable local drift.

4. Neutralizing dynamic benchmarks: Rolling regression residuals project asset returns into the null space of a benchmark, stripping out market beta to expose pure relative-value dislocations.

5. Eliminating stochastic drift via cointegration: Engle-Granger equilibrium spreads remove shared unit-root trends between paired assets, producing stationary inputs designed for mean-reversion models.

6. Isolating multiscale wavelet details: Discrete Haar wavelet filter banks decouple overlapping frequency bands, targeting scale-specific shocks while filtering out macro drift and microstructural noise.

7. Encoding bounded state ranges: Rolling min-max positions compress nominal prices into a [0, 1] interval, removing cross-sectional scale disparities and allowing tree algorithms to process boundary rejections.

Sample

450KB ∙ PDF file

Download

Download

Read more

Before you begin, remember that you have an index with the newsletter content organized by clicking on the image below.

Why a trading hypothesis?

A trading hypothesis is presented as the first scientific form of a market idea, one that transforms intuition into a structured claim with an activating condition, an expected response, a time horizon, and a proposed mechanism. The lecture develops this framework as the bridge between market logic and empirical evidence, and explains how restriction, precision, and coherence turn a vague observation into a research object that can be tested, challenged, and refined.

What’s inside:

1. Why a trading hypothesis matters. A trading hypothesis is the first formal research object in quantitative trading because it gives direction, causal meaning, and empirical consequences to an otherwise informal market observation.

2. Hypothesis as a conditional claim about market behavior. The lecture defines a genuine hypothesis as a structured conditional statement that specifies when a market condition appears, what response should follow, over what horizon, and because of what underlying process.

3. The activating condition. A hypothesis begins with a trigger that identifies when the market enters a meaningful state, such as a volatility expansion, spread dislocation, order flow imbalance, or liquidity shock, so the sample becomes selective in a principled way.

4. The expected market response. The claim must state what should happen after activation by defining the object of movement, the direction of adjustment, and the scale or relevance of that movement, so the idea acquires a clear empirical identity.

5. The horizon over which the response should emerge. Time is treated as part of the hypothesis itself because different mechanisms operate on different clocks, and the validity of the research depends on matching the response window to the real rhythm of the market process.

6. A bridge between market logic and empirical evidence. The lecture shows that a good hypothesis connects two domains at once, the logic of participants, frictions, and structural forces on one side, and the language of variables, samples, outcomes, and comparisons on the other.

7. Empirical signature and supporting evidence. A strong hypothesis does not predict profitability alone, but a specific patterned trace in the data, including direction, structure, timing, conditional strength, and comparative contrast, so support comes from alignment rather than from one backtest statistic.

8. The hypothesis as a restricted object. The lecture explains that every valid hypothesis must be restricted to a coherent asset universe, a defined market state, and a proper time horizon, because restriction is what gives the claim scientific shape and protects it from vague breadth.

Sample

1.87MB ∙ PDF file

Download

Download

Read more