Quant Researcher: The research case and Modelling case
Work through a modelling case
About 30 minutes, start to finish.
Open withLet me make sure I know exactly what we're predicting, at what moment, and what the forecast is used for.
The clock
Stage by stage
Close each stage out loud, so they always know where you are.
- 1The exact target5 min
That's the target and when we forecast it. Next, the inputs we'd really have.
- 2Inputs known at the time6 min
Those are the inputs we'd have had at that moment. Now the baseline to beat.
- 3A baseline5 min
That's the simple answer my model has to beat. Next, how I'd test it honestly.
- 4An honest test8 min
That's the test, in time order. Last, what would make me drop it.
- 5What would make you drop it6 min
That's my rule for dropping it, set before I look. Where should I go further?
How people lose this round
I'd train a deep network on the whole history.
It skips the baseline, so you can't tell whether it learned anything. And daily data gives a few thousand rows, little for a model with many weights.I'd check it with 5-fold cross-validation.
Shuffled folds train on days after the ones they test, and neighbouring days look alike. Test in time order.It fits with an R² of 0.6, so it works.
A fit on the data it was built from comes cheap. What counts is how far it beats the baseline on data it never saw.The best of my 40 versions has a t-statistic of 2.5.
Try enough versions and one clears 2.5 by luck. Say how many you tried, and keep data back for the winner.My strongest input is the volume over the next few minutes.
It's strong because it's nearly the answer, and you can't know it at the moment you forecast.
A worked answer
The notes in the margin mark where the candidate asked, put a number on it, took a hint or caught a slip.
- Interviewer
Build a forecast of tomorrow's volatility for an equity index future.
- You
Let me pin it down. Is that realised volatility over tomorrow's regular session, forecast at today's close? And what's it for: sizing positions, or pricing options?
Fixes the target and the moment of forecast.
The rest of this answer comes with Pro.
Pro opens every worked answer, margin notes and all.