Effective September 21, 2015 the CME changed the closing time for futures that closed at 5:15 PM ET from 5:15 to 5:00 PM. The CME did this because the volume from 5:00 PM to 5:15 PM just wasn’t that significant.
My initial thought was “no big deal, my strategies hardly ever traded during that time anyhow.”
Turns out, I was wrong. It could be a HUGE deal, depending on your strategies. Here’s the story, and what you can do about it.
At the end of every month, I take a look at how all my strategies performed during the past month. I take a quick look at the equity curve, record a performance metric or two, and then move on to the next strategy. I do this for live strategies, experimental strategies, strategies I am watching (incubating), etc. – I analyze over 100 strategies (and growing!) each month.
So, at the start of October, after the CME data change went into effect, I took a look at a 30-minute Crude oil system I had. Last time I looked at it in the beginning of September, it looked like this:
At the beginning of October, it now looked like this:
Whoa!!! What happened?????
Answer: The CME data change screwed up my strategy!!!
Of course, my immediate thought was “oh no, all my strategies are ruined!” It turns out that is not the case, as I’ll explain later. But the bigger question is why is this happening?
This particular strategy trades the 24-hour market, with 30-minute bars. So, the last bar of the day was always from 5:00 PM ET to 5:15 PM ET (a 15-minute bar, but a bar nonetheless). 47 bars defined one full session. When the CME changed the trading time, my data provider (TradeStation) went back and modified their 24-hour session to end at 5:00 PM, not 5:15 PM. This means all the history changes, with one less bar per day. Now I only have 46 bars each day. Can you see how this might possibly be an issue?
What is the impact of having one less bar per day? Well, it depends on your strategy, but here is what happens to a 20-period moving average indicator. As you can see, as time goes on, the moving average shifts more and more. It is very easy to see how this could dramatically impact your trading strategy signals!
So, that is the bad news. What is the good news? Depending on the market you trade, this data change may or may not be a big deal for you. If you trade with daily bars, chances are this will not be a problem. If you day trade the mini S&P, you should be OK because your session ends at 4:15 PM ET. And, of course any product on the ICE exchange (coffee, cocoa, etc.) is not impacted.
Plus, your strategy may not be impacted by this at all. Strategies that use moving averages might be troublesome, but strategies with candlestick patterns might not be impacted.
Finally, your data provider may matter, too. TradeStation chose to eliminate all history of trading from 5:00 – 5:15 PM ET from their “regular” session (don’t worry, the data is still there, you just have to create a custom session to access that “lost” data), but other data providers might have accounted for the changeover differently. CQG, for example, assumes the closing price of a daily bar is the last trade price. Now, that last trade occurs 15 minutes earlier – that might be an issue for you. Really, you need to check with your data provider to see what they did.
In short, you may or may not have to do anything about this data change, but you should definitely check. Here is what I did:
- I analyzed performance of all my strategies. If the historical performance changed between my September 1 and October 1 evaluation, then I knew the strategy was impacted by the data change.
- For strategies that had a change in performance, I did one of three things:
- If performance difference was small, I assumed data change was not that significant, and just left the strategy alone. That could be a bad assumption, I realize.
- If change was large, I re-ran my development steps with the new time session for all the history. Basically, I am treating this as a new strategy. If this new analysis looked good, I now treat this as a “new” strategy.
- For cases where the “new” strategy (based on 5:00 PM end time throughout history) looks awful, I am keeping the original strategy, and just accepting the change. I’ll monitor the performance, but not trade it live. How will the strategy perform with the time session change? I don’t know, but if it keeps working in the future, I might just trade it again. I won’t be surprised, though, if the strategy falls apart. After all, the backtest was based on 5:15 PM stop time, and the future will be a 5:00 PM stop time. Why should that strategy still perform the same?
Bottom Line: Check all your strategies. See if the data change impacted them. Realize that future performance might change, and this effect is strategy, market, and data provider dependent. Don’t assume you are safe from this subtle data change. It may be dramatic for you.
If you would like to learn more about building trading systems be sure to get a copy of my latest book, Building Winning Algorithmic Trading Systems.
— Kevin J. Davey of KJ Trading Systems
Weird. If your 20 bars EMA broke, it only impact your half day trades just from the point of the data changing, because 20 M30 bars are only 10 hours. How can it impact your whole month trading?
Hi wqking –
With an exponential moving average, theoretically ALL past data points are included in the calculation. So, even if only one data point changed, this could impact the strategy going forward. Depending of the difference in data, it may or may not be a significant issue.
The important point for anyone reading is to check your strategies to see IF this is a problem. Many strategies won’t be affected by this, but some will. Hopefully none of your strategy results will change because of this!
Kevin, I don’t know the strategy in question but if a reduction of 1 bar from 47 to 46 would have that much of an impact, I would suggest a curve fit on the basis of bars. I’m assuming that you would have performed some sort of optimisation using a combination of different bar lengths, times MA’s etc., to see what the strategy looked like on ‘either side’ of the chosen strategy variables that you specify in the post. I know of your work, so perhaps I am missing something….
I use daily bars so I’m not impacted but I think that it is worthwhile for you to have pointed out the issue for readers.
Ryan
http://www.daxgaptrading.wordpress.com
Thanks for the reply, Ryan. It definitely could be a strategy robustness issue, but I saw some cases where it was more than just that. The same issue came up a few months ago when the CME changed the times for meats (cattle, hogs) trading.
The good thing is that it is an easy check to run.