The window the vendor could not see: 13 of 26 audits have one at all

2026-09-04. Every figure quoted here is a field in a published audit JSON, and the listed audits are linked in place.

Gold Snap closed 3,769 trades in our run and exactly 20 of them closed after the date of its last update. Those 20 trades are the only part of the record that the author could not have looked at while building the product. They are 0.5 percent of the run, they cover 46 calendar days, and they made 29.73 USD. The other 3,749 trades ran over price history that was on the screen while the robot was being written and adjusted.

Every audit we publish cuts its trade history at two dates and reports the three pieces separately. This article reads that block across all 26 default audits and reports what it found, including the part that does not flatter the method.

Where the two cuts fall

The two dates are the release date of the product and the date of its most recent update. They produce three windows.

Four mechanical details decide what a row means, and each of them can move a number.

The three windows add up, and we checked it

The window figures sit on the costs level of the audit, after the commission retrofit, and not on the tester header. That is easy to verify by addition, so we did it on four runs.

Thirteen of twenty six runs have such a window

The block behaves in four different ways across the catalog, and the three ways that are not a real window matter more than the one that is.

How big the window is when it exists

Across the 13 runs that have one, the median window is 46 days and the median count is 47 trades. The spread around that median is what a reader should carry away.

Six get better, six get worse, one cannot be compared

The obvious thing to do with this block is to compare the profit factor before release against the profit factor after the last update. We did, and the result is not the tidy story an audit site might prefer.

Six read worse out of sample. CryonX falls from 2.62 to 0.79 and is the only one of the thirteen that is net negative in the window, at 59.52 USD in the red. Gold House falls from 2.02 to 1.37, ThunderGold Scalper from 1.54 to 1.09, Gold Atlas from 1.35 to 1.07, Prop Firm Gold EA from 1.25 to 1.05 and Gold Snap from 1.66 to 1.62.

Six read better. Quantum Athena X rises from 3.93 to 11.46 on 47 trades in 11 days, The Gold Reaper from 1.92 to 9.65 on 16 trades, Quantum Queen X from 4.30 to 7.50 on 43 trades in 11 days, Gold Trade Pro from 1.71 to 2.44, Adaptive Gold Scalper from 1.19 to 2.16 and Smart Gold Impulse from 1.14 to 1.52.

One cannot be compared at all. Twister Pro Scalper has two out of sample trades and neither of them lost, so there is no denominator and the field is empty rather than infinite.

The split is six against six, and that is the finding. A profit factor of 9.65 built on 16 trades is not evidence that a robot works after its last update, and a profit factor of 0.79 built on 173 trades is not proof that one fails. What this block delivers is a sample size next to a number, so a reader can see how thin the only unfitted evidence really is before deciding what it is worth.

The same run, two different answers

One pair in the catalog makes the dependence on metadata impossible to miss. Quantum Queen and Quantum Queen X are the same measured run published under two slugs, and both count 3,357 trades. Queen X carries a release date of 2026-07-14 and an update on 2026-07-31, and reports 43 out of sample trades over 11 days. Queen carries no release date and reports nothing. Identical trades, two different answers, because this block reads dates and not deals.

Run these checks yourself

Every figure above is public in the audit files linked in place, and the category pages list the verdict lamps for free. Your own tester report? The browser check is free.

The honest limits. Out of sample here means after the last update we recorded, which is not the same as unknown to the author. A developer can work on data long before publishing, and nothing in a public archive can rule that out. The window is also bounded by our own test end, and the last trade in these runs closes between 2026-08-05 and 2026-08-13, so a longer test would grow the window for every product listed here. There is no statistical test in this block at all, and with samples of 2, 3 and 16 trades none of the comparisons above would survive one. Our dates come from the MQL5 product archive, so a republished product can show a release date that is not its first. And Quantum Queen and Quantum Queen X are the same measured run under two slugs, so the 26 files above cover 25 distinct runs.