You may have noticed the stats in your Campaign, Flight, or Project reports drop recently, or you may have seen a pop-up message acknowledging that those stats could drop. In this article, we will discuss the meaning and implications of this change, and why it represents an overall improvement in Feathr's functionality.
What has changed?
In August 2023, Feathr changed its reporting calculation method from a bulk aggregation model to a live model. This is because our users and developers noticed the bulk aggregation model was causing some important reporting metrics to be unintentionally inflated beyond what is accurate.
The new live modeling calculates certain reporting metrics in real time as you load your report, resulting in superior accuracy when compared to bulk aggregation.
Due to the switch from bulk aggregation to the more accurate live modeling, however, many users' reports will now show a decrease in reach and other stats that are predicated upon reach. This is an expected result from identifying a problem with bulk aggregation and utilizing live modeling to solve it.
This change is the product of a significant improvement in how Feathr calculates the results of your marketing efforts. This update also represents an upgrade to Feathr app stability, which contributes to a smoother experience for all Feathr users.
Which Stats are Affected?
You may see a drop in the following stats in your Campaign, Flight, and/or Project reporting as a result of this change:
For Ad Campaigns:
- Unique Clicks
For Email Campaigns:
- Unique Opens
- Unique Clicks
Our tests have determined Reach and Opens have dropped an average of 23%, while click stats have dropped an average of 6%.
The following stats may increase as a result of the change in calculation:
- Opens Per Person
- Click-through Rate
Which Campaigns are Affected?
- All Campaigns, Flights, and Projects created since December 2018 will now be calculated using live modeling and therefore could see stats change.
- All Campaigns, Flights, and Projects created since October 2022 will see a less significant change, because they were calculated using a more accurate aggregation method.
- All Campaigns, Flights, and Projects created since May 2023 will see an even less significant change yet, because they were initially calculated using live modeling and will be recalculated using the updated live modeling launched in August 2023.
Is there something broken with my reporting?
No, there is something fixed! The reason you're seeing reduced numbers in your reporting stats is due to an upgraded calculation method we introduced to ensure superior accuracy in your reports now and in the future.
Were my previous reports inaccurately inflating campaign stats?
For the stats mentioned above, the answer is most likely yes. However, other stats like total views, total opens, total clicks, conversions, and anything else not called out above are not affected.
Have my Monetization campaigns also been reporting inaccurately inflated stats?
Monetization campaigns were affected in the same way as all other campaigns, but only the stats mentioned above. From August 2023 onward, all campaign stats have been adjusted to be calculated accurately.