Classic and New Analytics - FAQ
Why is there a discrepancy between KPIs results in Classic and New Analytics?
There are two main reasons:
Updated KPI Definitions:
KPI definitions were revised in the New Analytics to reflect customer feedback, making them more accurate and aligned with real-world use cases.Event Processing Differences:
In some cases, discrepancies were caused by missing or unprocessed events in the New Analytics data pipeline due to earlier architectural misconfigurations, which have since been resolved.
Have KPI values (current or historical) changed in the Classic Analytics?
No, KPI values in the Classic Analytics have not changed.
Have KPI values (current or historical) changed in the New Analytics?
Yes, in some cases. After a full database synchronization, any previously missed historical data was reflected and updated in the New Analytics, leading to more accurate results.
What caused unprocessed events in the New Analytics?
Earlier misconfigurations in the pipeline and insufficient monitoring led to some events not being sent to the New Analytics data warehouse. This has since been addressed with architectural changes, improved monitoring, and a new process for daily synchronization.
What has been done to ensure accuracy in the New Analytics?
To guarantee data accuracy:
A full synchronization process runs twice daily at 12:00 AM and 12:00 PM CET, ensuring all data is up-to-date.
Enhanced monitoring and quality checks have been implemented to alert teams of any missing events.
Historical data issues have been resolved, and KPI definitions have been updated to reflect these changes accurately.
How often is the data updated in the New Analytics?
The New Analytics updates twice daily:
UI Updates: Data refreshes at 4:30 AM and 4:30 PM CET.
Download Updates: Data for downloadable reports is refreshed at the same times.
Are both Analytics versions (Classic and New) available?
Currently, both versions are available for some customers. However, the Classic Analytics will be sunset in early 2025 in a phased approach.
What are the key differences between Classic and New Analytics?
Feature | Classic Analytics | New Analytics |
|---|---|---|
Update Cycle | "Real-time" (but prone to timeouts) | 2x daily updates for UI and downloads, improving reliability. |
User Interface | Deprecated design components | Updated design aligned with modern SoSafe Manager UI. |
Download Speed | Slower downloads | Faster downloads. |
Data Accuracy | Prone to discrepancies due to unstable pipelines | High accuracy with stable pipelines and daily syncs. |
Scalability | Limited by basic architecture | Scalable and cost-efficient infrastructure. |
E-Learning: Key Differences
Feature | Classic Analytics | New Analytics |
|---|---|---|
Filter Options | Campaign | Campaign. |
Tabs | Basic & ISO view | Basic & ISO view. |
Personalized Campaigns | Not available | Available. |
Metrics | Registration as % of license pool. | Registration rate (% of assigned users who registered). |
Absolute count of users starting/completing. | Starting rate (% of users who started at least one module). | |
Completion rate (% of users who completed all modules). |
Simulation: Key Differences
Feature | Classic Analytics | New Analytics |
|---|---|---|
Over Time Charts | Some metrics supported. | All base metrics supported. |
Smishing Metrics | Not available. | Available. |
Breakdown by Group | Limited to Click Rate. | Click, Interaction, Open, Reply Rates. |
Why are real-time updates no longer available in the New Analytics?
Real-time updates in the Classic analytics often caused severe performance issues, including timeouts and fetch failures. The new architecture prioritizes reliability and accuracy through twice-daily updates. Efforts are underway to introduce near-real-time updates for specific use cases, such as monitoring setup and email sends, without compromising stability.
Can new customers still access the Classic Analytics?
No, accounts created after December 17, 2024, do not have access to the Classic Analytics.
When we switch off the Classic analytics, will we also lose all the archived analytics?
Archived analytics will be available to users. The product squad is currently working on making it available in the next 2 weeks (as of Feb 3rd 2025). So by the time we have switched off Classic analytics fully, we will have the archived campaigns view ready in the new one.
The only limitation is that downloading the reports is not available yet. Its in the backlog, and we'll let you know the ETA.