You made it! You have live Experiences, your users are engaging with them, and all that's left is to connect their impact to your product goals. For all Experiences, you can review key metrics over time and layer these onto your product events to better understand their impact.
Chameleon collects some default data to help you analyze your Experiences. You can review the overall stats in your Chameleon Dashboard, export the full data as a CSV file, or send it automatically to your analytics platform (via one of our integrations or API)
Availability & Usage
π Available for Startup, Growth, and Enterprise
π Analyze the impact of Tours, Tooltips, Embeddables, Microsurveys, Launchers
βοΈ Review or download from the Dashboard
π We use Tours to exemplify the data you have available and how you can review key metrics. The Dashboard will show a similar performance breakdown for each Experience type, and you can apply similar principles when analyzing other Experiences. The performance table does not include drafted Experiences.
What data does Chameleon provide?
Chameleon collects some data by default, from all the Experiences you have live. This includes events and properties, and all of these have a uid
attached, so you can track and associate these with your users easily.
We track data directly associated with your in-product Experiences, so you can understand how they impact your product's adoption.
With each Experience, the data we collect will be slightly different based on the engagement options your users have. For example, the data collected for Tours include events such as:
Tour event | Description |
Started Tour | If an end-user sees the first step of a Tour. |
Completed Tour | When the Tour is completed (the user takes an action that completes (or advances from) the last Step of the Tour. |
Exited Tour | When an end-user clicks the dismiss option in a Tour Step, this option is set to Exit the Tour. |
Previewed Tour | When an admin user previews a tour. |
Chameleon Experiment entered | When a user falls into the target audience on a matching page where a Tour with Testing can show, the property experiment_group indicates whether the user is in the test or control group. |
Step Seen | When a user views a step within a Tour. |
In addition, it also includes properties such as:
Tour Property | Description |
tour_name | The name of the tour (as defined within the Editor). |
url | The URL on which an event occurred (e.g. the URL of the first step of the tour for the Started Tour event). |
step_name | The name of the step - sent for Exited Tour events. |
tour_duration | The time in seconds between the Started Tour and Completed Tour / Exited Tour events (sent only for the latter events) |
Browser, City, Country | and other browser-based properties |
π For full details of all data that Chameleon collects, view our schema:
We collect all this for each user so you can assess how they engage with your Experiences, where they fall off, or where you can improve their journey.
Reviewing your Chameleon data and product events enables you to understand how you can improve your efforts and what's working and what isn't.
Understanding your data in Chameleon
To make it easier to assess the performance of your Experiences, you can review your overall Experience stats in your Dashboard. From the Homepage, you can get an overall understanding of how users engage with your Experiences
β¨ Your "Engagement Index" is a good indicator of "healthy" in-app Experiences.
You can also select any Experience type or a specific Experience to see a performance breakdown, for how many Experiences you have live, how many users engage with them, and how they are performing overall.
π Learn more about Chameleon's Dashboard reporting
Track overall performance
The performance graph is where you can understand how your Experiences perform over time and understand how the changes you make impact their engagement and completion rate.
Here, you can see a breakdown of how many Tours were started and completed on a daily, weekly, or monthly basis for a set time frame. On hover, you'll also see detailed stats for that particular time.
βΉ The "Performance chart" is also available on the "Analytics" page of each Experience, where you can see, in the case of Tours, for example, the overall completion rate.
You can also review the "Engagement Index" just for Tours, for example, as well as for any individual Tour. On the "Analytics" page of any Experience, you'll see a daily Index, and on the main Experience pages, you'll see a lifetime score.
π Use the individual "Performance chart" and "Engagement index" to monitor user engagement with your Experiences and quickly spot spikes or different behaviors. For example, you can connect a steady completion rate to a healthy trial activation.
Review specific behaviors
You can use the table view below to understand how users engage with specific Experiences. Depending on the type you're reviewing, you'll also see some key metrics to help you understand better how they perform. With Tours, for example, you can:
Analyze the number of users who start and complete them
See the individual completion rate of each one
Review Tours that haven't been started recently (an indication that there might be something wrong)
Here are a few things you can review when assessing high/low performance:
if the Segment is as accurate as possible
are there any recent changes or updates made to the Experience?
when was it last updated/reviewed (any product changes your users are not aware of?)
π Learn more about reviewing Experience changes on the Activity feed and how you can use it for an efficient async flow with your team.
Review one Experience at a time
You can also open any Experience and review its performance on the Analytics tab. Here, you can assess how many users see it and how they engage with your Experience, as well as an individual "Engagement Index" and a breakdown of all Step interactions.
This enables you to understand what users are interested in, where they might drop off, as well as how you can improve the timing or triggers of your Tour.
In the case of Microsurveys or Launchers, you can also see a response summary section or an overview of the different types of Items.
With the performance review you conduct in the Dashboard, you can get a good picture of what's working or not and what you can try to improve.
But we encourage you to take your analysis one step further by exporting a spreadsheet -- either by downloading the CSV or sending the data to your Google Drive. This enables you to analyze how your Experiences impact your product's adoption along with your overarching goals.
First, get familiar with the spreadsheet in front of you. Each row represents a unique action (event) a user has taken in your Tour, within the select time range. These events include:
Tour started, when a user sees the first Step of the Tour.
Tour exited, when a user dismisses any Step of the Tour (including the last Step).
Tour completed, when a user completes the last Step of the Tour.
Step seen, when a user sees a Step within the Tour.
And others that can be found in the "Events" tab of the Data Schema, such as Button clicked and Dismiss clicked.
Each row also contains user properties/attributes associated with the user that took this action. This includes default user properties collected by Chameleon and custom user properties that you're sending to Chameleon through our API, integrations (e.g. Mixpanel cohorts, HubSpot lists), or add via Chameleon Tags.
π‘ We highly recommend sending user properties to Chameleon to help target your Experiences. Learn more about how to send user data to Chameleon.
Next, review the Data glossary below π to gain a good understanding of what each column represents.
Below are the definitions of the columns you will see in your exported data. All data is accurate at the time that the event took place, for the live/published Tour:
Data property | Definition |
tour_id | Unique and persistent ID for that Tour. Learn how to expose this. |
tour_name | Name of the Tour. |
tour_steps | Total number of Steps in the Tour. |
step_id | Unique and persistent ID for the Step (only for Step seen events). |
step_number | The sequence number of the Step within the Tour (only for Step seen events). |
event_name | Type of event (see above). |
timestamp | Time when the event took place. |
elapsed_time | Time since the beginning of the Tour (for Tour events). Time the Step was showing (for Step events). |
Divider indicating what the next set of columns corresponds to. | |
uid | Unique ID for the user that caused the event, as sent by your product. * |
browser_width | Width of the browser, in pixels. |
browser_name | Name of the browser. |
browser_language | Default browser language code. |
browser_timezone | The timezone for the browser, relative to GMT/UTC. ** |
last_seen_at_session_count | Number of web sessions detected by Chameleon for that user. *** |
Divider indicating what the next set of columns corresponds to. | |
... | Any user data sent to Chameleon will be shown here |
* This should match the ID you use to track users in your database or other analytics tools and sent as part of the Chameleon installation.
** Pacific Time would be -8.
*** Sessions are separated by 90 minutes of inactivity, and the count begins after the Chameleon code snippet is installed.
Now that you know what you're looking at, here are a few things to keep in mind:
If a Step has a dismiss option, which is configured to show the Tour again later, it will not generate a Tour exited event.
This export does not contain detailed Step Seen event data (with information on all the Step configurations). However, this data can be sent to your connected integrations. To enable this for your account, please message us.
Content per cell is limited to 4096 characters (bytes)
Content that could be a function/formula in Excel are escaped with a leading single quote (i.e.
'=cmdl' /C Notepad'!'A1'
)
Once you have your data at hand, you can use it to conduct a range of analyses to answer questions such as:
Which Step are users exiting the Tour the most?
Which specific uses have seen a particular Step?
Which specific users have completed or dismissed the Tour?
Tour success by user property (such as language or a custom property).
How long did it take a particular user to complete a Tour?
To do this, we recommend creating a Pivot table from all the data and then selecting the most relevant data to plot and compare.
Pivot tables allow you to easily group, filter, and chart a large table of data. In the pivot table, you can decide which columns from the original data to show on each axis and add further filters. You can create pivot tables in MS Excel or Google Sheets.
For example, here's how you can recreate the funnel chart we show in the Dashboard π
Steps to create a Funnel Chart in Google Sheets
Export data from Chameleon to Sheets
Filter and remove any unwanted data rows
Create a Pivot table
Add the appropriate Pivot table settings
Rows - Event UID
Order by Descending
Sort by COUNTA of Event UID
Step seen*
Columns - Event
Order by Descending
Sort by Event
Values - Event UID
Summarize by COUNTA
Show as Default
Filters - Event
Status βStep seenβ
* Go back to "Rows" and add the "Step seen" there
Optional, copy and paste Step text to replace Step UIDs
Create bar graph
π This feature is only available in the Growth or Enterprise Plan. To learn more or upgrade your plan, please contact us.
It's important that users engage with Your Experiences, but to truly measure how your guidance impacts your adoptions is to look at whether users act on what they see in your Experiences.
With Tours, you can leverage your product events to understand how your Experiences drive your users to success. Goals can either be defined from within Chameleon (as a page load or click) or taken from any of the events you send to Chameleon (via our integrations or our API).
Once you understand how users engage with your Experiences, it's time you connect this data with your product events. We highly encourage you to use a specialist analytics provider to analyze your product data. Because your most important product events are unique to your brand and goals, you're the best to establish what success means to you.
We integrate with common providers, which you can use to track your native product events alongside Chameleon events. This way, you can holistically evaluate the impact of your Experiences on other user actions and understand how you can improve your process.
π‘ We recommend you consider using Segment or Freshpaint to streamline your analytics tracking and enjoy greater control of your data pipeline.
You can learn more about how Chameleon works with these tools from our user guides:
You can also add the data that Chameleon automatically collects directly into your database and then query this data alongside all your other product data.Β To do this, simply use our open API to send Chameleon data to your database or other tools.