firebasefirebase-remote-configfirebase-ab-testing

Activation event & frequency of flag updation for accurate AB test


I am trying to run an experiment to change the behavior of a element on app's step-3. In order for data to be accurate,I was planning to put activation event as event which completes step-2. Now firebase remote config values are fetched when app first starts so there's no way the app would get updated remote config value for the flag to be used on step-3 if I set step-2 completion as an activation event. If I fetch and activate the flag value every-time I use a flag,that would go over limit of 5 times in 60 minutes. What is best way to go around this problem?


Solution

  • So the activation event for ABT only causes users who trigger it to start getting counted in the experiment, it does not activate the actual config values when triggered. You should be able to fetch and activate on app start and then by using the activation event on step 2 the user may be entered into the experiment and get the step 3 behavior change.

    This article talks about about RC activation https://firebase.googleblog.com/2017/01/firebase-remote-config-loading.html

    And the docs here go into a bit more detail on ABT activation events https://firebase.google.com/docs/ab-testing/abtest-config