androidfirebasefirebase-test-lab

Firebase Device Test lab: Failed to create a test matrix


I want tot try out firebase device testing - but i get a really generic error message doing so:

Failed to create a test matrix.

Anyone knows how to get around this? Quota should not be the problem - the button I press says "Start 2 tests" I already removed some devices in case it is quota. Unfortunately googling for the error does not really lead to a result..

enter image description here


Solution

  • Ahmed here from the Firebase Test Lab team.

    The issue happens when you exceed the quota for the day. There have been two issues on the Test Lab side contributing to the confusion here:

    1. The message shown is confusing and it's hard to understand what's going on
    2. To enforce this daily quota on usage, we require to have the API enabled on your project. We needed to have the API enabled on all Firebase projects. When we launched, we had the following in place (i) All new projects have the API enabled by default and (ii) All existing Firebase Test Lab users had the API backfilled. The issue happens when you have created a Firebase project in the past (before October 1st 2016) and never used Test Lab then went back to use it afterwards.

    Issue (1) is still ongoing and we're currently working on making our error messages more informative. Stay tuned!

    Issue (2) is now resolved completely. We've backfilled all the Firebase projects that were ever created with the Test Lab APIs.

    You should now expect seeing this issue only in cases where you exceed the daily quota till we provide a better error message.

    Thanks so much and apologies for the confusion!