Side by side
AWS Device Farm vs Firebase Test Lab
Both stand on device farm software. Which one you can start free with, which one lets you read the code, and what each costs once you pay.
Free trial AndroidAPIiPhone+1
Choose AWS Device Farm if you need managed cloud testing across mobile devices or desktop browsers, with parallel runs and IDE or CI connections. Look elsewhere if the stated at-rest encryption and external key-management limitations do not meet your requirements.
Visit AWS Device Farm
Free plan Web
Choose Firebase Test Lab if you need cloud-based mobile testing for its listed targets, particularly with CI/CD integration. Spark offers daily run allowances; look at Blaze if you need testing-time allowances, while accounting for its per-minute billing.
Visit Firebase Test LabThe facts
| AWS Device Farm | Firebase Test Lab | |
|---|---|---|
| Free plan | A free trial | Yes |
| Open source | Not published | Not published |
| Runs on | Android, API, iPhone, Web | Web |
| Lowest paid plan | Private devices: $200 a month | Free or on request |
| Plans published | 4 | 2 |
| Maker | Not published | Not published |
| Website | aws.amazon.com | firebase.google.com |
| On device farm software | #8 of 26 | #12 of 26 |
AWS Device Farm: what it does well
- Tests run on real mobile devices and desktop browsers hosted on AWS.
- Parallel execution supports up to 50 runs.
- Test conditions include location, language, network and app data.
- Supports Appium, Calabash, Espresso and remote manual testing.
- Plugins and API connect testing with IDE and CI environments.
What to know first
- No free plan is offered.
- Physical mobile testing data is not encrypted at rest.
- External key management for data encryption is unavailable.
Firebase Test Lab: what it does well
- Runs tests in the cloud.
- Tests Android apps, iOS apps, and mobile games.
- Supports mobile testing.
- Supports CI/CD integration.
- Both plans include Android Device Streaming minutes.
What to know first
- Spark limits virtual-device tests to 10 runs per day.
- Spark limits physical-device tests to five runs per day.
- Blaze charges for testing time beyond its no-cost allowances.
Alternatives to AWS Device Farm Alternatives to Firebase Test Lab The whole list