Reports in AWS Device Farm
The following sections provide information about Device Farm test reports.
Report retention
Device Farm stores your reports for 400 days. These reports include metadata, logs, and screenshots.
Report components
Reports in Device Farm contain pass and fail information, crash reports, test and device logs, and screenshots. The report includes detailed per-device data and high-level results, such as the number of occurrences of a given problem.
Test Insights
Device Farm generates a Test Insights report by default for each run in a custom test environment that uses one of the following frameworks:
Appium Java JUnit
Appium Java TestNG
Appium Node.js
Appium Python
Android Instrumentation
XCTest UI
This includes Appium web app tests. Appium Ruby tests are not supported. The report includes the following information:
-
Passed, failed, skipped, and errored test counts for each job and for each run
-
Detailed test output with timestamps and stack traces for each test, where applicable
-
Median test execution time for each job, and median and average job execution duration for each run
Test Insights helps you understand your test suite performance at both the job and run level. With Test Insights, you get the detailed test reporting of standard mode combined with the faster execution speed of custom mode. For more information about test environments, see Test environments in AWS Device Farm.
To configure your tests for Test Insights, see the test report section for your framework:
To turn off Test Insights for a run, see Creating a test run in Device Farm.
Logs in reports
Reports include complete logcat captures for Android tests and complete Device Console logs for iOS tests.
Common tasks for reports
For more information, see Viewing test reports in Device Farm.