View a markdown version of this page

Reports in AWS Device Farm - AWS Device Farm

Reports in AWS Device Farm

The following sections provide information about Device Farm test reports.

Report retention

Device Farm stores your reports for 400 days. These reports include metadata, logs, and screenshots.

Report components

Reports in Device Farm contain pass and fail information, crash reports, test and device logs, and screenshots. The report includes detailed per-device data and high-level results, such as the number of occurrences of a given problem.

Test Insights

Device Farm generates a Test Insights report by default for each run in a custom test environment that uses one of the following frameworks:

  • Appium Java JUnit

  • Appium Java TestNG

  • Appium Node.js

  • Appium Python

  • Android Instrumentation

  • XCTest UI

This includes Appium web app tests. Appium Ruby tests are not supported. The report includes the following information:

  • Passed, failed, skipped, and errored test counts for each job and for each run

  • Detailed test output with timestamps and stack traces for each test, where applicable

  • Median test execution time for each job, and median and average job execution duration for each run

Test Insights helps you understand your test suite performance at both the job and run level. With Test Insights, you get the detailed test reporting of standard mode combined with the faster execution speed of custom mode. For more information about test environments, see Test environments in AWS Device Farm.

To configure your tests for Test Insights, see the test report section for your framework:

To turn off Test Insights for a run, see Creating a test run in Device Farm.

Logs in reports

Reports include complete logcat captures for Android tests and complete Device Console logs for iOS tests.

Common tasks for reports

For more information, see Viewing test reports in Device Farm.