Support tests running on an Android Emulator that is managed via Gradle Managed Devices

[jaysirju]

I'm submitting a ...

• bug report
• feature request
• support request => Please do not submit support request here, see note at the top of this template.

What is the current behavior?

Allure results are written to /sdcard/googletest/test_outputfiles/allure-results or <allure.results.directory> by default when running on a device.

What is the motivation / use case for changing the behavior?

If the device is managed via Gradle Managed Devices, you cannot use 'adb pull' to get the contents of the sd-card. However, there is a little known feature that the contents of the /sdcard/Android/media/<Bundle Identifier>/additional_test_output directory is copied over to app/build/outputs/managed_device_android_test_additional_output after the tests have been executed.

Details can be found here

[kadestro]

you can use additionalTestOutputDir to change the directory from which the test results will be taken, e.g.:

testInstrumentationRunnerArguments["additionalTestOutputDir"] = "/sdcard/googletest"

[JoseAlcerreca]

As @kadestro says, you can set the additionalTestOutputDir property so that an additional directory is automatically pulled from the device.

I couldn't get it to work with the default behavior because the test results are stored in /data/data, on the device, and I was getting a permission error in that directory. However, if you use the TestStorage feature the results are stored in /sdcard/googletest which works fine. It requires you to add androidTestUtil("androidx.test:orchestrator:1.5.1") to your module's dependencies and to enable the property which can be done with allure.results.useTestStorage=true.

Once done you need to pass additionalTestOutputDir to the runner. I do it from command line so that only the GMD tests use it.

./gradlew :app:pixel2Api33Variant1DebugAndroidTest --console=verbose -Pandroid.testInstrumentationRunnerArguments.additionalTestOutputDir=/sdcard/googletest -i

If you pass -i (info) you'll see something like
INFO: Copying files from device to host: /sdcard/googletest to /the/path/to/app/build/outputs/managed_device_android_test_additional_output/debug/flavors/variant1/pixelFoldApi34

(btw I filed https://issuetracker.google.com/389673587 because the name of the device is wrong)