Skip to content

chore: Add integration tests for Android #1146

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 23 commits into
base: main
Choose a base branch
from
Open

chore: Add integration tests for Android #1146

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
23 commits
Select commit Hold shift + click to select a range
7042674
Update sample app to receive input args on Android (required for test…
tustanivsky Nov 11, 2025
6e34b25
Add Android integration tests to CI
tustanivsky Nov 11, 2025
588aada
Comment crash capturing test
tustanivsky Nov 11, 2025
c82a55e
Fix test script
tustanivsky Nov 12, 2025
6b14d0a
Fix minor issues
tustanivsky Nov 12, 2025
a7bb5e3
Rename vars
tustanivsky Nov 12, 2025
7b3ab68
Clean up
tustanivsky Nov 12, 2025
a47a7ea
Better comments
tustanivsky Nov 12, 2025
35c488b
Refactor
tustanivsky Nov 12, 2025
297cf36
Fix workflow
tustanivsky Nov 12, 2025
d62218d
Fix
tustanivsky Nov 12, 2025
35862ce
Simplify mechanism to pass input args to Android app
tustanivsky Nov 13, 2025
3bc3f33
Clean up comments
tustanivsky Nov 13, 2025
281af4a
Merge branch 'main' into chore/android-tests
tustanivsky Nov 20, 2025
c9079bc
Test SauceLabs
tustanivsky Nov 20, 2025
957c826
Add separate SauceLabs test script
tustanivsky Nov 21, 2025
11d997a
Fix log retrieval
tustanivsky Nov 21, 2025
f87da41
Fix
tustanivsky Nov 21, 2025
4ea1b22
Rename script for running Android integration tests locally
tustanivsky Nov 21, 2025
d09d95e
Update readme
tustanivsky Nov 21, 2025
89c6014
Revert CI tweaks for faster iterations
tustanivsky Nov 21, 2025
b99f9a6
Clean up
tustanivsky Nov 21, 2025
4c7547b
Fix
tustanivsky Nov 21, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
12 changes: 12 additions & 0 deletions .github/workflows/ci.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -198,3 +198,15 @@ jobs:
uses: ./.github/workflows/integration-test-windows.yml
with:
unreal-version: ${{ matrix.unreal }}

integration-test-android:
needs: [test-android]
name: Android UE ${{ matrix.unreal }}
secrets: inherit
strategy:
fail-fast: false
matrix:
unreal: ['5.4', '5.5', '5.6', '5.7']
uses: ./.github/workflows/integration-test-android.yml
with:
unreal-version: ${{ matrix.unreal }}
55 changes: 55 additions & 0 deletions .github/workflows/integration-test-android.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,55 @@
on:
workflow_call:
inputs:
unreal-version:
required: true
type: string

jobs:
integration-test:
name: Integration Test
runs-on: ubuntu-latest

env:
SAUCE_USERNAME: ${{ secrets.SAUCE_USERNAME }}
SAUCE_ACCESS_KEY: ${{ secrets.SAUCE_ACCESS_KEY }}
GITHUB_TOKEN: ${{ github.token }}
SAUCE_REGION: eu-central-1

steps:
- uses: actions/checkout@v4
with:
submodules: recursive

- name: Download sample build
uses: actions/download-artifact@v4
with:
name: UE ${{ inputs.unreal-version }} sample build (Android)
path: sample-build

- name: Install Pester
shell: pwsh
run: Install-Module -Name Pester -Force -SkipPublisherCheck
Comment on lines +30 to +32
Copy link
Collaborator

@vaind vaind Nov 21, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pester: 5.7.1 is already installed in GH, have you had issues without this step?

https://github.com/actions/runner-images/blob/main/images/ubuntu/Ubuntu2404-Readme.md#powershell-modules


- name: Run integration tests
id: run-integration-tests
shell: pwsh
env:
SENTRY_UNREAL_TEST_DSN: ${{ secrets.SENTRY_UNREAL_TEST_DSN }}
SENTRY_AUTH_TOKEN: ${{ secrets.SENTRY_API_TOKEN }}
SENTRY_UNREAL_TEST_APP_PATH: ${{ github.workspace }}/sample-build/SentryPlayground-arm64.apk
UNREAL_VERSION: ${{ inputs.unreal-version }}
run: |
cd integration-test
mkdir build
cmake -B build -S .
Invoke-Pester Integration.Tests.Android.SauceLabs.ps1 -CI
Comment on lines +34 to +46
Copy link
Collaborator

@vaind vaind Nov 21, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

maybe a bit cleaner (move working dir to param and remove unnecessary mkdir)

Suggested change
- name: Run integration tests
id: run-integration-tests
shell: pwsh
env:
SENTRY_UNREAL_TEST_DSN: ${{ secrets.SENTRY_UNREAL_TEST_DSN }}
SENTRY_AUTH_TOKEN: ${{ secrets.SENTRY_API_TOKEN }}
SENTRY_UNREAL_TEST_APP_PATH: ${{ github.workspace }}/sample-build/SentryPlayground-arm64.apk
UNREAL_VERSION: ${{ inputs.unreal-version }}
run: |
cd integration-test
mkdir build
cmake -B build -S .
Invoke-Pester Integration.Tests.Android.SauceLabs.ps1 -CI
- name: Run integration tests
id: run-integration-tests
shell: pwsh
working-directory: integration-test
env:
SENTRY_UNREAL_TEST_DSN: ${{ secrets.SENTRY_UNREAL_TEST_DSN }}
SENTRY_AUTH_TOKEN: ${{ secrets.SENTRY_API_TOKEN }}
SENTRY_UNREAL_TEST_APP_PATH: ${{ github.workspace }}/sample-build/SentryPlayground-arm64.apk
UNREAL_VERSION: ${{ inputs.unreal-version }}
run: |
cmake -B build -S .
Invoke-Pester Integration.Tests.Android.SauceLabs.ps1 -CI

Copy link
Collaborator

@vaind vaind Nov 21, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Also, invoke-pester assumes files are named "*.Tests.ps1" so the filename should be Android.Adb.Tests.ps1 or similar. In this case it doesn't matter because you're specifying the exact path, but if you wanted to run all integration tests locally, calling invoke-pester integration-test would only pick up files ending with ".Tests.ps1"


- name: Upload integration test output
if: ${{ always() }}
uses: actions/upload-artifact@v4
with:
name: UE ${{ inputs.unreal-version }} integration test output (Android)
path: |
integration-test/output/
retention-days: 14
Loading