Commit Graph

56 Commits

Author SHA1 Message Date
Stefan Ceriu
0287611333 Manually pass in the coverage and test result report files and disable automatic search. 2025-12-16 17:57:30 +02:00
Stefan Ceriu
2714edf3d6 Stop running the coverage upload steps on failed or cancelled (i.e. non-successful) runs 2025-12-16 17:57:30 +02:00
Stefan Ceriu
89ba878ca6 Bump the codecov action from 3.1.6 to 5.5.2 2025-12-16 17:57:30 +02:00
Stefan Ceriu
16b5f7adca Converge on same comments and behaviours for forks and cancelled runs. 2025-12-16 17:57:30 +02:00
Stefan Ceriu
cc88353384 Remove unnecessary Codecov CLI version argument 2025-12-16 17:57:30 +02:00
Stefan Ceriu
9dc0b513c6 Replace the now deprecated codecov/test-results-action
As per https://github.com/codecov/test-results-action/pull/129
2025-12-16 17:57:30 +02:00
renovate[bot]
b66f7ff040 Update codecov/test-results-action action to v1.2.1 2025-12-16 08:53:19 +02:00
renovate[bot]
e23d6f2526 Update actions/upload-artifact action to v6 2025-12-13 09:41:59 +02:00
renovate[bot]
f6cdb10623 Update actions/cache action to v5 2025-12-12 09:30:05 +02:00
renovate[bot]
4ec364e215 Update actions/checkout action to v6 2025-11-21 14:56:18 +02:00
Stefan Ceriu
257c565f23 Switch the integration tests to the macos-26 runner
Fixes `No simulators found that are equal to the version of specifier (26.1) and greater than or equal to the version of deployment target (0)` errors
2025-11-21 11:14:06 +02:00
Doug
231185e673 Add timeouts to our GitHub actions. (#4669)
6 hours is way too long and eats up the runners.
2025-10-28 18:37:15 +00:00
renovate[bot]
6c9a8a7bfa Update actions/upload-artifact action to v5 2025-10-27 10:10:37 +01:00
Stefan Ceriu
0519ef9c9b Switch all workflow runners back to macos-15 in hope that it will require less ram and won't time out. 2025-09-29 12:37:28 +03:00
Stefan Ceriu
4e27af3c36 Fix integration tests for Xcode 26 2025-09-26 17:20:41 +03:00
Stefan Ceriu
8cdb36d887 Switch workflows to the macos-26 runner 2025-09-26 17:20:41 +03:00
renovate[bot]
62a8414a60 Update actions/checkout action to v5 (#4401)
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2025-08-11 18:00:27 +01:00
Doug
8bc97b6585 Run Xcode select on the Translations and CalVer workflows. (#4224)
* Run Xcode select on the Translations and CalVer workflows.

* Use ci_common.sh for xcode-select instead.
2025-06-18 16:53:32 +01:00
renovate[bot]
937747bb5e Update codecov/test-results-action action to v1.1.1 2025-05-23 09:35:44 +03:00
Doug
f1b0ca7739 Run the UI & Integration tests once a day instead of twice with a 6 hour offset. (#4086) 2025-05-02 13:12:49 +01:00
Mauro Romito
72fa104fca run integration tests on gh ci
possible fix

possible fix

Revert "possible fix"

This reverts commit 6484648153bf8f05485050f544b136e6ca9f0be9.

Revert "possible fix"

This reverts commit abb3a58c630bb0abab7c86a31be022496d4f3b4c.

possible fix

possible solution using ui interrupt monitor

Revert "possible solution using ui interrupt monitor"

This reverts commit ed28c85a37744e615c4bc464b3e8962d8c953be9.

possible fix

Revert "possible fix"

This reverts commit 43039e73c1e1b70493f2e22aa20f925257d2e6de.

fix
2025-04-29 13:42:09 +02:00
Stefan Ceriu
c57ff34b13 Revert codecov/codecov-action changes and add allowedVersions renovate rule. 2025-03-24 13:37:17 +02:00
renovate[bot]
4552e9ba3f Update GitHub Actions to v5 2025-03-24 13:37:17 +02:00
renovate[bot]
6825e21e0f Update codecov/codecov-action action to v3.1.6 2025-03-19 08:39:11 +02:00
Stefan Ceriu
a6daebfe59 Pin all 3rd party github actions to their full length commit SHA
- this is the recommended security practice as per https://docs.github.com/en/actions/security-for-github-actions/security-guides/security-hardening-for-github-actions#using-third-party-actions
2025-03-19 08:22:09 +02:00
Stefan Ceriu
21d3376b31 Switch codecov-Action@v3 to v0.7.3 so it runs on Intel macs 2024-09-30 11:59:08 +03:00
Stefan Ceriu
ac92187c12 Switch the integration tests to the perf-only runner 2024-09-30 11:59:08 +03:00
Stefan Ceriu
e918dc66ae Tracing and integration test tweaks (#3336)
* Disable image and document picker integration tests as they randomly fail to load and are flakey.

* Delete any pre-existing log files

* Various tracing tweaks and fixes:
- delete the custom tracing log levels as we can't control their ouput
- implement comparable on them
- change default levels only if the new chosen level increases their verbosity

* Make logging targets mandatory and fix their logging levels

* Switch back to using the `run_tests` reset simulator flag as `fastlane snapshot reset_simulators` was too generic and slow

* Switch all integration test taps to `tapCenter` (nee forceTap) after noticing missed taps on CI.

* Make the logging file prefix explicit, let the main app not use one.

* Rename tracing configuration `target` to `currentTarget`
2024-09-27 15:08:47 +03:00
Doug
0274cf3cd5 Start fixing flakey tests ❄️ (#3329)
* Wait longer on authentication flow tests.

* Move default perceptualPrecision value into the snapshot preferences.

* Delay snapshots *before* setting up the test.

* Reset the simulators on GitHub before running?

* Remove a test that is now handled by Rust.

* Fix a test that was yielding.
2024-09-26 16:09:01 +01:00
Stefan Ceriu
79e3758887 Integration test improvements (#3330)
* Send a message from integration tests and check that it doesn't show up in the app logs
* Increase photo library timeout

* Wait for image tapping to process

* Send a message using the rich text editor too

* Wait for the various pickers to finish loading

* Set all logs to `trace` in integration tests

* Close formatting options after sending the second message

* Make sure logs are actually sent to tracing and get redirected to the right file

* Switch from using a custom `trace` log configuration to the lowest level `TracingConfiguration` we support
2024-09-26 10:15:09 +03:00
Stefan Ceriu
8268b7fb5f Try to stop random codecov test result action failures from failing the whole test run. 2024-09-18 15:22:34 +03:00
Doug
c9d77de71c Try uploading test results to Codecov. (#3266) 2024-09-12 07:09:15 +01:00
Stefan Ceriu
7d616019a7 Switch codecov-action back to v3 as 4 significantly decreases coverage
- previously seen in https://github.com/element-hq/element-x-ios/pull/2727
2024-09-10 11:55:18 +03:00
Stefan Ceriu
7725c73860 Stop running and publishing performance metrics to gh-pages 2024-09-05 13:49:56 +03:00
renovate[bot]
de51b17d83 Update GitHub Actions 2024-09-03 18:21:22 +03:00
Stefan Ceriu
94e22bfa0f Revert "Update GitHub Actions"
This reverts commit a48c7444ea.
2024-09-03 18:14:28 +03:00
renovate[bot]
a48c7444ea Update GitHub Actions 2024-09-03 15:50:57 +03:00
Doug
af7cba5b46 Run the integration tests on GitHub again. (#3052) 2024-07-17 10:16:43 +01:00
renovate[bot]
54654a918a Update actions/upload-artifact action to v4 2024-05-20 11:19:12 +01:00
renovate[bot]
07247d7076 Update actions/checkout action to v4 2024-05-20 11:14:18 +01:00
renovate[bot]
6a566da69e Update actions/cache action to v4 2024-05-20 11:11:46 +01:00
manuroe
fa7520c553 Codecov: Add token for codecov-action@v3 to fix coverage report (#2727)
Moving to v4 is blocked because of a fundamental issue with https://github.com/codecov/codecov-action/issues/1279 on our mac runners and because the reported coverage is [decreasing with v4](https://app.codecov.io/gh/element-hq/element-x-ios/pull/2719/flags)
2024-04-22 14:59:51 +02:00
Doug
8942bdcfe3 Use xcresultparser in all workflows. (#2510)
* Fix integration tests.
2024-02-28 18:01:20 +00:00
Doug
ac3b8b6ffd UI Tests fixes. (#1322)
* Fix broken UI tests and update snapshots.

* Tweak workflow.

* Update schedule and zip the result bundle.
2023-07-13 16:10:41 +01:00
Michael Kaye
d33b30676f Disabling automatic cancellation as it is affecting testing. (#1271) 2023-07-07 09:56:29 +01:00
Michael Kaye
aa748448a1 Stop asserting integration test run time & move to performance testing runner. (#1132)
* Stop asserting integration test run time.
* Move integration testing to the perf runner.
2023-06-23 13:44:33 +01:00
Michael Kaye
3a2e0b623f Parse output from IntegrationTests performance metrics (#1054)
* Parse output and leave as CSV on disk for later usage.
* Minor tweaks to step & file names

Co-authored-by: Stefan Ceriu <stefanc@matrix.org>
2023-06-09 08:44:50 +00:00
Mauro
79b9f54a66 Fixing Tests for Xcode 14.3 (#888)
* settting macOS to 13, and let's runa test of... the tests

* I want the artifacts of the test, might give me some more insight in Xcode

* archive artifact

* trying a thing with the xcode version

* push notifications alert makes this test fail

* test improvement

* let's try with a very long time

* let's disable autocorrection

* sleep

* 1 seconds fixed 90% of the issue, 2 should fix 100%

* waiting some more time in flaky tests and updated the content of a test that was failing

* updated a screenshot test that had a notification

* this integration test is a bit so flaky increased the timing

* controlled delay waited a bit moe for the timeline to settle

* try await

* MainActor everywhere

* milliseconds fix

* trying with a bit more waiting time after the tap and a slow velocity for the swipe

* let's try waiting more time
2023-05-15 13:42:40 +00:00
Stefan Ceriu
5620e32f8e Various test fixes (#873)
* Switch back to macos-12 and see if the tests work

* Fix unit tests, add default invited, joined and active member counts to the mock room proxy

* Try running UI tests on 14.3 but on an existing iPad simulator

* Revert "Try running UI tests on 14.3 but on an existing iPad simulator"

This reverts commit b075e7fa384330a9070dc35ed4dded57e0af26e1.
2023-05-11 16:28:35 +03:00
Stefan Ceriu
9c651ae6a3 Media uploading (#851)
* MediaUploadingPreprocessor - Prevent images without any GPS metadata from being changed

* Add support for sending images

* Add support for sending video, audio and file attachments

* Rename MediaPickerPreview to MediaUploadPreview

* Move media uploading to the MediaUploadPreviewScreen, add waiting indicators and error handling

* Add support for pasting and drag&dropping in media for upload

* Adopt new media picker source UI, remove developer flag

* Set minimum heights for timeline loadable images

* Fix invalid camera picker file names

* Fix flakey MediaUploadingPreprocessor image tests, improve gps metadata stripping

* UITests: Update existing screenshots and add new step for the room attachment picker

* Switch all github action runners to macos-13

* Cleanup enter key and paste message composer handlers
2023-05-04 16:09:29 +03:00