Commit Graph

40 Commits

Author SHA1 Message Date
renovate[bot]
62a8414a60 Update actions/checkout action to v5 (#4401)
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2025-08-11 18:00:27 +01:00
Doug
8bc97b6585 Run Xcode select on the Translations and CalVer workflows. (#4224)
* Run Xcode select on the Translations and CalVer workflows.

* Use ci_common.sh for xcode-select instead.
2025-06-18 16:53:32 +01:00
renovate[bot]
937747bb5e Update codecov/test-results-action action to v1.1.1 2025-05-23 09:35:44 +03:00
Doug
f1b0ca7739 Run the UI & Integration tests once a day instead of twice with a 6 hour offset. (#4086) 2025-05-02 13:12:49 +01:00
Mauro Romito
72fa104fca run integration tests on gh ci
possible fix

possible fix

Revert "possible fix"

This reverts commit 6484648153bf8f05485050f544b136e6ca9f0be9.

Revert "possible fix"

This reverts commit abb3a58c630bb0abab7c86a31be022496d4f3b4c.

possible fix

possible solution using ui interrupt monitor

Revert "possible solution using ui interrupt monitor"

This reverts commit ed28c85a37744e615c4bc464b3e8962d8c953be9.

possible fix

Revert "possible fix"

This reverts commit 43039e73c1e1b70493f2e22aa20f925257d2e6de.

fix
2025-04-29 13:42:09 +02:00
Stefan Ceriu
c57ff34b13 Revert codecov/codecov-action changes and add allowedVersions renovate rule. 2025-03-24 13:37:17 +02:00
renovate[bot]
4552e9ba3f Update GitHub Actions to v5 2025-03-24 13:37:17 +02:00
renovate[bot]
6825e21e0f Update codecov/codecov-action action to v3.1.6 2025-03-19 08:39:11 +02:00
Stefan Ceriu
a6daebfe59 Pin all 3rd party github actions to their full length commit SHA
- this is the recommended security practice as per https://docs.github.com/en/actions/security-for-github-actions/security-guides/security-hardening-for-github-actions#using-third-party-actions
2025-03-19 08:22:09 +02:00
Stefan Ceriu
21d3376b31 Switch codecov-Action@v3 to v0.7.3 so it runs on Intel macs 2024-09-30 11:59:08 +03:00
Stefan Ceriu
ac92187c12 Switch the integration tests to the perf-only runner 2024-09-30 11:59:08 +03:00
Stefan Ceriu
e918dc66ae Tracing and integration test tweaks (#3336)
* Disable image and document picker integration tests as they randomly fail to load and are flakey.

* Delete any pre-existing log files

* Various tracing tweaks and fixes:
- delete the custom tracing log levels as we can't control their ouput
- implement comparable on them
- change default levels only if the new chosen level increases their verbosity

* Make logging targets mandatory and fix their logging levels

* Switch back to using the `run_tests` reset simulator flag as `fastlane snapshot reset_simulators` was too generic and slow

* Switch all integration test taps to `tapCenter` (nee forceTap) after noticing missed taps on CI.

* Make the logging file prefix explicit, let the main app not use one.

* Rename tracing configuration `target` to `currentTarget`
2024-09-27 15:08:47 +03:00
Doug
0274cf3cd5 Start fixing flakey tests ❄️ (#3329)
* Wait longer on authentication flow tests.

* Move default perceptualPrecision value into the snapshot preferences.

* Delay snapshots *before* setting up the test.

* Reset the simulators on GitHub before running?

* Remove a test that is now handled by Rust.

* Fix a test that was yielding.
2024-09-26 16:09:01 +01:00
Stefan Ceriu
79e3758887 Integration test improvements (#3330)
* Send a message from integration tests and check that it doesn't show up in the app logs
* Increase photo library timeout

* Wait for image tapping to process

* Send a message using the rich text editor too

* Wait for the various pickers to finish loading

* Set all logs to `trace` in integration tests

* Close formatting options after sending the second message

* Make sure logs are actually sent to tracing and get redirected to the right file

* Switch from using a custom `trace` log configuration to the lowest level `TracingConfiguration` we support
2024-09-26 10:15:09 +03:00
Stefan Ceriu
8268b7fb5f Try to stop random codecov test result action failures from failing the whole test run. 2024-09-18 15:22:34 +03:00
Doug
c9d77de71c Try uploading test results to Codecov. (#3266) 2024-09-12 07:09:15 +01:00
Stefan Ceriu
7d616019a7 Switch codecov-action back to v3 as 4 significantly decreases coverage
- previously seen in https://github.com/element-hq/element-x-ios/pull/2727
2024-09-10 11:55:18 +03:00
Stefan Ceriu
7725c73860 Stop running and publishing performance metrics to gh-pages 2024-09-05 13:49:56 +03:00
renovate[bot]
de51b17d83 Update GitHub Actions 2024-09-03 18:21:22 +03:00
Stefan Ceriu
94e22bfa0f Revert "Update GitHub Actions"
This reverts commit a48c7444ea.
2024-09-03 18:14:28 +03:00
renovate[bot]
a48c7444ea Update GitHub Actions 2024-09-03 15:50:57 +03:00
Doug
af7cba5b46 Run the integration tests on GitHub again. (#3052) 2024-07-17 10:16:43 +01:00
renovate[bot]
54654a918a Update actions/upload-artifact action to v4 2024-05-20 11:19:12 +01:00
renovate[bot]
07247d7076 Update actions/checkout action to v4 2024-05-20 11:14:18 +01:00
renovate[bot]
6a566da69e Update actions/cache action to v4 2024-05-20 11:11:46 +01:00
manuroe
fa7520c553 Codecov: Add token for codecov-action@v3 to fix coverage report (#2727)
Moving to v4 is blocked because of a fundamental issue with https://github.com/codecov/codecov-action/issues/1279 on our mac runners and because the reported coverage is [decreasing with v4](https://app.codecov.io/gh/element-hq/element-x-ios/pull/2719/flags)
2024-04-22 14:59:51 +02:00
Doug
8942bdcfe3 Use xcresultparser in all workflows. (#2510)
* Fix integration tests.
2024-02-28 18:01:20 +00:00
Doug
ac3b8b6ffd UI Tests fixes. (#1322)
* Fix broken UI tests and update snapshots.

* Tweak workflow.

* Update schedule and zip the result bundle.
2023-07-13 16:10:41 +01:00
Michael Kaye
d33b30676f Disabling automatic cancellation as it is affecting testing. (#1271) 2023-07-07 09:56:29 +01:00
Michael Kaye
aa748448a1 Stop asserting integration test run time & move to performance testing runner. (#1132)
* Stop asserting integration test run time.
* Move integration testing to the perf runner.
2023-06-23 13:44:33 +01:00
Michael Kaye
3a2e0b623f Parse output from IntegrationTests performance metrics (#1054)
* Parse output and leave as CSV on disk for later usage.
* Minor tweaks to step & file names

Co-authored-by: Stefan Ceriu <stefanc@matrix.org>
2023-06-09 08:44:50 +00:00
Mauro
79b9f54a66 Fixing Tests for Xcode 14.3 (#888)
* settting macOS to 13, and let's runa test of... the tests

* I want the artifacts of the test, might give me some more insight in Xcode

* archive artifact

* trying a thing with the xcode version

* push notifications alert makes this test fail

* test improvement

* let's try with a very long time

* let's disable autocorrection

* sleep

* 1 seconds fixed 90% of the issue, 2 should fix 100%

* waiting some more time in flaky tests and updated the content of a test that was failing

* updated a screenshot test that had a notification

* this integration test is a bit so flaky increased the timing

* controlled delay waited a bit moe for the timeline to settle

* try await

* MainActor everywhere

* milliseconds fix

* trying with a bit more waiting time after the tap and a slow velocity for the swipe

* let's try waiting more time
2023-05-15 13:42:40 +00:00
Stefan Ceriu
5620e32f8e Various test fixes (#873)
* Switch back to macos-12 and see if the tests work

* Fix unit tests, add default invited, joined and active member counts to the mock room proxy

* Try running UI tests on 14.3 but on an existing iPad simulator

* Revert "Try running UI tests on 14.3 but on an existing iPad simulator"

This reverts commit b075e7fa384330a9070dc35ed4dded57e0af26e1.
2023-05-11 16:28:35 +03:00
Stefan Ceriu
9c651ae6a3 Media uploading (#851)
* MediaUploadingPreprocessor - Prevent images without any GPS metadata from being changed

* Add support for sending images

* Add support for sending video, audio and file attachments

* Rename MediaPickerPreview to MediaUploadPreview

* Move media uploading to the MediaUploadPreviewScreen, add waiting indicators and error handling

* Add support for pasting and drag&dropping in media for upload

* Adopt new media picker source UI, remove developer flag

* Set minimum heights for timeline loadable images

* Fix invalid camera picker file names

* Fix flakey MediaUploadingPreprocessor image tests, improve gps metadata stripping

* UITests: Update existing screenshots and add new step for the room attachment picker

* Switch all github action runners to macos-13

* Cleanup enter key and paste message composer handlers
2023-05-04 16:09:29 +03:00
Stefan Ceriu
91cf139162 Project file removal (#569)
* Deleted project file

* Add back SPM Package.resolved + .gitignore

* Generate project file on release builds

* Converge on single CI setup scripts within `ci_scripts/ci_common.sh`

* Fix unit tests

* Use new `ci_common/setup_github_actions_environment` setup script on all workflows

* Move lfs validation check to the pre-commit hooks. Remove validate-lfs github actions workflow

* Fix integration tests workflow

* Tweaks following code review
2023-02-13 12:53:01 +00:00
Aleksandrs Proskurins
1ee5f7a18a Update codecov (#356)
* Exclude files that don't belong codecov

* Start tracking coverage from integration tests

* Added IntegrationTests to targets

* Pbxpoj file
2022-12-08 08:09:18 +00:00
Stefan Ceriu
c4822dd7fe Attempt fixing github workflows and prevent homebrew from updating ruby 2022-08-30 12:31:42 +03:00
Stefan Ceriu
9ca68176d5 Allow integration tests to actually run every night 2022-08-22 11:48:12 +03:00
Stefan Ceriu
702527aed6 Various CI fixes (#161)
* Update homebrew dependencies like on the other workflows. Fixes problems caused by buggy swiftformat prebundled on the github actions macos runner

* Removed UI tests from PR tests and running them on a schedule instead. Hopefuly fixed code coverage.

* Added back simulator versions as they need to match UI test snapshots

* Allow UI tests to run on this PR

* Added back skipped UI tests

* Fix danger sometimes not working on forks and disable integration tests on them
2022-08-19 17:42:03 +03:00
Stefan Ceriu
09daf52750 #49, #123 - Setup UI integration and performance testing (#148) 2022-08-18 16:32:29 +03:00