Update test deps

CHANGELOG.md

@@ -713,7 +713,7 @@
 * Fix an issue with Docker images causing the Rust dependencies to not be pinned correctly. Introduced in v1.68.0 (#14129)
 * Fix a bug introduced in Synapse 1.69.0rc1 which would cause registration replication requests to fail if the worker sending the request is not running Synapse 1.69. (#14135)
 * Fix error in background update when rotating existing notifications. Introduced in v1.69.0rc2. (#14138)
-* Allow application services to set the origin_server_ts of a state event by providing the query parameter ts in PUT /_matrix/client/r0/rooms/{roomId}/state/{eventType}/{stateKey}, per MSC3316. Contributed by @lukasdenk. (#11866)
+* Allow application services to set the origin_server_ts of a state event by providing the query parameter ts in PUT `/_matrix/client/r0/rooms/{roomId}/state/{eventType}/{stateKey}`, per MSC3316. Contributed by @lukasdenk. (#11866)
 * Allow server admins to require a manual approval process before new accounts can be used (using MSC3866). (#13556)
 * Exponentially backoff from backfilling the same event over and over. (#13635, #13936)
 * Add cache invalidation across workers to module API. (#13667, #13947)
@@ -721,7 +721,7 @@
 * Experimental support for thread-specific receipts (MSC3771). (#13782, #13893, #13932, #13937, #13939)
 * Add experimental support for MSC3881: Remotely toggle push notifications for another client. (#13799, #13831, #13860)
 * Keep track when an event pulled over federation fails its signature check so we can intelligently back-off in the future. (#13815)
-* Improve validation for the unspecced, internal-only _matrix/client/unstable/add_threepid/msisdn/submit_token endpoint. (#13832)
+* Improve validation for the unspecced, internal-only `_matrix/client/unstable/add_threepid/msisdn/submit_token` endpoint. (#13832)
 * Faster remote room joins: record when we first partial-join to a room. (#13892)
 * Support a dir parameter on the /relations endpoint per MSC3715. (#13920)
 * Ask mail servers receiving emails from Synapse to not send automatic replies (e.g. out-of-office responses). (#13957)
@@ -735,10 +735,172 @@
 * Fix packaging to include Cargo.lock in sdist. (#13909)
 * Fix a long-standing bug where device updates could cause delays sending out to-device messages over federation. (#13922)
 * Fix a bug introduced in v1.68.0 where Synapse would require setuptools_rust at runtime, even though the package is only required at build time. (#13952)
-* Fix a long-standing bug where POST /_matrix/client/v3/keys/query requests could result in excessively large SQL queries. (#13956)
+* Fix a long-standing bug where POST `/_matrix/client/v3/keys/query` requests could result in excessively large SQL queries. (#13956)
 * Fix a performance regression in the get_users_in_room database query. Introduced in v1.67.0. (#13972)
 * Fix a bug introduced in v1.68.0 bug where Rust extension wasn't built in release mode when using poetry install. (#14009)
 * Do not return an unspecified original_event field when using the stable /relations endpoint. Introduced in Synapse v1.57.0. (#14025)
 * Correctly handle a race with device lists when a remote user leaves during a partial join. (#13885)
 * Correctly handle sending local device list updates to remote servers during a partial join. (#13934)
 
+[1.53.0]
+* Update Synapse to 1.70.0
+* [Full changelog](https://github.com/matrix-org/synapse/releases/tag/v1.70.0)
+* Support for [MSC3856](https://github.com/matrix-org/matrix-spec-proposals/pull/3856): threads list API. ([\#13394](https://github.com/matrix-org/synapse/issues/13394), [\#14171](https://github.com/matrix-org/synapse/issues/14171), [\#14175](https://github.com/matrix-org/synapse/issues/14175))
+* Support for thread-specific notifications & receipts ([MSC3771](https://github.com/matrix-org/matrix-spec-proposals/pull/3771) and [MSC3773](https://github.com/matrix-org/matrix-spec-proposals/pull/3773)). ([\#13776](https://github.com/matrix-org/synapse/issues/13776), [\#13824](https://github.com/matrix-org/synapse/issues/13824), [\#13877](https://github.com/matrix-org/synapse/issues/13877), [\#13878](https://github.com/matrix-org/synapse/issues/13878), [\#14050](https://github.com/matrix-org/synapse/issues/14050), [\#14140](https://github.com/matrix-org/synapse/issues/14140), [\#14159](https://github.com/matrix-org/synapse/issues/14159), [\#14163](https://github.com/matrix-org/synapse/issues/14163), [\#14174](https://github.com/matrix-org/synapse/issues/14174), [\#14222](https://github.com/matrix-org/synapse/issues/14222))
+* Stop fetching missing `prev_events` after we already know their signature is invalid. ([\#13816](https://github.com/matrix-org/synapse/issues/13816))
+* Send application service access tokens as a header (and query parameter). Implements [MSC2832](https://github.com/matrix-org/matrix-spec-proposals/pull/2832). ([\#13996](https://github.com/matrix-org/synapse/issues/13996))
+* Ignore server ACL changes when generating pushes. Implements [MSC3786](https://github.com/matrix-org/matrix-spec-proposals/pull/3786). ([\#13997](https://github.com/matrix-org/synapse/issues/13997))
+* Experimental support for redirecting to an implementation of a [MSC3886](https://github.com/matrix-org/matrix-spec-proposals/pull/3886) HTTP rendezvous service. ([\#14018](https://github.com/matrix-org/synapse/issues/14018))
+* The `/relations` endpoint can now be used on workers. ([\#14028](https://github.com/matrix-org/synapse/issues/14028))
+* Advertise support for Matrix 1.3 and 1.4 on `/_matrix/client/versions`. ([\#14032](https://github.com/matrix-org/synapse/issues/14032), [\#14184](https://github.com/matrix-org/synapse/issues/14184))
+* Improve validation of request bodies for the [Device Management](https://spec.matrix.org/v1.4/client-server-api/#device-management) and [MSC2697 Device Dehyrdation](https://github.com/matrix-org/matrix-spec-proposals/pull/2697) client-server API endpoints. ([\#14054](https://github.com/matrix-org/synapse/issues/14054))
+* Experimental support for [MSC3874](https://github.com/matrix-org/matrix-spec-proposals/pull/3874): Filtering threads from the `/messages` endpoint. ([\#14148](https://github.com/matrix-org/synapse/issues/14148))
+* Improve the validation of the following PUT endpoints: [`/directory/room/{roomAlias}`](https://spec.matrix.org/v1.4/client-server-api/#put_matrixclientv3directoryroomroomalias), [`/directory/list/room/{roomId}`](https://spec.matrix.org/v1.4/client-server-api/#put_matrixclientv3directorylistroomroomid) and [`/directory/list/appservice/{networkId}/{roomId}`](https://spec.matrix.org/v1.4/application-service-api/#put_matrixclientv3directorylistappservicenetworkidroomid). ([\#14179](https://github.com/matrix-org/synapse/issues/14179))
+* Build and publish binary wheels for `aarch64` platforms. ([\#14212](https://github.com/matrix-org/synapse/issues/14212))
+
+[1.53.1]
+* Update Synapse to 1.70.1
+* [Full changelog](https://github.com/matrix-org/synapse/releases/tag/v1.70.1)
+* Fix a bug introduced in Synapse 1.70.0rc1 where the access tokens sent to application services as headers were malformed. Application services which were obtaining access tokens from query parameters were not affected. (#14301)
+* Fix room creation being rate limited too aggressively since Synapse v1.69.0. (#14314)
+
+[1.54.0]
+* Update Synapse to 1.71.0
+* [Full changelog](https://github.com/matrix-org/synapse/releases/tag/v1.71.0)
+
+[1.55.0]
+* Update Synapse to 1.72.0
+* [Full changelog](https://github.com/matrix-org/synapse/releases/tag/v1.72.0)
+* Add experimental support for MSC3912: Relation-based redactions. (#14260)
+* Add an Admin API endpoint for user lookup based on third-party ID (3PID). Contributed by @ashfame. (#14405)
+* Faster joins: include heroes' membership events in the partial join response, for rooms without a name or canonical alias. (#14442)
+
+[1.56.0]
+* Update Synapse to 1.73.0
+* Update Cloudron base image to 4.0.0
+* [Full changelog](https://github.com/matrix-org/synapse/releases/tag/v1.73.0)
+
+[1.57.0]
+* Update Synapse to 1.74.0
+* [Full changelog](https://github.com/matrix-org/synapse/releases/tag/v1.74.0)
+* Improve user search for international display names. ([\#14464](https://github.com/matrix-org/synapse/issues/14464))
+* Stop using deprecated `keyIds` parameter when calling `/_matrix/key/v2/server`. ([\#14490](https://github.com/matrix-org/synapse/issues/14490), [\#14525](https://github.com/matrix-org/synapse/issues/14525))
+* Add new `push.enabled` config option to allow opting out of push notification calculation. ([\#14551](https://github.com/matrix-org/synapse/issues/14551), [\#14619](https://github.com/matrix-org/synapse/issues/14619))
+* Advertise support for Matrix 1.5 on `/_matrix/client/versions`. ([\#14576](https://github.com/matrix-org/synapse/issues/14576))
+* Improve opentracing and logging for to-device message handling. ([\#14598](https://github.com/matrix-org/synapse/issues/14598))
+* Allow selecting "prejoin" events by state keys in addition to event types. ([\#14642](https://github.com/matrix-org/synapse/issues/14642))
+* Fix a long-standing bug where a device list update might not be sent to clients in certain circumstances. ([\#14435](https://github.com/matrix-org/synapse/issues/14435), [\#14592](https://github.com/matrix-org/synapse/issues/14592), [\#14604](https://github.com/matrix-org/synapse/issues/14604))
+* Suppress a spurious warning when `POST /rooms/<room_id>/<membership>/`, `POST /join/<room_id_or_alias`, or the unspecced `PUT /join/<room_id_or_alias>/<txn_id>` receive an empty HTTP request body. ([\#14600](https://github.com/matrix-org/synapse/issues/14600))
+* Return spec-compliant JSON errors when unknown endpoints are requested. ([\#14620](https://github.com/matrix-org/synapse/issues/14620), [\#14621](https://github.com/matrix-org/synapse/issues/14621))
+* Update html templates to load images over HTTPS. Contributed by @ashfame. ([\#14625](https://github.com/matrix-org/synapse/issues/14625))
+* Fix a long-standing bug where the user directory would return 1 more row than requested. ([\#14631](https://github.com/matrix-org/synapse/issues/14631))
+* Reject invalid read receipt requests with empty room or event IDs. Contributed by Nick @ Beeper (@fizzadar). ([\#14632](https://github.com/matrix-org/synapse/issues/14632))
+* Fix a bug introduced in Synapse 1.67.0 where not specifying a config file or a server URL would lead to the `register_new_matrix_user` script failing. ([\#14637](https://github.com/matrix-org/synapse/issues/14637))
+* Fix a long-standing bug where the user directory and room/user stats might be out of sync. ([\#14639](https://github.com/matrix-org/synapse/issues/14639), [\#14643](https://github.com/matrix-org/synapse/issues/14643))
+* Fix a bug introduced in Synapse 1.72.0 where the background updates to add non-thread unique indexes on receipts would fail if they were previously interrupted. ([\#14650](https://github.com/matrix-org/synapse/issues/14650))
+* Improve validation of field size limits in events. ([\#14664](https://github.com/matrix-org/synapse/issues/14664))
+* Fix bugs introduced in Synapse 1.55.0 and 1.69.0 where application services would not be notified of events in the correct rooms, due to stale caches. ([\#14670](https://github.com/matrix-org/synapse/issues/14670))
+
+[1.58.0]
+* Update Synapse to 1.75.0
+* [Full changelog](https://github.com/matrix-org/synapse/releases/tag/v1.75.0)
+* Fix race where calling /members or /state with an at parameter could fail for newly created rooms, when using multiple workers. (#14817)
+* Add a cached function to synapse.module_api that returns a decorator to cache return values of functions. (#14663)
+* Add experimental support for MSC3391 (removing account data). (#14714)
+* Support RFC7636 Proof Key for Code Exchange for OAuth single sign-on. (#14750)
+* Support non-OpenID compliant userinfo claims for subject and picture. (#14753)
+* Improve performance of /sync when filtering all rooms, message types, or senders. (#14786)
+* Improve performance of the /hierarchy endpoint. (#14263)
+* Fix the MAU Limits section of the Grafana dashboard relying on a specific job name for the workers of a Synapse deployment. (#14644)
+* Fix a bug introduced in Synapse 1.70.0 which could cause spurious UNIQUE constraint failed errors in the rotate_notifs background job. (#14669)
+* Ensure stream IDs are always updated after caches get invalidated with workers. Contributed by Nick @ Beeper (@Fizzadar). (#14723)
+* Remove the unspecced device field from /pushrules responses. (#14727)
+* Fix a bug introduced in Synapse 1.73.0 where the picture_claim configured under oidc_providers was unused (the default value of "picture" was used instead). (#14751)
+* Unescape HTML entities in URL preview titles making use of oEmbed responses. (#14781)
+* Disable sending confirmation email when 3pid is disabled. (#14725)
+
+[1.59.0]
+* Update Synapse to 1.76.0
+* [Full changelog](https://github.com/matrix-org/synapse/releases/tag/v1.76.0)
+* Faster joins: Fix a bug introduced in Synapse 1.69 where device list EDUs could fail to be handled after a restart when a faster join sync is in progress. (#14914)
+* Update the default room version to v10 (MSC 3904). Contributed by @FSG-Cat. (#14111)
+* Add a set_displayname() method to the module API for setting a user's display name. (#14629)
+* Add a dedicated listener configuration for health endpoint. (#14747)
+* Implement support for MSC3890: Remotely silence local notifications. (#14775)
+* Implement experimental support for MSC3930: Push rules for (MSC3381) Polls. (#14787)
+* Per MSC3925, bundle the whole of the replacement with any edited events, and optionally inhibit server-side replacement. (#14811)
+* Faster joins: always serve a partial join response to servers that request it with the stable query param. (#14839)
+* Faster joins: allow non-lazy-loading ("eager") syncs to complete after a partial join by omitting partial state rooms until they become fully stated. (#14870)
+* Faster joins: request partial joins by default. Admins can opt-out of this for the time being---see the upgrade notes. (#14905)
+
+[1.60.0]
+* Update Synapse to 1.77.0
+* [Full changelog](https://github.com/matrix-org/synapse/releases/tag/v1.77.0)
+* Fix bug where retried replication requests would return a failure. Introduced in v1.76.0. ([\#15024](https://github.com/matrix-org/synapse/issues/15024))
+
+[1.61.0]
+* Update Synapse to 1.78.0
+* [Full changelog](https://github.com/matrix-org/synapse/releases/tag/v1.78.0)
+* Implement the experimental `exact_event_match` push rule condition from MSC3758. (#14964)
+* Add account data to the command line user data export tool. (#14969)
+* Implement MSC3873 to disambiguate push rule keys with dots in them. (#15004)
+* Allow Synapse to use a specific Redis logical database in worker-mode deployments. (#15034)
+* Tag opentracing spans for federation requests with the name of the worker serving the request. (#15042)
+* Implement the experimental `exact_event_property_contains` push rule condition from MSC3966. (#15045)
+
+[1.62.0]
+* Update Synapse to 1.79.0
+* [Full changelog](https://github.com/matrix-org/synapse/releases/tag/v1.79.0)
+* Fix a bug introduced in Synapse 1.79.0rc1 where attempting to register a on_remove_user_third_party_identifier module API callback would be a no-op. (#15227)
+* Fix a rare bug introduced in Synapse 1.73 where events could remain unsent to other homeservers after a faster-join to a room. (#15248)
+* Add two new Third Party Rules module API callbacks: on_add_user_third_party_identifier and on_remove_user_third_party_identifier. (#15044)
+* Experimental support for MSC3967 to not require UIA for setting up cross-signing on first use. (#15077)
+* Add media information to the command line user data export tool. (#15107)
+* Add an admin API to delete a specific event report. (#15116)
+* Add support for knocking to workers. (#15133)
+* Allow use of the /filter Client-Server APIs on workers. (#15134)
+* Update support for MSC2677: remove support for server-side aggregation of reactions. (#15172)
+* Stabilise support for MSC3758: event_property_is push condition. (#15185)
+
+[1.62.1]
+* Update post installation message
+
+[1.63.0]
+* Update Synapse to 1.80.0
+* [Full changelog](https://github.com/matrix-org/synapse/releases/tag/v1.80.0)
+* Fix a bug in which the POST /_matrix/client/v3/rooms/{roomId}/report/{eventId} endpoint would return the wrong error if the user did not have permission to view the event. This aligns Synapse's implementation with MSC2249. (#15298, #15300)
+* Fix a bug introduced in Synapse 1.75.0rc1 where the SQLite port_db script
+* would fail to open the SQLite database. (#15301)
+* Stabilise support for MSC3966: event_property_contains push condition. (#15187)
+* Implement MSC2659: application service ping endpoint. Contributed by Tulir @ Beeper. (#15249)
+* Allow loading /register/available endpoint on workers. (#15268)
+* Improve performance of creating and authenticating events. (#15195)
+* Add topic and name events to group of events that are batch persisted when creating a room. (#15229)
+* Fix a long-standing bug in which the user directory would assume any remote membership state events represent a profile change. (#14755, #14756)
+* Implement MSC3873 to fix a long-standing bug where properties with dots were handled ambiguously in push rules. (#15190)
+* Faster joins: Fix a bug introduced in Synapse 1.66 where spurious "Failed to find memberships ..." errors would be logged. (#15232)
+* Fix a long-standing error when sending message into deleted room. (#15235)
+
+[1.64.0]
+* Update Synapse to 1.81.0
+* [Full changelog](https://github.com/matrix-org/synapse/releases/tag/v1.81.0)
+* Fix the set_device_id_for_pushers_txn background update crash. (#15391)
+* Add the ability to enable/disable registrations when in the OIDC flow. (#14978)
+* Add a primitive helper script for listing worker endpoints. (#15243)
+* Experimental support for passing One Time Key and device key requests to application services (MSC3983 and MSC3984). (#15314, #15321)
+* Allow loading /password_policy endpoint on workers. (#15331)
+* Add experimental support for Unix sockets. Contributed by Jason Little. (#15353)
+* Build Debian packages for Ubuntu 23.04 (Lunar Lobster). (#15381)
+* Fix a long-standing bug where edits of non-m.room.message events would not be correctly bundled. (#15295)
+* Fix a bug introduced in Synapse v1.55.0 which could delay remote homeservers being able to decrypt encrypted messages sent by local users. (#15297)
+* Add a check to SQLite port_db script
+* to ensure that the sqlite database passed to the script exists before trying to port from it. (#15306)
+* Fix a bug introduced in Synapse 1.76.0 where responses from worker deployments could include an internal _INT_STREAM_POS key. (#15309)
+* Fix a long-standing bug that Synpase only used the legacy appservice routes. (#15317)
+* Fix a long-standing bug preventing users from rejoining rooms after being banned and unbanned over federation. Contributed by Nico. (#15323)
+* Fix bug in worker mode where on a rolling restart of workers the "typing" worker would consume 100% CPU until it got restarted. (#15332)
+* Fix a long-standing bug where some to_device messages could be dropped when using workers. (#15349)
+* Fix a bug introduced in Synapse 1.70.0 where the background sync from a faster join could spin for hours when one of the events involved had been marked for backoff. (#15351)
+* Fix missing app variable in mail subject for password resets. Contributed by Cyberes. (#15352)
+* Fix a rare bug introduced in Synapse 1.66.0 where initial syncs would fail when the user had been kicked from a faster joined room that had not finished syncing. (#15383)
+

CloudronManifest.json

@@ -5,8 +5,8 @@
   "description": "file://DESCRIPTION.md",
   "changelog": "file://CHANGELOG.md",
   "tagline": "Secure & decentralized communication",
-  "version": "1.52.0",
+  "version": "1.64.0",
-  "upstreamVersion": "1.69.0",
+  "upstreamVersion": "1.81.0",
   "healthCheckPath": "/",
   "httpPort": 8008,
   "memoryLimit": 536870912,

Dockerfile

@@ -1,4 +1,4 @@
-FROM cloudron/base:3.2.0@sha256:ba1d566164a67c266782545ea9809dc611c4152e27686fd14060332dd88263ea
+FROM cloudron/base:4.0.0@sha256:31b195ed0662bdb06a6e8a5ddbedb6f191ce92e8bee04c03fb02dd4e9d0286df
 
 RUN mkdir -p /app/pkg
 
@@ -9,15 +9,18 @@ RUN virtualenv -p python3 /app/code/env
 ENV VIRTUAL_ENV=/app/code/env
 ENV PATH="$VIRTUAL_ENV/bin:$PATH"
 
-ARG VERSION=v1.69.0
+ARG VERSION=v1.81.0
+
+# https://github.com/matrix-org/synapse-s3-storage-provider
+ARG STORAGE_PROVIDER_VERSION=fa27fa1a92bcbeb42b10399641348bee0ddf2c72
 
 # Synapse (https://github.com/matrix-org/synapse/blob/master/INSTALL.md)
 # lxml - required for previews
 RUN pip install --upgrade pip && \
     pip install --upgrade setuptools && \
-    pip install matrix-synapse==${VERSION} psycopg2-binary python-ldap matrix-synapse-ldap3 lxml publicsuffix2 git+https://github.com/matrix-org/synapse-s3-storage-provider.git@ffd3fa477321608e57d27644197e721965e0e858 matrix-synapse[oidc]
+    pip install matrix-synapse==${VERSION} psycopg2-binary python-ldap matrix-synapse-ldap3 lxml publicsuffix2 git+https://github.com/matrix-org/synapse-s3-storage-provider.git@${STORAGE_PROVIDER_VERSION} matrix-synapse[oidc]
 
-RUN ln -sf /app/data/index.html /app/code/env/lib/python3.8/site-packages/synapse/static/index.html
+RUN ln -sf /app/data/index.html /app/code/env/lib/python3.10/site-packages/synapse/static/index.html
 
 RUN chown -R cloudron.cloudron /app/code
 

POSTINSTALL.md

@@ -1,5 +1,5 @@
 Account ids are created with the username and the second level domain under which the
-app is installed e.g. `@$CLOUDRON-USERNAME@$CLOUDRON-APP-DOMAIN`.
+app is installed e.g. `@$CLOUDRON-USERNAME:$CLOUDRON-APP-DOMAIN`.
 
 For federation to work, the delegation URI `https://$CLOUDRON-APP-DOMAIN/.well-known/matrix/server`
 must be configured. See the [docs](https://docs.cloudron.io/apps/synapse/#post-installation) on how to do this.

test/package.json

@@ -9,11 +9,10 @@
   "author": "",
   "license": "ISC",
   "dependencies": {
-    "chromedriver": "^106.0.1",
+    "chromedriver": "^112.0.0",
     "expect.js": "^0.3.1",
-    "mocha": "^10.1.0",
+    "mocha": "^10.2.0",
-    "selenium-server-standalone-jar": "^3.141.59",
+    "selenium-webdriver": "^4.8.2",
-    "selenium-webdriver": "^4.5.0",
+    "superagent": "^8.0.9"
-    "superagent": "^8.0.0"
   }
 }