288cbf4a80
Clean up null-ability of incoming message entity fields
2022-02-17 13:23:48 -08:00
73fa3c3fe4
Add test for content length validation
2022-02-17 13:23:48 -08:00
579eb85175
Reject invalid envelope types
2022-02-17 13:23:48 -08:00
baaae6cd9f
Add `@NotNull` to controller args where appropriate
...
Notably, `@Valid` doesn't imply `@NotNull`
2022-02-10 11:57:04 -06:00
ed398aa7b9
Add `DeviceCapabilities.pni`
2022-02-09 15:56:01 -08:00
41bf2b2c42
Add a binary format for incoming messages
...
The existing, general incoming message endpoint accepts messages as
JSON strings containing base64 data, along with all the metadata as
other JSON keys. That's not very efficient, and we don't make use of
that full generality anyway. This commit introduces a new binary
format that supports everything we're using from the old format (with
the help of some query parameters like multi-recipient messages).
2022-02-07 16:05:03 -08:00
639d634426
Restore displaced UUID from deleted accounts table when present
2022-01-31 13:01:36 -08:00
05e7c98620
Return an `AccountIdentityResponse` when changing phone numbers
2022-01-26 14:44:53 -05:00
1f1d618dea
Rename `AccountCreationResult` to `AccountIdentityResponse` (since it's not just for account creation any more)
2022-01-26 14:44:53 -05:00
b18117ef89
Add tests for unidentified access when requesting profiles
2022-01-25 14:07:44 -05:00
f69db11f42
Drop some unused dynamic configuration properties
2022-01-21 18:46:37 -05:00
96a680dcf0
Remove displaced account from directory when changing numbers
2022-01-21 18:46:11 -05:00
c612663490
Handle `null` `AccountAttributes` when verifying linked devices
2022-01-14 14:47:46 -05:00
146655e997
Add a "sameAvatar" flag to CreateProfileRequest
...
If sameAvatar is set (and "avatar" is also set), the avatar field for
a profile will be copied from the existing profile. This saves S3
churn and client bandwidth.
2022-01-04 13:57:41 -08:00
bb27dd0c3b
Migrate from `Object[]` parameters to `Stream<Arguments>`
2022-01-03 15:10:02 -08:00
d7a3c12bbe
Drop unused DynamoDB class rules
2022-01-03 15:10:02 -08:00
a1e84f5a88
Migrate service tests to JUnit 5
2022-01-03 15:10:02 -08:00
b758737907
Migrate remaining JUnit 4 Redis cluster tests to `RedisClusterExtension`
...
* Increase redis cluster initialization wait to 10 seconds
* Move to JUnit 5 `Assumptions`
2022-01-03 14:59:39 -08:00
3e777df86c
Timeout `sendNextMessagePage` after 5 minutes
2021-12-20 11:31:11 -08:00
278b4e810d
Add (failing) test for send message timeouts
2021-12-20 11:31:11 -08:00
5baa51d547
Migrate challenge-issuing configuration into the abusive message filter module
2021-12-16 12:22:19 -05:00
616db337e1
Remove an old rate limiting feature flag
2021-12-16 12:22:19 -05:00
3895871462
Repair missing PNIs in JSON blobs on account load
2021-12-16 11:17:51 -05:00
a87b84fbe2
Return an empty response if somebody requests a profile key credential with a non-existent version
2021-12-16 10:30:55 -05:00
e611a70ba4
Remove usernames from profile responses
2021-12-15 15:53:47 -05:00
66845d7080
Refactor: separate the various types of profile responses
2021-12-15 15:53:47 -05:00
4ea7278c6f
Remove unversioned profile properties from `Account` entities
2021-12-15 15:53:47 -05:00
2b2e26f14b
Remove deprecated, unversioned profile setters
2021-12-15 15:53:47 -05:00
0ce87153e5
Remove second database for `AbusiveHostRules`
2021-12-08 16:03:02 -08:00
dba1711e8d
Convert `AbusiveHostRule` to a record
2021-12-08 14:43:21 -08:00
a70b057e1c
Add second (migration) database to `AbusiveHostRules`
2021-12-08 12:46:05 -08:00
3df143dd3d
Switch to zonky test embedded postgres and use postgres 11.13.0
2021-12-03 16:07:07 -05:00
d0ad580c7d
Add (failing!) tests for getting a profile key credentials for somebody else
2021-12-03 16:06:26 -05:00
20a71b7df2
Add tests for generating profile key credentials
2021-12-03 12:16:13 -05:00
31e5058b15
Make temporary iOS envelope type adaptation a little wider
2021-12-03 12:06:31 -05:00
14cff958e9
Migrate challenge-issuing rate limiters to the abusive message filter
2021-12-03 11:52:58 -05:00
9628f147f1
Separate statically- and dynamically-configured rate limiters
2021-12-03 11:01:15 -05:00
13e346d4eb
Distinguish local vs remote in `ClientPresenceManager#disconnectPresence`
2021-12-02 14:32:42 -08:00
401953313a
Remove all vestiges of the relational account database
2021-12-02 12:46:43 -05:00
4d2403d619
Use `assertTimeoutPreemptively` instead of `assertTimeout`
2021-12-02 12:17:08 -05:00
c5f261305d
Store destination UUIDs when persisting messages to DynamoDB
2021-12-02 12:17:08 -05:00
394f58f6cc
Add a (failing!) check for destination UUIDs
2021-12-02 12:17:08 -05:00
674bf1b0e0
Drop a myserious empty test
2021-12-02 12:17:08 -05:00
e23a1fac50
Remove old Postgres-backed remote config machinery
2021-12-02 12:16:43 -05:00
efb410444b
Introduce a username validator
2021-12-02 12:02:29 -05:00
23bc11f3b6
Introduce a DynamoDB-backed remote config store
2021-12-02 11:13:07 -05:00
4eb7dde1c8
Migrate RemoteConfigsTest to Junit 5
2021-12-02 11:13:07 -05:00
064861b930
Consolidate profiles store tests and discard `ProfilesStore` interface
2021-12-02 10:49:54 -05:00
afa910bbd7
Drop relational profiles store
2021-12-02 10:49:54 -05:00
6aceb24fd2
Drop profile migration tools
2021-12-02 10:49:54 -05:00
d94e86781f
Migrate username storage from a relational database to DynamoDB
2021-12-01 16:50:18 -05:00
f7ff8e3837
Add a (failing!) test for deleting, then resetting profiles
2021-12-01 11:59:18 -05:00
048e17c62b
Use a memoizing supplier instead of a looping thread to cache remote config entries
2021-11-30 16:35:42 -07:00
d89b4f7e95
Compare versioned profiles synchronously; log a subset of mismatches for further investigation
2021-11-30 16:35:29 -07:00
65b49b2d9c
Use a "for each" strategy in profile migration methods
2021-11-24 16:54:30 -05:00
9e7010f185
Migrate profiles from a relational database to DynamoDB
2021-11-24 14:48:41 -05:00
3bb8e5bb00
Set a TTL for `Account` entries in the general cache
2021-11-24 14:47:36 -05:00
ebf24fb125
Add a (failing!) test for clients omitting badges in profile update requests
2021-11-24 13:47:39 -05:00
6919354520
Fix a counting bug with reported messages
2021-11-23 17:28:39 -05:00
a42fe9bfb0
Add crawler names to log messages
2021-11-23 16:22:09 -05:00
c910fa406d
Migrate reserved usernames from a relational database to DynamoDB
2021-11-23 16:21:03 -05:00
71dd0890de
Restore an accidentally-removed PNI consistency check
2021-11-23 10:53:40 -05:00
067aee6664
Remove unused properties from `OutgoingMessageEntity`
2021-11-22 15:43:09 -05:00
138a2ebbd0
Drop transactional logic from phone number identifier migration
2021-11-22 15:32:24 -05:00
296f6a7a88
Make phone number identifiers non-optional
2021-11-22 15:32:24 -05:00
069ffa9921
Drop PNI migration tools
2021-11-22 15:32:24 -05:00
0bbd34d060
Use text blocks where possible
2021-11-22 15:30:31 -05:00
caba110266
Revert "Revert "Remove transparent SVG for badging""
...
This reverts commit 0fdb23c1e9
2021-11-18 10:23:09 -06:00
0fdb23c1e9
Revert "Remove transparent SVG for badging"
...
This reverts commit 13a84f0c72
2021-11-18 10:09:34 -06:00
13a84f0c72
Remove transparent SVG for badging
2021-11-18 10:04:42 -06:00
7ea43a728d
Set boost description from configuration
2021-11-16 17:21:57 -06:00
71b38356b1
Update to Mockito 4.0.0
2021-11-16 15:56:35 -07:00
f89a20dbc7
Allow callers to set/retrieve keys by ACI or PNI
2021-11-16 15:08:10 -05:00
3a4c5a2bfb
Store and retrieve one-time pre-keys by UUID
2021-11-16 15:08:10 -05:00
5e1334e8de
s/KeysDynamoDb/Keys/
2021-11-16 15:08:10 -05:00
fa6e3d3690
Allow clients to request PNI-based group credentials
2021-11-16 15:08:10 -05:00
9383e7716b
Resolve `CertificateControllerTest` warnings and recommendations
2021-11-16 15:08:10 -05:00
cfe34fbf0f
Allow unsealed-sender messages to be addressed by PNI
2021-11-16 15:08:10 -05:00
975f753c2b
Add an endpoint for testing whether an account with a given ACI or PNI exists
2021-11-16 15:08:10 -05:00
e6237480f8
Require that unidentified access keys be exactly 16 bytes
2021-11-16 15:08:10 -05:00
26f876a2cb
Check service configurations in verify phase
2021-11-16 11:43:07 -07:00
ab9e6ac48a
Revert "Replace zkgroup with libsignal-client"
...
This reverts commit 73ea6e4251
2021-11-16 11:35:10 -05:00
c1d6c04ab2
Revert "Replace curve25519-java with libsignal-client"
...
This reverts commit 0011b8925b
2021-11-16 11:35:10 -05:00
888cec3d56
Introduce a filter for correcting numeric "online" flags
2021-11-16 10:15:14 -05:00
1461bcc2c2
Correct envelope types for certain iOS builds
2021-11-16 10:15:14 -05:00
11f1cf80bd
Move `MessageControllerTest` out of the `tests` sub-package to expose package-private elements from the class under test
2021-11-16 10:15:14 -05:00
c675cc8b26
Test the response code for invalid serialized zkgroup objects
...
Test by Jon, making sure this is consistent even without up-front size
checking.
2021-11-16 09:52:38 -05:00
0011b8925b
Replace curve25519-java with libsignal-client
...
These APIs stemmed from a common source long ago, so there's not much
to change!
2021-11-16 09:52:38 -05:00
73ea6e4251
Replace zkgroup with libsignal-client
2021-11-16 09:52:38 -05:00
2015ba77ca
Switch to a disallowed prefix model instead of a disallowed country code model
2021-11-15 15:44:55 -05:00
cbdec0cb22
Remove legacy push latency measurement pathways
2021-11-11 15:44:07 -05:00
de6e9d31c9
Add dedicated crawler for directory reconciler
2021-11-11 13:38:13 -07:00
f0a6be32fc
Add a crawler to assign PNIs to existing accounts
2021-11-10 11:15:05 -05:00
aaa2a6eef1
Break down push latency metrics by VOIP/not-VOIP and optionally by client version
2021-11-10 10:35:41 -05:00
b1f56c3324
Resolve formatting complaints
2021-11-10 10:15:14 -05:00
da5c0ae4b6
Enable Payments Beta for more country codes
2021-11-10 10:15:14 -05:00
1e1394560d
Check length of cancellation reason list before getting reason codes
2021-11-09 11:42:44 -05:00
bae0196bcf
Tolerate null UUID attribute values
2021-11-09 11:00:27 -05:00
3398955c1a
Add basic support for phone number identifiers
2021-11-09 10:23:08 -05:00
0a4392f700
Streamline `ExternalServiceCredentialsGenerator` construction
2021-11-08 14:30:52 -07:00
eb86986cf4
Add /v2/directory/auth endpoint
2021-11-08 14:30:52 -07:00
99b1f48e0e
Copy badges from existing account on re-reg
2021-11-04 18:00:47 -05:00
c931103712
Remove unused utility classes
2021-11-01 10:51:47 -04:00
a52c91a665
Add names to subscription levels
2021-10-28 14:48:44 -07:00
94bf3a3902
Extract logic for created header controlled resource bundles
2021-10-28 14:26:53 -07:00
090d722b61
Add method to retrieve receipt credentials for a boost payment
2021-10-25 14:54:40 -07:00
72b52965b9
Expand definition of badge SVGs
2021-10-25 10:28:02 -07:00
ae7077c643
Refresh accounts from storage when checking for device state changes after requests
2021-10-22 14:02:28 -04:00
534c577f59
Enforce phone number normalization when creating accounts or changing numbers
2021-10-22 14:01:54 -04:00
7762afc497
Add a method for verifying that numbers are normalized in addition to being dialable
2021-10-22 14:01:54 -04:00
a3fe4b9980
Update/parameterize ValidNumberTest
2021-10-22 14:01:54 -04:00
07cd69ab34
Add endpoint for fetching boost amounts
2021-10-21 13:56:35 -05:00
3b764bed7a
Make `DynamicConfigurationManager` generic
2021-10-19 11:52:29 -04:00
c91d5c2fdb
Count reported messages per sender
2021-10-19 11:47:54 -04:00
c0837104cd
Bring badge configuration into levels information
2021-10-14 11:35:18 -05:00
fe21d014f7
Remove legacy rate-limiting tools
2021-10-14 11:43:18 -04:00
c379a3d297
Remove deprecated counters
2021-10-14 10:52:20 -04:00
eedeaaecee
Update rate-limiting for requests matching specific criteria
2021-10-14 10:42:16 -04:00
64eeb1e361
Move to using collections for sprites and svgs for badges
2021-10-13 23:25:39 -05:00
5f2656710c
Update badge configuration to new style
2021-10-13 22:58:57 -05:00
1af53f2612
Simplify getLevels API
2021-10-13 13:28:31 -05:00
bbde93a3c7
Enable unwrapping of CompletionStage
2021-10-13 11:46:20 -05:00
b01b76d78f
First pass at subscriptions API
...
This is an incomplete first pass at building the subscriptions API. More API endpoints are still to be added along with controller tests.
2021-10-12 21:23:20 -05:00
3c1705994d
Count accounts with non-normalized phone numbers
2021-10-11 10:13:08 -04:00
d2bc3c7360
Add dynamic configuration to disable directory reconciler
2021-10-04 14:38:47 -07:00
9734433f00
Use the default `SecureRandom` algorithm for tests
2021-10-04 11:37:32 -04:00
5bd08800bb
Remove public modifier from test class
2021-10-01 14:27:07 -05:00
3032415141
Add receipt redemption API to chat server
2021-10-01 12:44:47 -05:00
ba58a95a0f
Add support for changing phone numbers
2021-10-01 10:15:33 -04:00
aa4bd92fee
Lazy-load scripts; fall back to `eval` if `evalsha` returns `NOSCRIPT`
2021-09-29 16:08:17 -04:00
2383aaaa3d
Update ClusterLuaScript formatting
2021-09-29 16:08:17 -04:00
8359ef73f4
Cycle all connected websockets on any device or account enabled state change
2021-09-29 14:18:35 -04:00
e333cbd94d
Close websockets on account deletion
2021-09-29 14:11:16 -04:00
5189cbe5c7
apply editorconfig formatting
2021-09-29 10:31:39 -07:00
3e5087e60b
Remove obsolete ephemeral queue handling
2021-09-29 10:31:39 -07:00
559026933d
Add low and high detail svgs to badges
2021-09-27 17:00:09 -05:00
7864405efd
Remove single URL in favor of density based sprite sheets
2021-09-27 16:50:18 -05:00
041aed2d72
Remove zkgroup enabled flag
...
The last remnants of a time before zkgroup have been swept away.
2021-09-23 09:24:06 -05:00
98e41f9a37
Improve Redis exception handling
2021-09-22 10:31:39 -04:00
6a71d369e2
More Accounts cleanup
...
* Remove `AccountStore`
* Clean up `AccountsDynamoDb#delete`
* Rename `AccountsDynamoDb` → `Accounts`
* Remove unused configuration
* Move Accounts scan page size to static configuration
* Remove disabled tests and related methods
2021-09-21 15:25:16 -07:00
df5498e1c0
Add test for self badge fetching
2021-09-20 16:42:38 -05:00
44bc90e5ab
Return a badge with additional properties when fetching your own profile
2021-09-20 16:42:38 -05:00
17e8b77e88
Add unit test for setting badges
2021-09-20 16:41:09 -05:00
8011935a3b
Fix compilation issues created by constructor changes
2021-09-20 16:41:09 -05:00
537d61d5bd
Add badges to CreateProfileRequest
...
This will permit users to set the order and visibility of badges on
their profile.
2021-09-20 16:41:09 -05:00
09519ae942
Only retry websocket sending if the client is still connected
2021-09-20 14:24:07 -04:00
2a67b2e610
Remove Accounts Postgres
2021-09-20 11:10:24 -07:00
8161f55a82
Add dynamic configuration for setting Dynamo as primary
2021-09-17 13:28:45 -07:00
ecee189ad8
Add `AccountDatabaseCrawler.dedicatedDynamoMigrationCrawler`
2021-09-17 11:27:20 -07:00
c2ba8ab562
Identify receipt destinations by UUID instead of e164
2021-09-16 10:47:03 -04:00
83e0a19561
Migrate `MessagesDynamoDbRule` to `MessagesDynamoDbExtension`
2021-09-16 10:46:37 -04:00
6a5d475198
Add a "refresh websocket on number change" provider
2021-09-16 10:37:34 -04:00
49ccbba2e3
Generalize the "watch for websockets that need to be refreshed" listener
2021-09-16 10:37:34 -04:00
fb1f99da87
Add a method to enable a badge for all accounts
2021-09-16 09:28:21 -05:00
08c6a8c2e5
Add category to badges
2021-09-16 09:28:21 -05:00
ce3835e176
Rename id to name in the configuration
2021-09-16 09:28:21 -05:00
39f6eadbb9
Add test for add and remove badges
2021-09-16 09:28:21 -05:00
8a8e6e7b49
Rename name to id in the stored badge information and expose id in the profile endpoint
2021-09-16 09:28:21 -05:00
98a31d1474
Switch ProfileController to the actual badge converter
2021-09-16 09:28:21 -05:00
5b25e38e41
Ensure badges are in ordered collections
2021-09-15 16:20:15 -05:00
2fb400280b
Remove unused parameter from `deleteMessageByDestinationAndGuid`
2021-09-15 10:14:08 -07:00
79ad09524e
Implement the ProfileBadgeConverter interface
2021-09-15 10:32:20 -05:00
6304c84cdb
Add ContactDiscoveryWriterTest based on mock.
2021-09-13 15:20:21 -06:00
a51a7a0901
Add `MigrationMismatchedAccounts` to `AccountsManager`
2021-09-13 13:54:19 -07:00
372e131e25
Update `PaymentsControllerTest`
2021-09-13 09:58:42 -07:00
cd66a1ceb7
fix merge issue after 2021 Aug 15 commit d1735c7e57 ( #137 )
2021-09-13 09:39:11 -07:00
feb59deb28
Use BigDecimal instead of Double for currency rate calculations ( #134 )
...
use BigDecimal instead of double for accuracy
2021-09-10 16:15:57 -05:00
49489a6021
Re-check mismatched accounts after a delay, to avoid false positives from concurrent requests
2021-09-10 11:31:44 -07:00
8cd93d68e4
Add MetricsUtil
2021-09-10 11:31:44 -07:00
b91a69d8b3
Add asynchronous chunk pre-read to `AccountDatabaseCrawler`
2021-09-10 11:14:11 -07:00
23a076a204
Update `Account#getNextDeviceId` to not reuse disable device’s IDs
2021-09-10 10:48:48 -07:00
016141a05d
Add `DevicesHelper`
2021-09-10 10:48:48 -07:00
a064b25a14
Fix CDS writer to use AccountsManager.
2021-09-10 11:36:06 -06:00
bd40e32f3b
Send acceptable languages instead of request into the profile badge converter
2021-09-10 10:53:04 -05:00
539b62a829
Add request event listener that handles device.isEnabled changes
2021-09-08 13:11:09 -07:00
fc1465c05d
Wire up stored account badges to the profile endpoints
2021-09-07 15:51:29 -05:00
2059bb5ef8
Update test to handle read-then-write in ContactDiscoveryWriter.
2021-09-07 13:41:47 -06:00
b4aabd799b
Canonical discoverability writing.
2021-09-07 13:41:47 -06:00
92f035bc2a
Add a "change number" device/account capability
2021-09-07 15:07:30 -04:00
d1735c7e57
Retire `AmbiguousIdentifier`
2021-08-27 13:40:46 -04:00
a9339b7037
Update to Pushy 0.15.0
2021-08-27 11:52:29 -04:00
aeb9f67266
Migrate MessageSenderTest to JUnit 5
2021-08-25 12:25:10 -05:00
e08c5a412e
Insert ephemeral messages in the standard cache queue
2021-08-25 12:25:10 -05:00
dadf43b93e
Consolidate directory reconciliation on v3 endpoints
2021-08-19 14:18:38 -05:00
a398e2269c
Update `AccountsManager` mismatch comparison
2021-08-19 14:08:48 -05:00
5c68d83a93
Add integration test for re-registration with and without Dynamo DB
2021-08-19 14:05:21 -05:00
27844fe692
Add JUnit 5 RedisClusterExtension
2021-08-13 12:07:04 -05:00
d13741fbd5
Change from using parallel streams to using an ExecutorService
2021-08-12 12:05:01 -05:00
a46045d987
Remove unused methods that delete messages by sender and timestamp
2021-08-11 17:30:39 -05:00
662c905b80
Remove deprecated delete messages endpoint
...
DELETE /v1/messages/{source}/{timestamp} has been deprecated a long
time and has minimal usage each day at this point. Dropping support
for this endpoint to improve message cache storage flexibility.
2021-08-11 16:17:44 -05:00
31022aeb79
Use refreshing `AuthenticatedAccount` for `@Auth`
2021-08-11 14:52:25 -05:00
b3e6a50dee
Send 508 status code for legacy clients that produce rate limit challenges
2021-08-11 11:57:30 -05:00
d29764d11f
Only process updates for enabled devices in PushFeedbackProcessor
2021-08-11 11:54:42 -05:00
f58a320223
Remove unused method from MessagesCache
2021-08-10 10:02:04 -05:00
3e01bc1174
Add metric for content-length header distribution
2021-08-06 14:41:16 -05:00
73c368ea86
Use UUIDs instead of e164s to associate accounts with push notifications.
2021-08-04 14:38:28 -04:00
a680639718
Use UUIDs as rate limiter keys.
2021-08-04 14:15:21 -04:00
bcb89924b4
Simplify optimistic write logic
2021-08-03 11:54:26 -04:00
33fb7a72de
Use RecaptchaClient interface
2021-08-02 13:14:44 -05:00
2aaddd721f
Rename existing captcha client
2021-08-02 13:14:44 -05:00
Chris Eager