fe21d014f7
Remove legacy rate-limiting tools
2021-10-14 11:43:18 -04:00
75c5032cd3
Add method to set default payment method
2021-10-14 10:37:12 -05:00
f84e7aebd0
Count numbers that can't be normalized because another account has the normalized form of the number
2021-10-14 11:10:12 -04:00
c379a3d297
Remove deprecated counters
2021-10-14 10:52:20 -04:00
eedeaaecee
Update rate-limiting for requests matching specific criteria
2021-10-14 10:42:16 -04:00
64eeb1e361
Move to using collections for sprites and svgs for badges
2021-10-13 23:25:39 -05:00
e07597eba7
Add initial text for donation badges
2021-10-13 23:08:02 -05:00
5f2656710c
Update badge configuration to new style
2021-10-13 22:58:57 -05:00
1af53f2612
Simplify getLevels API
2021-10-13 13:28:31 -05:00
c89cfa4927
Move property setting above servlet construction
2021-10-13 13:17:07 -05:00
bbde93a3c7
Enable unwrapping of CompletionStage
2021-10-13 11:46:20 -05:00
b01b76d78f
First pass at subscriptions API
...
This is an incomplete first pass at building the subscriptions API. More API endpoints are still to be added along with controller tests.
2021-10-12 21:23:20 -05:00
75c22038eb
Create empty Badges_en.properties file
2021-10-11 22:27:30 -05:00
3c1705994d
Count accounts with non-normalized phone numbers
2021-10-11 10:13:08 -04:00
d2bc3c7360
Add dynamic configuration to disable directory reconciler
2021-10-04 14:38:47 -07:00
9734433f00
Use the default `SecureRandom` algorithm for tests
2021-10-04 11:37:32 -04:00
5bd08800bb
Remove public modifier from test class
2021-10-01 14:27:07 -05:00
3032415141
Add receipt redemption API to chat server
2021-10-01 12:44:47 -05:00
ba58a95a0f
Add support for changing phone numbers
2021-10-01 10:15:33 -04:00
aa4bd92fee
Lazy-load scripts; fall back to `eval` if `evalsha` returns `NOSCRIPT`
2021-09-29 16:08:17 -04:00
f37c76dab1
Drop `LuaScript`
2021-09-29 16:08:17 -04:00
863969c77c
Resolve ClusterLuaScript warnings/suggestions
2021-09-29 16:08:17 -04:00
2383aaaa3d
Update ClusterLuaScript formatting
2021-09-29 16:08:17 -04:00
715d1157ad
Reject Redis commands when disconnected
2021-09-29 16:07:26 -04:00
4aaae3f445
Use a single configuration URI for Redis clusters
2021-09-29 14:46:09 -04:00
8359ef73f4
Cycle all connected websockets on any device or account enabled state change
2021-09-29 14:18:35 -04:00
c6bb649adb
Simplify map-building logic
2021-09-29 14:18:35 -04:00
e333cbd94d
Close websockets on account deletion
2021-09-29 14:11:16 -04:00
5189cbe5c7
apply editorconfig formatting
2021-09-29 10:31:39 -07:00
d1d6e5c652
Filter stale ephemeral messages from cache
2021-09-29 10:31:39 -07:00
3e5087e60b
Remove obsolete ephemeral queue handling
2021-09-29 10:31:39 -07:00
93c3cea912
Clean up old "ephemeral" metrics
2021-09-29 10:31:39 -07:00
e824b861d4
Drop `accounts` table
2021-09-29 10:31:20 -07:00
e8dd1e0bf2
Fixup formatting
2021-09-29 10:31:20 -07:00
559026933d
Add low and high detail svgs to badges
2021-09-27 17:00:09 -05:00
7864405efd
Remove single URL in favor of density based sprite sheets
2021-09-27 16:50:18 -05:00
a5575902de
Pause if we bump into an exception while trying to persist messages
2021-09-27 13:38:17 -04:00
041aed2d72
Remove zkgroup enabled flag
...
The last remnants of a time before zkgroup have been swept away.
2021-09-23 09:24:06 -05:00
02a296e500
Use a MIME Base64 decoder for provisioning messages
2021-09-22 16:30:44 -04:00
98e41f9a37
Improve Redis exception handling
2021-09-22 10:31:39 -04:00
6a71d369e2
More Accounts cleanup
...
* Remove `AccountStore`
* Clean up `AccountsDynamoDb#delete`
* Rename `AccountsDynamoDb` → `Accounts`
* Remove unused configuration
* Move Accounts scan page size to static configuration
* Remove disabled tests and related methods
2021-09-21 15:25:16 -07:00
75661fa800
Add JavaTimeModule
2021-09-20 16:42:38 -05:00
df5498e1c0
Add test for self badge fetching
2021-09-20 16:42:38 -05:00
c0af911197
Show invisible badges to query for self
2021-09-20 16:42:38 -05:00
44bc90e5ab
Return a badge with additional properties when fetching your own profile
2021-09-20 16:42:38 -05:00
5c1cde1b28
Add visibility modifying helper method in AccountBadge
2021-09-20 16:41:09 -05:00
3172b571c6
Move "testing" string into BadgeConfiguration
2021-09-20 16:41:09 -05:00
17e8b77e88
Add unit test for setting badges
2021-09-20 16:41:09 -05:00
8011935a3b
Fix compilation issues created by constructor changes
2021-09-20 16:41:09 -05:00
3f3052c23c
Remove isZkEnabled
2021-09-20 16:41:09 -05:00
8f17f45339
Reorder creating of testing badges
...
Need their expiration time to always get refreshed on set so reorder
how they're created to ensure that's the case.
2021-09-20 16:41:09 -05:00
009e2eeb97
Enable editing of badges on profiles
2021-09-20 16:41:09 -05:00
c70fa48835
Fix indentation of ProfileController#setProfile
2021-09-20 16:41:09 -05:00
bd5f5c407b
Add method to merge badge ids list into a profile
2021-09-20 16:41:09 -05:00
2bc573a53d
Add additional test badges for translation
2021-09-20 16:41:09 -05:00
537d61d5bd
Add badges to CreateProfileRequest
...
This will permit users to set the order and visibility of badges on
their profile.
2021-09-20 16:41:09 -05:00
09519ae942
Only retry websocket sending if the client is still connected
2021-09-20 14:24:07 -04:00
2a67b2e610
Remove Accounts Postgres
2021-09-20 11:10:24 -07:00
8161f55a82
Add dynamic configuration for setting Dynamo as primary
2021-09-17 13:28:45 -07:00
ecee189ad8
Add `AccountDatabaseCrawler.dedicatedDynamoMigrationCrawler`
2021-09-17 11:27:20 -07:00
383d744bd8
Log the error message when retrying queue send
2021-09-16 18:03:42 -04:00
c2ba8ab562
Identify receipt destinations by UUID instead of e164
2021-09-16 10:47:03 -04:00
cd49ea43c0
Use `queryPaginator` when loading messages
2021-09-16 10:46:37 -04:00
53aa45a2bb
Use `queryPaginator` when deleting messages
2021-09-16 10:46:37 -04:00
83e0a19561
Migrate `MessagesDynamoDbRule` to `MessagesDynamoDbExtension`
2021-09-16 10:46:37 -04:00
6a5d475198
Add a "refresh websocket on number change" provider
2021-09-16 10:37:34 -04:00
49ccbba2e3
Generalize the "watch for websockets that need to be refreshed" listener
2021-09-16 10:37:34 -04:00
41735ed40e
Introduce queueDrainRetry counter metric
2021-09-16 10:30:19 -04:00
2d11a433c9
Wrap all calls to getAcceptableLanguages
...
ContainerRequestContext#getAcceptableLanguages throws a
ProcessingException if the header has invalid values in it. Rather than
error out of the request entirely with the exception handler for that
exception, we just treat it as though no Accept-Languages header was
specified.
2021-09-16 09:28:21 -05:00
e79ab2521f
Rename field in ConfiguredProfileBadgeConverter
2021-09-16 09:28:21 -05:00
fb1f99da87
Add a method to enable a badge for all accounts
2021-09-16 09:28:21 -05:00
08c6a8c2e5
Add category to badges
2021-09-16 09:28:21 -05:00
ce3835e176
Rename id to name in the configuration
2021-09-16 09:28:21 -05:00
39f6eadbb9
Add test for add and remove badges
2021-09-16 09:28:21 -05:00
16dba09b61
Handle merging badges when adding to account
2021-09-16 09:28:21 -05:00
d5ebf2f2ed
Rename name to id in Account#removeBadge
2021-09-16 09:28:21 -05:00
8a8e6e7b49
Rename name to id in the stored badge information and expose id in the profile endpoint
2021-09-16 09:28:21 -05:00
34e21b9f7b
Change name to id on AccountBadge
...
This makes it distinct from the localized name field on the Badge
entity that is returned.
2021-09-16 09:28:21 -05:00
98a31d1474
Switch ProfileController to the actual badge converter
2021-09-16 09:28:21 -05:00
72a0c1be0f
Tune mismatch logging
2021-09-15 16:46:10 -07:00
5b25e38e41
Ensure badges are in ordered collections
2021-09-15 16:20:15 -05:00
2fb400280b
Remove unused parameter from `deleteMessageByDestinationAndGuid`
2021-09-15 10:14:08 -07:00
79ad09524e
Implement the ProfileBadgeConverter interface
2021-09-15 10:32:20 -05:00
5f8accb492
Add acceptable languages from request to variable
2021-09-14 17:43:39 -07:00
6fcadc2297
Handle exception reading `Accept-Language` header
2021-09-13 18:07:16 -07:00
3f4e1522eb
Only put accounts that exhaust optimistic lock retries in migration retry table
2021-09-13 15:00:01 -07:00
6304c84cdb
Add ContactDiscoveryWriterTest based on mock.
2021-09-13 15:20:21 -06:00
894297efa9
Add dynamic configuration for doing a mismatch post-check
2021-09-13 13:54:19 -07:00
a51a7a0901
Add `MigrationMismatchedAccounts` to `AccountsManager`
2021-09-13 13:54:19 -07:00
372e131e25
Update `PaymentsControllerTest`
2021-09-13 09:58:42 -07:00
cd66a1ceb7
fix merge issue after 2021 Aug 15 commit d1735c7e57 ( #137 )
2021-09-13 09:39:11 -07:00
feb59deb28
Use BigDecimal instead of Double for currency rate calculations ( #134 )
...
use BigDecimal instead of double for accuracy
2021-09-10 16:15:57 -05:00
489519a982
Use Map.of() for statically defined map
2021-09-10 14:27:18 -05:00
6a6555e2d5
Add metrics for AuthEnablementRequestEventListener displacements
2021-09-10 12:01:05 -07:00
49489a6021
Re-check mismatched accounts after a delay, to avoid false positives from concurrent requests
2021-09-10 11:31:44 -07:00
8cd93d68e4
Add MetricsUtil
2021-09-10 11:31:44 -07:00
f3b9a8d97f
Add account to migration retry table on transient dynamo failure
2021-09-10 11:30:49 -07:00
b91a69d8b3
Add asynchronous chunk pre-read to `AccountDatabaseCrawler`
2021-09-10 11:14:11 -07:00
624e40e3b7
Add separate `AccountsDatabaseCrawler` for DynamoDB migration
2021-09-10 11:14:11 -07:00
23a076a204
Update `Account#getNextDeviceId` to not reuse disable device’s IDs
2021-09-10 10:48:48 -07:00
016141a05d
Add `DevicesHelper`
2021-09-10 10:48:48 -07:00
a064b25a14
Fix CDS writer to use AccountsManager.
2021-09-10 11:36:06 -06:00
bd40e32f3b
Send acceptable languages instead of request into the profile badge converter
2021-09-10 10:53:04 -05:00
81a21c0d5f
Use @NotNull since @NotEmpty doesn't support URL
2021-09-10 10:49:31 -05:00
6478210330
Update configuration for badges to use URL instead of String
2021-09-10 10:49:31 -05:00
aa1c37fe26
Create configuration for badges
2021-09-10 10:14:16 -05:00
6ee23b0186
Create resource bundle for badges
2021-09-10 10:11:56 -05:00
40eb445592
Add a command to set a user's discoverability in CDS
2021-09-10 10:34:20 -04:00
ce7d687205
Add a shutdown monitor that publishes shutdown state as a metric
2021-09-08 16:37:05 -04:00
758900b7a8
Register AuthEnablementApplicationEventListener
2021-09-08 13:11:09 -07:00
539b62a829
Add request event listener that handles device.isEnabled changes
2021-09-08 13:11:09 -07:00
2866f1b213
Include e164 in account creation (whoami) responses
2021-09-07 16:52:32 -04:00
fc1465c05d
Wire up stored account badges to the profile endpoints
2021-09-07 15:51:29 -05:00
bc887ec6fa
Add visibility flag to badge storage
2021-09-07 15:50:29 -05:00
84b3d324bb
Creates a storage object for badges
2021-09-07 15:49:41 -05:00
fc10108788
Make fields final in Badge entity
2021-09-07 15:39:48 -05:00
fbbc1bec58
Add badge entity to profile
2021-09-07 15:39:48 -05:00
2059bb5ef8
Update test to handle read-then-write in ContactDiscoveryWriter.
2021-09-07 13:41:47 -06:00
b080a5db4d
Get-and-set accounts, since other updates may have made them stale.
...
Co-authored-by: Chris Eager <79161849+eager-signal@users.noreply.github.com>
2021-09-07 13:41:47 -06:00
b4aabd799b
Canonical discoverability writing.
2021-09-07 13:41:47 -06:00
92f035bc2a
Add a "change number" device/account capability
2021-09-07 15:07:30 -04:00
18a6df34bd
Add timers to `processChunk` and `deleteRecentlyDeletedUuids`
2021-09-03 14:54:51 -07:00
b1274125c9
Add start/chunk/sleep logging to crawler
2021-09-03 14:54:51 -07:00
dceebc1c8d
Consistently use `whenCompleteAsync(…, migrationThreadPool)`
2021-09-03 14:02:51 -07:00
6aadb4b458
Parameterize registration lock constructor when updating account attributes
2021-09-03 14:02:27 -07:00
703405b874
Start WebSocket before registering its presence
2021-08-27 16:41:07 -04:00
d1735c7e57
Retire `AmbiguousIdentifier`
2021-08-27 13:40:46 -04:00
1f815b49dd
Measure APNs rejections by reason
2021-08-27 11:52:29 -04:00
a9339b7037
Update to Pushy 0.15.0
2021-08-27 11:52:29 -04:00
f2c6ca182d
Include the current server version in the tag list for Dropwizard metrics
2021-08-27 11:52:11 -04:00
b946c27a20
Remove a metric aggregator
2021-08-27 11:52:11 -04:00
8a8a848fac
Record error metrics from Twilio Verify
2021-08-26 12:22:17 -04:00
aeb9f67266
Migrate MessageSenderTest to JUnit 5
2021-08-25 12:25:10 -05:00
e08c5a412e
Insert ephemeral messages in the standard cache queue
2021-08-25 12:25:10 -05:00
a7443a9ece
Don’t persist ephemeral messages; clear ephemeral field when sending to clients
2021-08-25 11:17:00 -05:00
54fe3b9a43
Update TextSecure.proto
2021-08-25 11:17:00 -05:00
ba522b1691
Clean redis message cache structure
2021-08-24 10:30:52 -05:00
739c5bf22c
Add a counter to estimate announcement group adoption
2021-08-23 17:31:34 -04:00
7cdadeb791
Register circuit breaker metrics for FaultTolerantPubSubConnection
2021-08-23 15:49:19 -05:00
dadf43b93e
Consolidate directory reconciliation on v3 endpoints
2021-08-19 14:18:38 -05:00
19f7b207b7
Extract configuration for WebSocket max message sizes
2021-08-19 14:09:57 -05:00
a398e2269c
Update `AccountsManager` mismatch comparison
2021-08-19 14:08:48 -05:00
2e28fb97a4
Delete DynamoDB accounts with invalid UUIDs in AccountsManager#create
2021-08-19 14:05:21 -05:00
5c68d83a93
Add integration test for re-registration with and without Dynamo DB
2021-08-19 14:05:21 -05:00
0b7c3ad745
.editorconfig formatting
2021-08-16 16:32:26 -05:00
0cde06557d
Catch and log unexpected exceptions keyspace notification executor service
2021-08-16 16:32:26 -05:00
27844fe692
Add JUnit 5 RedisClusterExtension
2021-08-13 12:07:04 -05:00
779051ef9f
Add minThreads(64) to multiRecipientMessageExecutor
2021-08-12 13:03:40 -05:00
d13741fbd5
Change from using parallel streams to using an ExecutorService
2021-08-12 12:05:01 -05:00
f7f870fe62
Execute send multi-recipient message loop in parallel
2021-08-12 12:05:01 -05:00
de59aa099d
Add uncaught exception handler
2021-08-12 11:10:05 -05:00
57a478b898
Remove unused local variable
2021-08-12 10:26:23 -05:00
3e8d79e147
Remove unused lua script to delete by sender and timestamp
2021-08-11 17:38:55 -05:00
a46045d987
Remove unused methods that delete messages by sender and timestamp
2021-08-11 17:30:39 -05:00
662c905b80
Remove deprecated delete messages endpoint
...
DELETE /v1/messages/{source}/{timestamp} has been deprecated a long
time and has minimal usage each day at this point. Dropping support
for this endpoint to improve message cache storage flexibility.
2021-08-11 16:17:44 -05:00
31022aeb79
Use refreshing `AuthenticatedAccount` for `@Auth`
2021-08-11 14:52:25 -05:00
b3e6a50dee
Send 508 status code for legacy clients that produce rate limit challenges
2021-08-11 11:57:30 -05:00
d29764d11f
Only process updates for enabled devices in PushFeedbackProcessor
2021-08-11 11:54:42 -05:00
f8e4f6727a
Reorder crawler listeners so updates happen after read-only processing
2021-08-11 11:54:20 -05:00
63d05df8a3
Fix indentation
2021-08-10 10:02:04 -05:00
52d13d1d62
Remove unused lua script
2021-08-10 10:02:04 -05:00
f58a320223
Remove unused method from MessagesCache
2021-08-10 10:02:04 -05:00
3e01bc1174
Add metric for content-length header distribution
2021-08-06 14:41:16 -05:00
d1ada7f998
Revert "Continue to verify rate limiters by e164 during UUID migration period"
...
This reverts commit ce5edbb7fc
2021-08-06 14:33:59 -05:00
73c368ea86
Use UUIDs instead of e164s to associate accounts with push notifications.
2021-08-04 14:38:28 -04:00
ce5edbb7fc
Continue to verify rate limiters by e164 during UUID migration period
2021-08-04 14:15:21 -04:00
a680639718
Use UUIDs as rate limiter keys.
2021-08-04 14:15:21 -04:00
becf6afbdd
Block until all UUID bytes are read or EOF
2021-08-03 17:59:48 -05:00
1dda015c6a
Update multi-recipient message sending to handle unrestricted destinations
2021-08-03 17:31:39 -05:00
cfd31e98ff
Move version comparison to after more meaningful checks
2021-08-03 11:03:41 -05:00
bcb89924b4
Simplify optimistic write logic
2021-08-03 11:54:26 -04:00
1f6318a919
Rename constant
2021-08-02 13:14:44 -05:00
b0667b258b
Implement EnterpriseRecaptchaClient
2021-08-02 13:14:44 -05:00
4c3a48f5be
Use more specific prefix for recaptcha transition
2021-08-02 13:14:44 -05:00
33fb7a72de
Use RecaptchaClient interface
2021-08-02 13:14:44 -05:00
2c808e369c
Create a transitional recaptcha client for upgrading
2021-08-02 13:14:44 -05:00
906d0be382
Setup recaptcha client interface
2021-08-02 13:14:44 -05:00
2aaddd721f
Rename existing captcha client
2021-08-02 13:14:44 -05:00
4e2284b83f
Retire old GV2 adoption metrics.
2021-08-02 12:51:49 -05:00
d5d9978e48
Use non-stale account in mutator when adding a new device
2021-08-02 11:38:03 -05:00
d45659ac76
Reduce contention when updating `device.lastSeen`
2021-08-02 11:26:15 -05:00
13a07dc6cd
Drop the active user counter.
2021-07-29 15:40:27 -04:00
51b7a8d868
Add excluded E164s configuration to pre-registration experiment
2021-07-29 14:16:40 -05:00
df9c0051c9
Reconcile inactive and undiscoverable accounts when using v3 endpoints
2021-07-29 10:56:44 -05:00
331ff83cd5
Drop legacy PIN-based registration lock plumbing
2021-07-29 11:51:14 -04:00
44838d6238
Verify that nobody's addressing API calls by e164 any more.
2021-07-29 11:50:36 -04:00
5400abb065
Better support unhandled exception logging on websocket requests
2021-07-28 14:06:09 -05:00
f47fefb73e
Lock accounts for the duration of deletion operations.
2021-07-27 13:12:39 -04:00
cdef745a7a
Drop a not-very-helpful metric (logging works better in this case).
2021-07-27 13:12:39 -04:00
1a1eab4ec0
Also clear profiles on re-registration.
2021-07-27 13:05:54 -04:00
3a966ef345
Reuse account UUIDs when registering an account with a recently-deleted e164.
2021-07-27 13:05:54 -04:00
be20c04cd8
Identify accounts for which to delete keys by UUID.
2021-07-27 13:05:54 -04:00
d09dcc90fe
Add methods for getting, clearing, locking recently-deleted account records.
2021-07-27 13:05:54 -04:00
0117fc12c7
Actually increment the moved "new user" counter.
2021-07-27 12:09:51 -04:00
ef9a7fda9a
Publish outstanding SQS operation count as a gauge.
2021-07-27 11:15:41 -04:00
13447df1e0
Update validation for NotNull items in IncomingMessagesList
2021-07-27 10:39:30 -04:00
3608c5bfb0
Wait for outstanding requests to be resolved before shutting down the directory queue.
2021-07-27 10:36:53 -04:00
34dbff6786
Switch to an async SQS client.
2021-07-27 10:36:53 -04:00
a6066bfc2f
Migrate DirectoryQueueTest to JUnit 5.
2021-07-27 10:36:53 -04:00
8579190cdf
Consolidate account creation/directory updates into `AccountsManager`
2021-07-27 10:27:47 -04:00
917f667229
Remove AccountController and KeysController from websocket
2021-07-26 14:27:43 -05:00
317a551bdb
Migrate MetricsRequestEventListenerTest to JUnit 5
2021-07-26 12:06:29 -05:00
27e9271473
Add request path and user agent to unhandled exception logging
2021-07-26 12:06:29 -05:00
11dff6c546
more controllers
2021-07-26 12:06:17 -05:00
e6712937ca
fix indent
2021-07-26 12:06:17 -05:00
cf8887bb5a
Provide more WebSocket endpoints
2021-07-26 12:06:17 -05:00
696340f780
Migrate DeviceControllerTest to JUnit 5
2021-07-26 11:18:17 -05:00
86ddcbaa08
Migrate CertificateControllerTest to JUnit 5
2021-07-26 11:18:17 -05:00
2144d2a8d8
Migrate AttachmentControllerTest to JUnit 5
2021-07-26 11:18:17 -05:00
f7af861b31
Migrate SecureStorageControllerTest to JUnit 5
2021-07-26 11:18:17 -05:00
208a09b3ae
Migrate RemoteConfigControllerTest to JUnit 5
2021-07-26 11:18:17 -05:00
831023e41d
Migrate PaymentsControllerTest to JUnit 5
2021-07-26 11:18:17 -05:00
ff627793d6
Migrate DirectoryControllerTest to JUnit 5
2021-07-26 11:18:17 -05:00
f971c76a99
Migrate StickerControllerTest to JUnit 5
2021-07-26 11:18:17 -05:00
8f41176c76
Enable "sms" transport for +98
2021-07-26 10:40:05 -05:00
31bbbbb5e0
Raise default message TTL to 14 days
2021-07-20 14:08:08 -05:00
effcd6038d
Also record dimensional metrics for circuit breakers and retries.
2021-07-19 16:56:16 -04:00
12be7d49c2
Clear one-time pre-keys on re-registration.
2021-07-19 10:05:01 -04:00
14863b575e
Clear one-time pre-keys when a device is unlinked.
2021-07-19 10:05:01 -04:00
32a95f96ff
Add a pessimistic locking system for operations on recently-deleted account records
2021-07-16 16:52:58 -04:00
b757d4b334
Measure how many "send message" requests are still using e164-based addressing.
2021-07-16 16:52:58 -04:00
bd03d910fe
Set authenticated device after updating last seen
2021-07-16 16:52:58 -04:00
01ef855157
Return a non-stale account from base authenticator when last seen is updated
2021-07-16 16:52:58 -04:00
817866caf3
Use fresh accounts to update in PushFeedbackProcessor
2021-07-16 16:52:58 -04:00
158d65c6a7
Add optimistic locking to account updates
2021-07-16 16:52:58 -04:00
62022c7de1
Migrate AppConfig to SDK v2 to detect and use web identify token
2021-07-16 16:48:33 -04:00
a824b5575d
Add dynamic configuration for using DynamoDB in AccountsDatabaseCrawler
2021-07-06 13:01:24 -05:00
78819d5382
Remove expiration logic when checking token validity.
...
The data store will no longer return tokens that have expired, and we no longer need to check for expiration in application space.
2021-07-06 11:03:49 -04:00
d128bc782a
Retire Postgres-backed pending account/device tables.
2021-07-06 11:03:49 -04:00
530b2a310f
Ensure active future is always completed
2021-07-02 15:05:11 -05:00
d5b0d99a54
Remove unused method
2021-07-02 15:05:11 -05:00
43be72d076
Add test for ManagedPeriodicWork; fix shutdown not awaiting active execution
2021-07-02 15:05:11 -05:00
0f6c866c8d
Update imports
2021-07-02 15:05:11 -05:00
bac78e9291
Switch DeletedAccountsTableCrawler metrics to a basic Metrics#summary
2021-07-02 15:05:11 -05:00
c22ea78672
Add crawler to process migration retry accounts
2021-07-02 15:05:11 -05:00
a85afe827d
Avoid NPE by using scheduledFuture as the Gauge state object
2021-07-02 15:05:11 -05:00
abaed821ec
Add additional case to unit test
2021-07-02 15:05:11 -05:00
6fa9dcd954
Refactor to use shared recurringJobExecutor
2021-07-02 15:05:11 -05:00
819d59cd79
Update reconciliation crawler to use secondary index
2021-07-02 15:05:11 -05:00
2f88f0eedb
Refactor to use single threaded scheduled executor
2021-07-02 15:05:11 -05:00
74ff491671
Rename ManagedPeriodicWorkCache to ManagedPeriodicWorkLock
2021-07-02 15:05:11 -05:00
eac48a6617
Don’t delete accounts after reconciling
2021-07-02 15:05:11 -05:00
19617c14f8
Improved logging in ManagedPeriodcWork
2021-07-02 15:05:11 -05:00
fc7291c3e8
Migrate DeletedAccountsTableCrawler to ManagedPeriodicWork
2021-07-02 15:05:11 -05:00
88db808298
Add abstract ManagedPeriodicWork
2021-07-02 15:05:11 -05:00
5193abdab3
Add DeletedAccountsTableCrawler
2021-07-02 15:05:11 -05:00
a315c9be92
Add DeletedAccounts DynamoDB table
2021-07-02 15:05:11 -05:00
fc1541591a
Add AbstractDynamoDbStore#scan
2021-07-02 15:05:11 -05:00
ae97c4db9f
Use editorconfig in AbstractDynamoDbStore
2021-07-02 15:05:11 -05:00
26bc5973b5
Clear message queue before and after removing a device
2021-07-02 10:48:42 -05:00
e52b8c8423
Implement DatadogConfig in DatadogConfiguration
2021-07-02 10:48:05 -05:00
7395489bac
Add tests for pending account/device managers.
2021-07-02 11:30:13 -04:00
b384ed7f5c
Add a counter for requests for delivery certificates with/without e164s.
2021-07-01 10:59:10 -04:00
e3afcae7d3
Gather data to verify safety of retiring legacy reglock system.
2021-07-01 10:58:47 -04:00
9faeed7b20
Count E164 authentications versus UUID authentications.
2021-07-01 10:51:34 -04:00
49adcca80e
Use Optional.isEmpty().
2021-07-01 10:51:34 -04:00
49c43a6816
Simplify distribution summary for "days since last seen."
2021-07-01 10:51:34 -04:00
84f85ae098
Collapse various account meters into a single, multi-dimensional counter.
2021-07-01 10:51:34 -04:00
3d581941ab
Add plumbing and configuration to migrate pending accounts/devices to DynamoDB.
2021-07-01 10:50:52 -04:00
d2d39baede
Add a DynamoDB-backed stored verification code store.
2021-07-01 10:50:52 -04:00
111f5ba024
Use java.time classes for stored verification code expiration; add tests.
2021-07-01 10:50:52 -04:00
ce3fb7fa99
Extract a common base class for verification code store tests.
2021-07-01 10:50:52 -04:00
fc421d3f21
Introduce a common interface for verification code stores.
2021-07-01 10:50:52 -04:00
71bea759c6
Consolidate StoredVerificationCode constructors.
2021-07-01 10:50:52 -04:00
bf1dd791a5
Drop caching for pending accounts/devices.
2021-07-01 10:50:52 -04:00
4c99577c08
Add configuration for Datadog batch size
2021-06-30 16:44:25 -05:00
5d5c63e6d4
Update profile controller to S3 AWSv2.
2021-06-30 13:09:18 -06:00
42ff3f8432
Switch SQS to Amazon SDKv2.
2021-06-30 12:46:12 -06:00
7883352b74
Match random capability generation in test
2021-06-21 17:32:31 -05:00
982d122d18
Match random capability generation in test
2021-06-21 17:32:31 -05:00
d8d94407c6
Create announcement group capability
2021-06-21 17:32:31 -05:00
28cfc54170
Update FunctionCounter builder to use non-null object and method
2021-06-11 11:27:45 -05:00
2ee7279743
Pause nstat counters.
2021-06-11 12:26:56 -04:00
eb1b073385
Add a hostname-aware reporter factory.
2021-06-10 14:23:05 -04:00
c634185b6f
Standardize a utility method for getting local host names.
2021-06-10 14:23:05 -04:00
2c33d22a30
Stop recording specific client versions in metrics until we know we need them again.
2021-06-08 12:25:31 -04:00
58d3a12eff
Set hostname to lowercase to avoid strange case mismatch issues; log hostname failures.
2021-06-07 17:17:46 -04:00
88c4b2be97
Correct a misunderstanding about the metrics host tag.
2021-06-07 16:29:44 -04:00
6cbd57f19f
Include environment/service/version as common metric tags.
2021-06-04 18:17:09 -04:00
5522376584
Include a host tag with metrics.
2021-06-04 18:17:09 -04:00
5089c37d28
Drop a pair of unused commands.
2021-06-04 12:35:06 -04:00
1ccf24e68c
Add a command to check dynamic config files.
2021-06-04 12:34:48 -04:00
411f7298f2
Enforce validation constraints for dynamic configuration objects.
2021-06-04 12:34:48 -04:00
5b0214c6f2
Make pre-key `take` operations more null-safe
2021-06-04 11:18:59 -04:00
735573e61b
Make reporting intervals configurable.
2021-06-03 17:50:41 -04:00
c545cff1b3
Switch DynamoDB to AWSv2.
...
Switch from using com.amazonaws.services.dynamodbv2 to using
software.amazon.awssdk.services.dynamodb for all current DynamoDB uses.
2021-06-03 13:37:10 -06:00
cbd9681e3e
Configure histograms and exclude high-cardinality metrics.
2021-06-03 14:12:02 -04:00
ca876e40ca
Add a second metric aggregator.
2021-06-03 14:12:02 -04:00
76f5a71727
Include server version in logging tags
2021-06-03 11:24:25 -04:00
117de2382d
Verify that API consumers can skip/clear VOIP tokens.
2021-06-02 16:50:49 -05:00
25e7036451
Send a payload with mutable content for non-VOIP topics.
2021-06-02 16:50:49 -05:00
3131bd3dd9
Allow iOS callers to specify whether they're providing a VOIP token for preauth.
2021-06-02 16:50:49 -05:00
c97be15e79
Fix NPE when a null message comes in from a client
2021-06-01 15:00:41 -06:00
164fc40990
Rename receipt type and add new client-to-client plaintext type for decryption error receipts
2021-05-28 11:33:44 -05:00
6456af6284
Upgrade to latest protobuf
...
This upgrades to protobuf 3.17 and uses maven to automatically rebuild
the generated code instead of using prefabricated checked in Java
files.
2021-05-28 11:33:44 -05:00
6f0750790c
Add metric to count number of legacy messages sent
2021-05-27 11:13:42 -05:00
3e61b5c49d
Add call chain and mismatch check for push token timestamp
2021-05-27 11:10:58 -05:00
5ee093f87c
Add mismatch for signed pre-key; remove mismatch for migration version
2021-05-26 10:58:23 -05:00
67067f1d2d
Remove last-seen and registration lock comparisons
2021-05-25 10:47:57 -05:00
07f9bb112e
Use separate object for multi recipient response
...
`needsSync` was being sent back from the server in the JSON response
which is an unnecessary and constantly false field in multi-recipient
message sending endpoint as it's always sealed sender.
2021-05-25 10:30:39 -05:00
417d48c452
Block downgrading sender key support
...
Disallow linking an additional device to an account that has already
upgraded to having sender key support where the linked device does not
have sender key support. This should prompt the person attempting to
link the older application to upgrade in order to complete the linking
process.
2021-05-25 10:30:26 -05:00
215621a9b0
Remove temporary adaptation for nested `IncomingMessage.online`
2021-05-24 11:36:15 -05:00
c3f53c4dd9
Fix infinite loop in TorExitNodeManager.
2021-05-21 14:50:15 -06:00
c10b64c367
Simplify S3ObjectMonitor API, try-with-resource.
2021-05-21 14:50:15 -06:00
722055c8b5
Switch S3ObjectMonitor to AWSv2 SDK.
2021-05-21 14:50:15 -06:00
5290656c3b
Fix typo
2021-05-20 15:11:44 -05:00
cf59d849b0
@Min does not apply to byte[] use @Size instead
2021-05-20 10:15:49 -05:00
ee3b91e4fb
Register MultiRecipientMessageProvider with the websocket interface too
2021-05-20 10:15:49 -05:00
94ac3f6cc8
Return Optional.empty() for present-but-not-routed IPs.
2021-05-18 17:43:30 -04:00
b89de860d3
Add support for getting country codes for ASNs.
2021-05-18 17:43:30 -04:00
f8c623074b
Introduce an ASN-to-IP manager.
2021-05-18 17:43:30 -04:00
1160af9522
Add a utility class for associating IP addresses with ASNs.
2021-05-18 17:43:30 -04:00
3056ea8cbc
More clearly separate concerns for explicitly getting monitored objects.
2021-05-18 17:00:30 -04:00
28e3b23e8c
Add an "excessively large object" safeguard.
2021-05-18 17:00:30 -04:00
fbaf4a09e2
Use the S3 object monitor to retrieve Tor exit node lists.
2021-05-18 17:00:30 -04:00
cfa8cbedc1
Introduce an S3 object monitor.
2021-05-18 17:00:30 -04:00
bacf524ae6
Add optional logging for mismatches
2021-05-18 14:39:30 -05:00
aa65d34c36
Set min/max threads for backup/storage service.
...
From https://docs.oracle.com/javase/7/docs/api/java/util/concurrent/ThreadPoolExecutor.html :
When a new task is submitted in method execute(java.lang.Runnable),
and fewer than corePoolSize threads are running, a new thread is
created to handle the request, even if other worker threads are idle.
If there are more than corePoolSize but less than maximumPoolSize
threads running, a new thread will be created only if the queue is full.
Since we utilize an unbounded queue, we'll never hit the condition that
the queue is full, so the pool will never grow past corePoolSize. Given
that, explicitly state that our max is 1 thread. This should be a noop
operationally.
Thanks to https://github.com/dropwizard/dropwizard/pull/834 for building
in warnings to help us find this.
2021-05-18 13:34:59 -06:00
0cd3640f13
Add more tests
2021-05-18 13:09:40 -05:00
c595d9415c
Change from quadratic scan to use more memory instead
2021-05-18 13:09:40 -05:00
1a604d8c79
Add unit test to readU16
2021-05-18 13:09:40 -05:00
f76e6705c0
Add handling of registration id in multi recipient send payload
2021-05-18 13:09:40 -05:00
89470ff536
Add class prefix to counter
2021-05-17 17:17:48 -05:00
d252e579f4
Get more detailzed serialization mismatches
2021-05-17 15:42:54 -05:00
30b2c2b5ad
Fix observed mismatches by swapping in original UUID
2021-05-17 15:42:17 -05:00
282f39141e
Add additional tests for AccountStore#create
2021-05-17 15:42:17 -05:00
85e4de6933
Switch platform value from `null` to "unrecognized" in metrics
2021-05-17 15:41:11 -05:00
00c9023e74
Include server GUID when sending messages over websocket
2021-05-14 17:10:15 -05:00
2a3ea13c9e
Classify DynamoDB mismatches in AccountsManager
2021-05-14 15:57:47 -05:00
6906336dfb
Include the uuid with the list of mismatched devices
2021-05-14 14:46:56 -05:00
df01be2dca
Don’t throw exceptions from ReportMessageManager#store()
2021-05-13 18:33:02 -05:00
e320626c6e
Add report message API
2021-05-13 17:19:34 -05:00
03dac2bf7e
Break down rate limit overruns by country.
2021-05-13 18:16:47 -04:00
57ff9f86f5
Refactor repeated use of the UserCapabilities constructor
2021-05-13 12:08:59 -05:00
bfd2c32d4e
Add sender key capability
2021-05-12 18:15:25 -05:00
e9a3d52d7f
Add an optional description to the payment intent request
2021-05-12 18:14:33 -05:00
d45154f2aa
Measure captcha challenge success rates.
2021-05-12 12:20:53 -05:00
760462f8fb
Add configuration for regional SMS verification text
2021-05-12 12:20:46 -05:00
46110d4d65
Add client challenges for prekey and message rate limiters
2021-05-11 16:21:32 -05:00
02d06af3fc
Replace use of MDC with custom fields on the appender
2021-05-11 14:08:20 -05:00
b100f09205
Actually instantiate the donation controller in the service
2021-05-11 10:03:04 -05:00
670b69df24
Add host and service tags
2021-05-11 10:03:04 -05:00
13ecbe7e53
Fix missing defaults
2021-05-11 10:03:04 -05:00
17047513c3
Create stripe api endpoint for apple pay donations
2021-05-11 10:03:04 -05:00
4571042814
Add missing increment to counter
2021-05-10 10:45:46 -04:00
9cb89b42bf
Create a logstash tcp socket appender factory
2021-05-07 16:02:55 -05:00
bf32b766a5
Don't generate stack traces for rate limit exceptions.
2021-05-07 10:44:31 -04:00
f0a8b5a54a
Allow the environment to manage the Tor exit node manager's lifecycle.
2021-05-06 15:38:24 -04:00
b81b811400
Actually instantiate the Tor exit node manager.
2021-05-06 12:21:30 -04:00
b41f97233e
Measure source country for all pre-key requests.
2021-05-06 11:58:14 -04:00
350de1c759
Add a simple utility class for testing if an IP belongs to a Tor exit node.
2021-05-06 11:57:18 -04:00
dfb8a419e7
Include message IDs when sending message batches.
2021-05-04 16:15:04 -04:00
cf495ef7cf
Key the message rate limiter to sender e164, not UUID.
2021-05-04 15:18:59 -04:00
8fdbcbef44
Send directory updates in batches.
2021-05-04 15:18:43 -04:00
1a8c40c02a
Patch code to use new Base64
2021-05-04 13:34:27 -05:00
20677d4be1
Fix logic error
2021-05-04 13:34:27 -05:00
c448c37cc9
Add logic to handle sending a common payload to multiple recipients
2021-05-04 13:34:27 -05:00
fac4538f6f
Migrate rate limiters to rate limiter cluster
2021-05-03 10:57:34 -05:00
7e805d1592
Add rate limiters cluster to all RateLimiters
2021-04-30 17:18:56 -05:00
0e6cfb460d
Fix potential NullPointerException in RateLimiter
2021-04-30 16:15:36 -05:00
4f6b132449
Add secondaryCacheCluster to RateLimiter
2021-04-30 15:26:17 -05:00
e4dbb8efe7
Fix deserialization for Duration in dynamic config
2021-04-28 15:57:23 -05:00
59e401f41e
Use a MIME Base64 decoder for attachment signing keys.
2021-04-26 18:53:15 -04:00
6196856a7c
Use the JDK-provided Base64 encoder/decoder.
2021-04-26 18:17:03 -04:00
0e8d4f9a61
Drop Bouncy Castle as a dependency.
2021-04-26 17:58:19 -04:00
62315f423c
Record duration of successful verifications
2021-04-26 14:31:52 -05:00
5ee56b022c
Add CustomFriendlyName parameter to Twilio Verify requests
2021-04-26 14:31:52 -05:00
6c37b658ac
Migrate VoiceVerificationControllerTest to JUnit 5
2021-04-26 14:31:52 -05:00
1f53900345
Migrate VoiceVerificationController to Util#findBestLocale
2021-04-26 14:31:52 -05:00
deece33a0d
Fix parameterized testWhoAmI
2021-04-26 14:31:52 -05:00
13053da97f
Add Twilio Verify experiment to AccountController
2021-04-26 14:31:52 -05:00
4c019aef15
Migrate PendingAccountsTest to JUnit 5
2021-04-26 14:31:52 -05:00
bab5e5769b
Add TwilioVerifyExperimentEnrollmentManager
2021-04-26 14:31:52 -05:00
f68390e96f
Add Twilio Verify methods to SmsSender
2021-04-26 14:31:52 -05:00
76cbf734ad
Add TwilioVerifySender to TwilioSmsSender
2021-04-26 14:31:52 -05:00
17ba630014
Add TwilioVerifySender
2021-04-26 14:31:52 -05:00
3121867f72
Remove incorrect license header
2021-04-23 13:27:22 -05:00
f190462879
Fully implement unsealed sender cardinality rate limiter
2021-04-23 11:45:53 -05:00
ac72c8b2de
Remove log
2021-04-22 18:15:52 -05:00
6c6f073bc2
Pass re-migration account in test
2021-04-22 17:11:10 -05:00
0663fe30df
Add cancellation reason codes to error logging
2021-04-22 17:11:10 -05:00
b6cb23cbb5
Handle potentially null item from Dynamo delete outcome
2021-04-22 15:24:58 -04:00
b75456acf3
Allow migration thread pool to be scaled up
2021-04-21 15:23:02 -05:00
abafa2ccac
Include ATTR_MIGRATION_VERSION in update()
2021-04-21 14:13:13 -05:00
b75dec40ac
Drop syslog4j in favor of Dropwizard's/Logback's syslog appender.
2021-04-21 11:23:52 -05:00
5974328d9c
Ensure accounts are deleted after batch migration; store migration failures for later processing
2021-04-21 11:13:07 -05:00
a472774734
Add threadpoool to increase Accounts → Dynamo migration throughput
2021-04-21 11:13:07 -05:00
166d203e8e
Don’t PUT unmigrated accounts in update()
2021-04-21 11:13:07 -05:00
f2a1a65a45
Migrate MessageControllerTest to JUnit 5
2021-04-20 13:00:29 -05:00
b7c56108ca
Rate limit unsealed sender by E164
2021-04-20 13:00:29 -05:00
52478e7de0
Test the account crawler against a real redis cluster.
2021-04-20 13:58:27 -04:00
59bbd0c43c
Add Accounts DynamoDB
...
* Add additional test cases to AccountsTest
* Migrate AccountsManagerTest to JUnit 5
* Add AccountsDynamoDbConfiguration
* Add Account.dynamoDbMigrationversion
* Add DynamicAccountsDynamoDbMigrationConfiguration
* Add AccountsDynamoDb to AccountsManager
* Add AccountsDynamoDbMigrator
2021-04-16 14:24:24 -05:00
4d33ba48cc
Discard some tools intended to detect abusive behavior that turned out to not actually be that helpful.
2021-04-14 11:18:19 -04:00
14f5271c20
logger use current class
2021-04-13 11:44:59 -05:00
37bda0b035
remove unused imports
2021-04-13 11:44:59 -05:00
0572951c8a
Remove temporary variable
2021-04-08 12:38:06 -05:00
1f24c913a6
add unit tests for SmsSender
2021-04-08 09:17:47 -04:00
ffcabe6fc4
Update metric names in RemoteConfigs
2021-04-07 16:53:06 -04:00
2cb788ceb7
Delete secure backups when deleting accounts.
2021-04-01 11:30:48 -04:00
257fef9734
Add a secure backup service client.
2021-04-01 11:30:48 -04:00
dea359ef91
Add metric tag for prekey target type
2021-03-31 17:59:47 -04:00
64c9648dd8
Also trust the GeoTrust Global CA cert for now. We'll remove it soon.
2021-03-31 17:59:32 -04:00
6dfd13118d
Pin the trusted APNs CA cert.
2021-03-31 17:59:32 -04:00
5c23f62cec
Record deletion errors in logs/metrics.
2021-03-30 17:17:32 -04:00
ab4e94edab
Revert "Revert "Delete data in the storage service when deleting accounts.""
...
This reverts commit 91fc0fd623
2021-03-30 17:17:32 -04:00
9589b7758c
Disallow generation of certificates with key IDs reserved for testing.
2021-03-30 16:25:36 -04:00
ad6c271f9d
Add dynamic configuration for signup captcha by country code
2021-03-30 10:22:02 -05:00
c10d9603ad
Add metric for international PreKey requests
2021-03-29 14:52:04 -05:00
91bd061110
Migrate deprecated Lettuce method and enum usages
2021-03-29 14:51:26 -05:00
83aa59f4dd
Align messages_cluster client name
2021-03-29 14:51:26 -05:00
3745a0b81d
Update from 684 to 776 for payment address length to account for signature
2021-03-27 00:45:47 -05:00
7e29ed1cc7
Block attempts to set wallet addresses from unsupported countries.
2021-03-26 12:21:11 -04:00
5965f0fd22
Add a dynamically-configured list of allowed country codes for payments.
2021-03-26 12:21:11 -04:00
a816aa0186
Revert "Add a storage client method for checking wheter a user has a stored manifest."
...
This reverts commit 8b6012f8a8
2021-03-22 10:32:38 -04:00
a7bad20eae
Revert "Add an admin command for printing a subset of account data."
...
This reverts commit a288b9df8e
2021-03-22 10:32:38 -04:00
089b6b1644
Retry attempts to get messages after a delay; close connections after a finite number of retries.
2021-03-22 10:32:25 -04:00
7509520883
Make sure to release the semaphore even if something goes wrong getting messages.
2021-03-22 10:32:25 -04:00
e5ae0572c5
Add android-2021-03 verification format
2021-03-18 12:49:50 -05:00
63dac3bd9f
Migrate AccountControllerTest to JUnit 5
2021-03-18 12:45:20 -05:00
19295eef46
Add dimensional metrics for account creation and verification
2021-03-18 12:45:20 -05:00
0bc1369e04
Work through the full list of supported locales when choosing a language for voice verification.
2021-03-18 13:29:09 -04:00
ca2f7d2eed
Parse locale strings when sending voice verification codes.
2021-03-18 13:29:09 -04:00
3ea535a412
Lower logging level for common failures and record failure metrics.
2021-03-18 12:43:31 -04:00
a288b9df8e
Add an admin command for printing a subset of account data.
2021-03-18 12:43:12 -04:00
8b6012f8a8
Add a storage client method for checking wheter a user has a stored manifest.
2021-03-18 12:43:12 -04:00
ad838b4827
Add isEnrolled(e164, experiment) for pre-registration experiments
2021-03-16 13:09:10 -05:00
25f603efc9
Add DynamicPreRegistrationExperimentEnrollmentConfiguration
2021-03-16 13:09:10 -05:00
152c927929
Reformat to match EditorConig
2021-03-16 13:09:10 -05:00
b5bd16c6a9
Migrate DynamicConfigurationTest to JUnit 5
2021-03-16 13:09:10 -05:00
14bfa83bb8
Migrate ExperimentEnrollmentManagerTest to JUnit 5
2021-03-16 13:09:10 -05:00
5dc8086968
Migrate Twilio numbers from static to dynamic configuration
2021-03-16 12:53:51 -05:00
efe7f2e4c1
Remove vestiges of per-country sender ID logic/configuration.
2021-03-10 14:58:46 -05:00
fb2fc2335a
Require messaging service IDs; remove fallback-to-random-number logic.
2021-03-10 14:58:46 -05:00
345e116699
Place our trust in a Twilio message service.
2021-03-10 14:58:46 -05:00
e50a1c0646
Revert "Turn off alphanumeric sender ID for all countries."
...
This reverts commit 3bf0188e7f
2021-03-10 14:58:46 -05:00
3cdc58200a
Copy headers from the initial websocket upgrade request into subsequent resource requests.
2021-03-10 14:54:11 -05:00
933dd81d82
Allow callers to specify a TLS version when constructing a FaultTolerantHttpClient.
2021-03-10 10:53:33 -05:00
a1434524a4
Allow the storage service client to trust the Signal CA root.
2021-03-10 10:53:33 -05:00
cdc6afefe2
Add an affordance for providing a custom trust store to FaultTolerantHttpClient.
2021-03-10 10:53:33 -05:00
738ec2a38e
Use ForwardedIpUtil everywhere we're handling X-Forwarded-For values.
2021-03-10 10:37:10 -05:00
07886a9722
Introduce a utility class for working with forwarding chains in HTTP headers.
2021-03-10 10:37:10 -05:00
fde1b49729
Introduce a set of gauges for various network statistics as reported by `nstat`.
2021-03-09 11:45:53 -05:00
58210141f4
Discard unhelpful message count histograms.
2021-03-08 16:57:26 -05:00
af2a8548c3
Use Durations everywhere, drop unused constructors, and add tests.
2021-03-05 12:47:36 -05:00
1faedd3870
Return Retry-After time to clients when they are rate limited ( #421 )
...
* Return Retry-After time to clients when they are rate limited
* Update based on feedback
- New exception type that is mapped differently
- Always report time until allowed on rate limits
- Consume and transform into a differnt exception if we think it will be
allowed later
2021-03-05 10:23:03 -07:00
f57a4171ba
Gather IP-based metrics for international, unsealed-sender messages.
2021-03-05 11:54:01 -05:00
df9dc82de5
Record days since last seen when somebody's "last seen" date changes.
2021-03-01 15:31:53 -05:00
eb6fe11da1
Add tools to decline messages from senders meeting specific conditions
2021-02-24 18:09:26 -05:00
0ee3f0a5b5
Fix a goof where the international unsealed sender country meter was incrementing unconditionally.
2021-02-23 16:45:47 -05:00
7dabc92447
Actually increment the international unsealed-sender counter instead of just declaring its existence.
2021-02-23 15:36:36 -05:00
5354104128
Only apply unsealed sender rate limits to targeted country codes.
2021-02-23 14:17:16 -05:00
a5118e4daa
Record push challenge presence/outcomes by country.
2021-02-23 13:36:37 -05:00
b5ade5dc12
Only return payment address from latest profile ( #408 )
...
* Only return payment address from latest profile
* Rename `currentVersionedProfile` to `currentProfileVersion`
* Change return type to Optional
* Update service/src/main/java/org/whispersystems/textsecuregcm/controllers/ProfileController.java
Co-authored-by: Jon Chambers <63609320+jon-signal@users.noreply.github.com>
* Fix broken test
Co-authored-by: Jon Chambers <63609320+jon-signal@users.noreply.github.com>
2021-02-23 12:29:47 -06:00
fff8c72f42
Record the rate of unsealed-sender messages from accounts with a non-push-capable master device.
2021-02-23 12:26:23 -05:00
06ca5f14fc
Record the age of accounts that send unsealed-sender messages.
2021-02-23 12:16:45 -05:00
8c9d871268
Log different messages depending on whether rate limits are actually enforced.
2021-02-23 12:16:45 -05:00
7266eeee7a
Record the rate of international unsealed-sender attempts.
2021-02-23 12:01:09 -05:00
f85c6bf828
Demonstrate JUnit 5 works by migrating an existing test
2021-02-19 13:30:44 -06:00
93f845610d
Remove payments list from Account
2021-02-19 13:18:30 -06:00
aa8525385a
Temporarily support `IncomingMessage.online` ( #404 )
...
iOS versions prior to 5.5.0.7 send `online` on `IncomingMessage`, rather
than on the top-level entity. This adds a temporary server-side adaptation,
to prevent client-side issues, like persistent typing indicators.
2021-02-18 12:21:16 -06:00
ec783133c1
Close websockets if anything seems fishy at init time; register close handlers early.
2021-02-18 13:20:19 -05:00
71f0aab2c6
Actually start the currency managed lifecycle
2021-02-17 14:28:08 -08:00
6142998b87
Use stripToNull on payments address
2021-02-16 16:12:50 -06:00
142376f360
Add payment address to the versioned profile
2021-02-16 16:12:50 -06:00
ae329e735f
Make quote timestamp based on ftx timestamp
2021-02-16 12:02:39 -08:00
2dbab70c8c
Create utility endpoint for currency conversion
2021-02-16 11:57:34 -08:00
635f669a32
Count slow queue drain events by platform.
2021-02-12 15:43:50 -05:00
5f49772ca6
Control enforcement of unsealed sender rate limits via dynamic configuration.
2021-02-12 15:43:05 -05:00
6332552346
Record the sender's country when we reject unsealed-sender messages.
2021-02-12 15:23:52 -05:00
4fb7afcf7b
Drop the feature flags table.
2021-02-12 15:23:34 -05:00
ff448950ed
Collapse the feature flag system into the dynamic config system.
2021-02-12 15:23:34 -05:00
d6319aeb92
just set OWA,OWP,OWI user agents upon token deletion
2021-02-12 15:22:50 -05:00
8fc6f9c442
when a user unregisters, record his user agent for posterity
2021-02-12 15:22:50 -05:00
e9ea79cc8e
Shorten eviction time to 7 days (to match message retention time).
2021-02-11 14:01:11 -05:00
ad32555cc9
Drop the old push scheduler Redis singleton.
2021-02-11 14:01:11 -05:00
be8a1acca9
Remove message database from the codebase ( #395 )
...
* Remove message database from the codebase
* Remove unused ExperimentEnrollmentManager in test
* Be more stylish
2021-02-11 10:50:03 -06:00
e0ed8fa0b8
Introduce a hyper-log-log-based cardinality rate limiter
2021-02-11 10:36:26 -05:00
dcbf285fae
Un-ignore message controller tests.
2021-02-11 10:14:48 -05:00
ceda459942
Substitute some !Optional.isPresent with Optional.isEmpty
2021-02-10 13:21:44 -06:00
28fe44aea4
Remove messages dynamo db experiment
2021-02-10 10:21:49 -06:00
71510a8199
Decommission the old directory cache.
2021-02-10 11:02:11 -05:00
9cd121c8f6
Record initial queue drain times faceted by client platform.
2021-02-09 19:21:46 -05:00
2f105ed0a4
Add support for remote client deprecation
2021-02-09 12:24:44 -05:00
704d54dd01
Record a distribution of the number of keys available when checked.
2021-02-08 16:50:27 -05:00
bee9b61831
Record a distribution of initial queue depths broken down by platform.
2021-02-08 16:06:21 -05:00
9c6ce08db0
Break down message send attempts by client platform, message ephemerality, and sealed sender status.
2021-02-08 16:06:04 -05:00
6c0de89de8
Remove scary message-throttling feature flags.
2021-02-08 11:55:01 -05:00
aa99e202b4
Clarify behavioral contract of the pre-key store
2021-02-08 11:45:57 -05:00
04728ea4bc
Drop the old Postgres-based pre-key store.
2021-02-08 11:40:43 -05:00
6865cdfce3
Replace all org.hibernate validators with modern javax.validation
2021-02-08 09:45:33 -06:00
d09b36b1d5
Fix deprecated imports for Java6Assertions and Matchers
2021-02-08 09:45:33 -06:00
a5dd4f5fac
Remove signaling key from Device and AccountAttributes
2021-02-08 09:45:33 -06:00
9936b2967e
Don't use signaling key anymore
...
Signaling key was deprecated over 2 years ago. It's time for it to go.
2021-02-08 09:45:33 -06:00
0971613ac0
Remove messages table from account DB
...
This is quite out of date. Messages has been a separate database for a
long long time.
2021-02-08 09:45:33 -06:00
f7d855c59e
Drop unsealed sender rate limit logging from `info` to `debug`.
2021-02-05 11:43:37 -05:00
2fe743649d
Extract common UUID operations into a utility class.
2021-02-05 10:40:27 -05:00
a015237fd2
Don't request data from DynamoDB if we already have it locally.
2021-02-05 10:40:27 -05:00
e1f4deaacc
Add a generalized countItemsMatchingQuery method for DynamoDB stores.
2021-02-05 10:40:27 -05:00
1dceee3fa0
Make DynamoDBConfiguration more consistent.
2021-02-05 10:40:27 -05:00
3a17a7c98f
Explicitly make the dynamic config worker a daemon thread.
2021-02-04 19:05:51 -05:00
Jon Chambers