a064b25a14
Fix CDS writer to use AccountsManager.
2021-09-10 11:36:06 -06:00
bd40e32f3b
Send acceptable languages instead of request into the profile badge converter
2021-09-10 10:53:04 -05:00
81a21c0d5f
Use @NotNull since @NotEmpty doesn't support URL
2021-09-10 10:49:31 -05:00
6478210330
Update configuration for badges to use URL instead of String
2021-09-10 10:49:31 -05:00
aa1c37fe26
Create configuration for badges
2021-09-10 10:14:16 -05:00
6ee23b0186
Create resource bundle for badges
2021-09-10 10:11:56 -05:00
40eb445592
Add a command to set a user's discoverability in CDS
2021-09-10 10:34:20 -04:00
ce7d687205
Add a shutdown monitor that publishes shutdown state as a metric
2021-09-08 16:37:05 -04:00
758900b7a8
Register AuthEnablementApplicationEventListener
2021-09-08 13:11:09 -07:00
539b62a829
Add request event listener that handles device.isEnabled changes
2021-09-08 13:11:09 -07:00
2866f1b213
Include e164 in account creation (whoami) responses
2021-09-07 16:52:32 -04:00
fc1465c05d
Wire up stored account badges to the profile endpoints
2021-09-07 15:51:29 -05:00
bc887ec6fa
Add visibility flag to badge storage
2021-09-07 15:50:29 -05:00
84b3d324bb
Creates a storage object for badges
2021-09-07 15:49:41 -05:00
fc10108788
Make fields final in Badge entity
2021-09-07 15:39:48 -05:00
fbbc1bec58
Add badge entity to profile
2021-09-07 15:39:48 -05:00
2059bb5ef8
Update test to handle read-then-write in ContactDiscoveryWriter.
2021-09-07 13:41:47 -06:00
b080a5db4d
Get-and-set accounts, since other updates may have made them stale.
...
Co-authored-by: Chris Eager <79161849+eager-signal@users.noreply.github.com>
2021-09-07 13:41:47 -06:00
b4aabd799b
Canonical discoverability writing.
2021-09-07 13:41:47 -06:00
92f035bc2a
Add a "change number" device/account capability
2021-09-07 15:07:30 -04:00
18a6df34bd
Add timers to `processChunk` and `deleteRecentlyDeletedUuids`
2021-09-03 14:54:51 -07:00
b1274125c9
Add start/chunk/sleep logging to crawler
2021-09-03 14:54:51 -07:00
dceebc1c8d
Consistently use `whenCompleteAsync(…, migrationThreadPool)`
2021-09-03 14:02:51 -07:00
6aadb4b458
Parameterize registration lock constructor when updating account attributes
2021-09-03 14:02:27 -07:00
703405b874
Start WebSocket before registering its presence
2021-08-27 16:41:07 -04:00
d1735c7e57
Retire `AmbiguousIdentifier`
2021-08-27 13:40:46 -04:00
1f815b49dd
Measure APNs rejections by reason
2021-08-27 11:52:29 -04:00
a9339b7037
Update to Pushy 0.15.0
2021-08-27 11:52:29 -04:00
f2c6ca182d
Include the current server version in the tag list for Dropwizard metrics
2021-08-27 11:52:11 -04:00
b946c27a20
Remove a metric aggregator
2021-08-27 11:52:11 -04:00
8a8a848fac
Record error metrics from Twilio Verify
2021-08-26 12:22:17 -04:00
aeb9f67266
Migrate MessageSenderTest to JUnit 5
2021-08-25 12:25:10 -05:00
e08c5a412e
Insert ephemeral messages in the standard cache queue
2021-08-25 12:25:10 -05:00
a7443a9ece
Don’t persist ephemeral messages; clear ephemeral field when sending to clients
2021-08-25 11:17:00 -05:00
54fe3b9a43
Update TextSecure.proto
2021-08-25 11:17:00 -05:00
ba522b1691
Clean redis message cache structure
2021-08-24 10:30:52 -05:00
739c5bf22c
Add a counter to estimate announcement group adoption
2021-08-23 17:31:34 -04:00
7cdadeb791
Register circuit breaker metrics for FaultTolerantPubSubConnection
2021-08-23 15:49:19 -05:00
dadf43b93e
Consolidate directory reconciliation on v3 endpoints
2021-08-19 14:18:38 -05:00
19f7b207b7
Extract configuration for WebSocket max message sizes
2021-08-19 14:09:57 -05:00
a398e2269c
Update `AccountsManager` mismatch comparison
2021-08-19 14:08:48 -05:00
2e28fb97a4
Delete DynamoDB accounts with invalid UUIDs in AccountsManager#create
2021-08-19 14:05:21 -05:00
5c68d83a93
Add integration test for re-registration with and without Dynamo DB
2021-08-19 14:05:21 -05:00
0b7c3ad745
.editorconfig formatting
2021-08-16 16:32:26 -05:00
0cde06557d
Catch and log unexpected exceptions keyspace notification executor service
2021-08-16 16:32:26 -05:00
27844fe692
Add JUnit 5 RedisClusterExtension
2021-08-13 12:07:04 -05:00
779051ef9f
Add minThreads(64) to multiRecipientMessageExecutor
2021-08-12 13:03:40 -05:00
d13741fbd5
Change from using parallel streams to using an ExecutorService
2021-08-12 12:05:01 -05:00
f7f870fe62
Execute send multi-recipient message loop in parallel
2021-08-12 12:05:01 -05:00
de59aa099d
Add uncaught exception handler
2021-08-12 11:10:05 -05:00
57a478b898
Remove unused local variable
2021-08-12 10:26:23 -05:00
3e8d79e147
Remove unused lua script to delete by sender and timestamp
2021-08-11 17:38:55 -05:00
a46045d987
Remove unused methods that delete messages by sender and timestamp
2021-08-11 17:30:39 -05:00
662c905b80
Remove deprecated delete messages endpoint
...
DELETE /v1/messages/{source}/{timestamp} has been deprecated a long
time and has minimal usage each day at this point. Dropping support
for this endpoint to improve message cache storage flexibility.
2021-08-11 16:17:44 -05:00
31022aeb79
Use refreshing `AuthenticatedAccount` for `@Auth`
2021-08-11 14:52:25 -05:00
b3e6a50dee
Send 508 status code for legacy clients that produce rate limit challenges
2021-08-11 11:57:30 -05:00
d29764d11f
Only process updates for enabled devices in PushFeedbackProcessor
2021-08-11 11:54:42 -05:00
f8e4f6727a
Reorder crawler listeners so updates happen after read-only processing
2021-08-11 11:54:20 -05:00
63d05df8a3
Fix indentation
2021-08-10 10:02:04 -05:00
52d13d1d62
Remove unused lua script
2021-08-10 10:02:04 -05:00
f58a320223
Remove unused method from MessagesCache
2021-08-10 10:02:04 -05:00
3e01bc1174
Add metric for content-length header distribution
2021-08-06 14:41:16 -05:00
d1ada7f998
Revert "Continue to verify rate limiters by e164 during UUID migration period"
...
This reverts commit ce5edbb7fc
2021-08-06 14:33:59 -05:00
73c368ea86
Use UUIDs instead of e164s to associate accounts with push notifications.
2021-08-04 14:38:28 -04:00
ce5edbb7fc
Continue to verify rate limiters by e164 during UUID migration period
2021-08-04 14:15:21 -04:00
a680639718
Use UUIDs as rate limiter keys.
2021-08-04 14:15:21 -04:00
becf6afbdd
Block until all UUID bytes are read or EOF
2021-08-03 17:59:48 -05:00
1dda015c6a
Update multi-recipient message sending to handle unrestricted destinations
2021-08-03 17:31:39 -05:00
a0427ecf8c
Update s3-upload-maven-plugin to 1.6-SNAPSHOT
2021-08-03 11:04:29 -05:00
cfd31e98ff
Move version comparison to after more meaningful checks
2021-08-03 11:03:41 -05:00
bcb89924b4
Simplify optimistic write logic
2021-08-03 11:54:26 -04:00
1f6318a919
Rename constant
2021-08-02 13:14:44 -05:00
b0667b258b
Implement EnterpriseRecaptchaClient
2021-08-02 13:14:44 -05:00
4c3a48f5be
Use more specific prefix for recaptcha transition
2021-08-02 13:14:44 -05:00
33fb7a72de
Use RecaptchaClient interface
2021-08-02 13:14:44 -05:00
2c808e369c
Create a transitional recaptcha client for upgrading
2021-08-02 13:14:44 -05:00
906d0be382
Setup recaptcha client interface
2021-08-02 13:14:44 -05:00
1c9a3c6105
Bringing in Google Cloud Recaptcha Enterprise libraries
2021-08-02 13:14:44 -05:00
2aaddd721f
Rename existing captcha client
2021-08-02 13:14:44 -05:00
4e2284b83f
Retire old GV2 adoption metrics.
2021-08-02 12:51:49 -05:00
d5d9978e48
Use non-stale account in mutator when adding a new device
2021-08-02 11:38:03 -05:00
d45659ac76
Reduce contention when updating `device.lastSeen`
2021-08-02 11:26:15 -05:00
13a07dc6cd
Drop the active user counter.
2021-07-29 15:40:27 -04:00
51b7a8d868
Add excluded E164s configuration to pre-registration experiment
2021-07-29 14:16:40 -05:00
df9c0051c9
Reconcile inactive and undiscoverable accounts when using v3 endpoints
2021-07-29 10:56:44 -05:00
331ff83cd5
Drop legacy PIN-based registration lock plumbing
2021-07-29 11:51:14 -04:00
44838d6238
Verify that nobody's addressing API calls by e164 any more.
2021-07-29 11:50:36 -04:00
5400abb065
Better support unhandled exception logging on websocket requests
2021-07-28 14:06:09 -05:00
f47fefb73e
Lock accounts for the duration of deletion operations.
2021-07-27 13:12:39 -04:00
cdef745a7a
Drop a not-very-helpful metric (logging works better in this case).
2021-07-27 13:12:39 -04:00
1a1eab4ec0
Also clear profiles on re-registration.
2021-07-27 13:05:54 -04:00
3a966ef345
Reuse account UUIDs when registering an account with a recently-deleted e164.
2021-07-27 13:05:54 -04:00
be20c04cd8
Identify accounts for which to delete keys by UUID.
2021-07-27 13:05:54 -04:00
d09dcc90fe
Add methods for getting, clearing, locking recently-deleted account records.
2021-07-27 13:05:54 -04:00
0117fc12c7
Actually increment the moved "new user" counter.
2021-07-27 12:09:51 -04:00
ef9a7fda9a
Publish outstanding SQS operation count as a gauge.
2021-07-27 11:15:41 -04:00
13447df1e0
Update validation for NotNull items in IncomingMessagesList
2021-07-27 10:39:30 -04:00
3608c5bfb0
Wait for outstanding requests to be resolved before shutting down the directory queue.
2021-07-27 10:36:53 -04:00
34dbff6786
Switch to an async SQS client.
2021-07-27 10:36:53 -04:00
a6066bfc2f
Migrate DirectoryQueueTest to JUnit 5.
2021-07-27 10:36:53 -04:00
8579190cdf
Consolidate account creation/directory updates into `AccountsManager`
2021-07-27 10:27:47 -04:00
917f667229
Remove AccountController and KeysController from websocket
2021-07-26 14:27:43 -05:00
317a551bdb
Migrate MetricsRequestEventListenerTest to JUnit 5
2021-07-26 12:06:29 -05:00
27e9271473
Add request path and user agent to unhandled exception logging
2021-07-26 12:06:29 -05:00
11dff6c546
more controllers
2021-07-26 12:06:17 -05:00
e6712937ca
fix indent
2021-07-26 12:06:17 -05:00
cf8887bb5a
Provide more WebSocket endpoints
2021-07-26 12:06:17 -05:00
696340f780
Migrate DeviceControllerTest to JUnit 5
2021-07-26 11:18:17 -05:00
86ddcbaa08
Migrate CertificateControllerTest to JUnit 5
2021-07-26 11:18:17 -05:00
2144d2a8d8
Migrate AttachmentControllerTest to JUnit 5
2021-07-26 11:18:17 -05:00
f7af861b31
Migrate SecureStorageControllerTest to JUnit 5
2021-07-26 11:18:17 -05:00
208a09b3ae
Migrate RemoteConfigControllerTest to JUnit 5
2021-07-26 11:18:17 -05:00
831023e41d
Migrate PaymentsControllerTest to JUnit 5
2021-07-26 11:18:17 -05:00
ff627793d6
Migrate DirectoryControllerTest to JUnit 5
2021-07-26 11:18:17 -05:00
f971c76a99
Migrate StickerControllerTest to JUnit 5
2021-07-26 11:18:17 -05:00
8f41176c76
Enable "sms" transport for +98
2021-07-26 10:40:05 -05:00
31bbbbb5e0
Raise default message TTL to 14 days
2021-07-20 14:08:08 -05:00
effcd6038d
Also record dimensional metrics for circuit breakers and retries.
2021-07-19 16:56:16 -04:00
12be7d49c2
Clear one-time pre-keys on re-registration.
2021-07-19 10:05:01 -04:00
14863b575e
Clear one-time pre-keys when a device is unlinked.
2021-07-19 10:05:01 -04:00
32a95f96ff
Add a pessimistic locking system for operations on recently-deleted account records
2021-07-16 16:52:58 -04:00
b757d4b334
Measure how many "send message" requests are still using e164-based addressing.
2021-07-16 16:52:58 -04:00
bd03d910fe
Set authenticated device after updating last seen
2021-07-16 16:52:58 -04:00
01ef855157
Return a non-stale account from base authenticator when last seen is updated
2021-07-16 16:52:58 -04:00
817866caf3
Use fresh accounts to update in PushFeedbackProcessor
2021-07-16 16:52:58 -04:00
158d65c6a7
Add optimistic locking to account updates
2021-07-16 16:52:58 -04:00
62022c7de1
Migrate AppConfig to SDK v2 to detect and use web identify token
2021-07-16 16:48:33 -04:00
a824b5575d
Add dynamic configuration for using DynamoDB in AccountsDatabaseCrawler
2021-07-06 13:01:24 -05:00
78819d5382
Remove expiration logic when checking token validity.
...
The data store will no longer return tokens that have expired, and we no longer need to check for expiration in application space.
2021-07-06 11:03:49 -04:00
d128bc782a
Retire Postgres-backed pending account/device tables.
2021-07-06 11:03:49 -04:00
530b2a310f
Ensure active future is always completed
2021-07-02 15:05:11 -05:00
d5b0d99a54
Remove unused method
2021-07-02 15:05:11 -05:00
43be72d076
Add test for ManagedPeriodicWork; fix shutdown not awaiting active execution
2021-07-02 15:05:11 -05:00
9558944e22
Add needsReconciliationIndexName to sample.yml
2021-07-02 15:05:11 -05:00
0f6c866c8d
Update imports
2021-07-02 15:05:11 -05:00
bac78e9291
Switch DeletedAccountsTableCrawler metrics to a basic Metrics#summary
2021-07-02 15:05:11 -05:00
c22ea78672
Add crawler to process migration retry accounts
2021-07-02 15:05:11 -05:00
a85afe827d
Avoid NPE by using scheduledFuture as the Gauge state object
2021-07-02 15:05:11 -05:00
abaed821ec
Add additional case to unit test
2021-07-02 15:05:11 -05:00
6fa9dcd954
Refactor to use shared recurringJobExecutor
2021-07-02 15:05:11 -05:00
819d59cd79
Update reconciliation crawler to use secondary index
2021-07-02 15:05:11 -05:00
2f88f0eedb
Refactor to use single threaded scheduled executor
2021-07-02 15:05:11 -05:00
74ff491671
Rename ManagedPeriodicWorkCache to ManagedPeriodicWorkLock
2021-07-02 15:05:11 -05:00
eac48a6617
Don’t delete accounts after reconciling
2021-07-02 15:05:11 -05:00
19617c14f8
Improved logging in ManagedPeriodcWork
2021-07-02 15:05:11 -05:00
fc7291c3e8
Migrate DeletedAccountsTableCrawler to ManagedPeriodicWork
2021-07-02 15:05:11 -05:00
88db808298
Add abstract ManagedPeriodicWork
2021-07-02 15:05:11 -05:00
5193abdab3
Add DeletedAccountsTableCrawler
2021-07-02 15:05:11 -05:00
a315c9be92
Add DeletedAccounts DynamoDB table
2021-07-02 15:05:11 -05:00
fc1541591a
Add AbstractDynamoDbStore#scan
2021-07-02 15:05:11 -05:00
ae97c4db9f
Use editorconfig in AbstractDynamoDbStore
2021-07-02 15:05:11 -05:00
26bc5973b5
Clear message queue before and after removing a device
2021-07-02 10:48:42 -05:00
e52b8c8423
Implement DatadogConfig in DatadogConfiguration
2021-07-02 10:48:05 -05:00
7395489bac
Add tests for pending account/device managers.
2021-07-02 11:30:13 -04:00
b384ed7f5c
Add a counter for requests for delivery certificates with/without e164s.
2021-07-01 10:59:10 -04:00
e3afcae7d3
Gather data to verify safety of retiring legacy reglock system.
2021-07-01 10:58:47 -04:00
9faeed7b20
Count E164 authentications versus UUID authentications.
2021-07-01 10:51:34 -04:00
49adcca80e
Use Optional.isEmpty().
2021-07-01 10:51:34 -04:00
49c43a6816
Simplify distribution summary for "days since last seen."
2021-07-01 10:51:34 -04:00
84f85ae098
Collapse various account meters into a single, multi-dimensional counter.
2021-07-01 10:51:34 -04:00
3d581941ab
Add plumbing and configuration to migrate pending accounts/devices to DynamoDB.
2021-07-01 10:50:52 -04:00
d2d39baede
Add a DynamoDB-backed stored verification code store.
2021-07-01 10:50:52 -04:00
111f5ba024
Use java.time classes for stored verification code expiration; add tests.
2021-07-01 10:50:52 -04:00
ce3fb7fa99
Extract a common base class for verification code store tests.
2021-07-01 10:50:52 -04:00
fc421d3f21
Introduce a common interface for verification code stores.
2021-07-01 10:50:52 -04:00
71bea759c6
Consolidate StoredVerificationCode constructors.
2021-07-01 10:50:52 -04:00
bf1dd791a5
Drop caching for pending accounts/devices.
2021-07-01 10:50:52 -04:00
4c99577c08
Add configuration for Datadog batch size
2021-06-30 16:44:25 -05:00
5d5c63e6d4
Update profile controller to S3 AWSv2.
2021-06-30 13:09:18 -06:00
42ff3f8432
Switch SQS to Amazon SDKv2.
2021-06-30 12:46:12 -06:00
be6ef76486
Update DynamoDBLocal to 1.16.0
2021-06-23 13:50:58 -05:00
7883352b74
Match random capability generation in test
2021-06-21 17:32:31 -05:00
982d122d18
Match random capability generation in test
2021-06-21 17:32:31 -05:00
d8d94407c6
Create announcement group capability
2021-06-21 17:32:31 -05:00
28cfc54170
Update FunctionCounter builder to use non-null object and method
2021-06-11 11:27:45 -05:00
2ee7279743
Pause nstat counters.
2021-06-11 12:26:56 -04:00
eb1b073385
Add a hostname-aware reporter factory.
2021-06-10 14:23:05 -04:00
c634185b6f
Standardize a utility method for getting local host names.
2021-06-10 14:23:05 -04:00
2c33d22a30
Stop recording specific client versions in metrics until we know we need them again.
2021-06-08 12:25:31 -04:00
b41ed9d810
Update sample.yml config
2021-06-07 17:21:36 -04:00
58d3a12eff
Set hostname to lowercase to avoid strange case mismatch issues; log hostname failures.
2021-06-07 17:17:46 -04:00
88c4b2be97
Correct a misunderstanding about the metrics host tag.
2021-06-07 16:29:44 -04:00
6cbd57f19f
Include environment/service/version as common metric tags.
2021-06-04 18:17:09 -04:00
5522376584
Include a host tag with metrics.
2021-06-04 18:17:09 -04:00
5089c37d28
Drop a pair of unused commands.
2021-06-04 12:35:06 -04:00
1ccf24e68c
Add a command to check dynamic config files.
2021-06-04 12:34:48 -04:00
411f7298f2
Enforce validation constraints for dynamic configuration objects.
2021-06-04 12:34:48 -04:00
5b0214c6f2
Make pre-key `take` operations more null-safe
2021-06-04 11:18:59 -04:00
735573e61b
Make reporting intervals configurable.
2021-06-03 17:50:41 -04:00
c545cff1b3
Switch DynamoDB to AWSv2.
...
Switch from using com.amazonaws.services.dynamodbv2 to using
software.amazon.awssdk.services.dynamodb for all current DynamoDB uses.
2021-06-03 13:37:10 -06:00
cbd9681e3e
Configure histograms and exclude high-cardinality metrics.
2021-06-03 14:12:02 -04:00
ca876e40ca
Add a second metric aggregator.
2021-06-03 14:12:02 -04:00
76f5a71727
Include server version in logging tags
2021-06-03 11:24:25 -04:00
117de2382d
Verify that API consumers can skip/clear VOIP tokens.
2021-06-02 16:50:49 -05:00
25e7036451
Send a payload with mutable content for non-VOIP topics.
2021-06-02 16:50:49 -05:00
3131bd3dd9
Allow iOS callers to specify whether they're providing a VOIP token for preauth.
2021-06-02 16:50:49 -05:00
c97be15e79
Fix NPE when a null message comes in from a client
2021-06-01 15:00:41 -06:00
164fc40990
Rename receipt type and add new client-to-client plaintext type for decryption error receipts
2021-05-28 11:33:44 -05:00
6456af6284
Upgrade to latest protobuf
...
This upgrades to protobuf 3.17 and uses maven to automatically rebuild
the generated code instead of using prefabricated checked in Java
files.
2021-05-28 11:33:44 -05:00
6f0750790c
Add metric to count number of legacy messages sent
2021-05-27 11:13:42 -05:00
Graeme Connell