docbrown/app/workers
Jamie Gaskins 9423060299
Fan out Feeds::ImportArticlesWorker (#16818)
* Fan out Feeds::ImportArticlesWorker

Doing all that work within a single Sidekiq job has begun taking over an
hour on DEV. Regardless of the reasons we did it that way originally, we
should be able to handle this concurrently. If we cannot, we need to
investigate why and handle it properly rather than consigning it to
sequential work.

* Fix specs

The specs make assumptions about how the code under test is implemented.
This commit does not change that, as much as I would like to. Instead,
it just aligns the assumptions with the new implementation.

The previous tests didn't actually represent reality though, since we
can't get a Time or ActiveSupport::TimeWithZone instance inside of the
`perform` method while running it through Sidekiq. Instead, the specs
seem to be relying on the fact that the time instance gets serialized to
ISO-8601/RFC3339 format and that that format is understood by Postgres.
Otherwise, I'm not sure how it would work in production as written.

The new specs reflect reality more closely. The `earlier_than` value
will be converted into an ISO8601/RFC3339 string when passed through
Sidekiq.

* Add parens to perform_bulk call

Turns out, we actually do this pretty consistently. I could've sworn I
saw a bunch of these calls without parens. ¯\_(ツ)_/¯

* Improve variable naming

This is not a list of ids, it's a list of lists of arguments for Sidekiq
jobs, the inner of which contains an id, but that's not the only thing
it contains.
2022-03-08 15:39:16 -05:00
..
articles Ensuring we don't track views of author or unpublished (#16143) 2022-01-18 11:23:18 -05:00
badge_achievements Split BadgeRewarder into multiple services (#11902) 2020-12-23 09:55:06 -05:00
broadcasts Add one day to the new users range (#16065) 2022-01-11 15:33:33 -06:00
comments Refactor EdgeCache (#11684) 2020-12-02 14:20:22 -05:00
credits Refactor:Move Credit Counter Cache Sync to Sidekiq (#9972) 2020-08-24 14:20:11 -05:00
discover Add Forem Discover registration worker and service (#14865) 2021-10-01 10:27:31 -04:00
emails Remove txn from with_statement_timeout block (#15088) 2021-10-15 14:53:35 -04:00
feeds Fan out Feeds::ImportArticlesWorker (#16818) 2022-03-08 15:39:16 -05:00
follows Use the tag_list method, rather than the cached_tag_list attribute (#15638) 2021-12-03 14:47:42 -06:00
github_repos Only update GithubRepos once in RepoSyncWorker (#14175) 2021-07-09 09:58:20 -04:00
html_variants [deploy] Optimization:Use delete_by when Destroying HtmlVariant Trials and Successes (#10332) 2020-09-14 15:40:30 -05:00
listings Update bust_listings to service (#12050) 2020-12-29 09:52:34 +01:00
mentions [15-min-fix] Ensure mention worker delivers email (#14038) 2021-06-22 14:29:56 -04:00
metrics Login with Google (#15986) 2022-01-13 10:25:52 -06:00
moderator Admin productivity: Allow admins to unpublish all posts from a user (#15054) 2021-10-15 08:56:59 +02:00
notification_subscriptions Add Article post_commit when user_id changes with specs (#15132) 2021-10-25 10:53:21 +07:00
notifications Use new UserSetting and UserNotificationSettings and Ignore Related User Table Fields (#14121) 2021-07-08 09:31:34 -05:00
organizations Asynchronous organization delete (#13388) 2021-04-19 18:30:35 +03:00
pages Update .bust_page to EdgeCache::BustPage (#11952) 2020-12-18 11:21:54 -05:00
podcast_episodes Update bust_podcast_episode to EdgeCache::BustPodcastEpisode (#12049) 2020-12-29 09:49:13 +01:00
podcasts Use perform_bulk in Podcasts::EnqueueGetEpisodesWorker (#16325) 2022-01-28 11:32:25 +07:00
push_notifications Update deliver worker conflict strategy (#15961) 2022-01-05 11:48:22 -06:00
rating_votes Remove Elasticsearch ✂️ ✂️ ✂️ ✂️ ✂️ ✂️ ✂️ ✂️ ✂️ ✂️ ✂️ ✂️ ✂️ ✂️ (#13606) 2021-05-03 11:09:45 -04:00
reactions Extracting Article.featured scope (#15612) 2021-12-01 12:16:32 -05:00
slack/messengers Remove SlackBotPingWorker (#7587) 2020-04-29 08:51:36 -04:00
tags Suggest top tags when tag search is empty (#14817) 2021-09-30 09:41:20 +01:00
users Fix goal conversion field test typo (#15985) 2022-01-06 16:34:36 -05:00
bust_cache_base_worker.rb Force Unique Jobs for User Initiated Jobs and Cache Jobs (#7688) 2020-05-06 08:27:17 -05:00
bust_cache_path_worker.rb Update bust to EdgeCache::Bust (#12052) 2020-12-29 09:53:15 +01:00
capture_query_stats_worker.rb Add PGHero for more insights into the DB (#15073) 2021-11-05 12:25:02 -04:00
data_update_worker.rb Add ability to re-run a data script from the the data update script page (#12424) 2021-02-02 17:24:39 +02:00
export_content_worker.rb Update data exporter to handle admin send (#10274) 2020-10-26 18:00:56 -04:00
migrate_data_to_work_field_worker.rb Fix data update script for work field migration (#14207) 2021-07-13 13:20:21 +07:00