51a4a35448
* Add the parallel gem * Add prototype version of Feeds::Import with parallel URL fetching and parsing * Tune Feeds::Import and add rake task for local tests * Add rough measurer tool * Add specs * Apply suggestions by @citizen428 * Replace silence with silent * No need for eager loading * Add temporary Articles::DevFeedsImportWorker * Remove temporary rake task * Add basic error handling, copied from RssReader * Fix error handling * Remove temporary measuring rake task * Remove logging added for development purposes * Add info and error logging on error level
20 lines
569 B
Ruby
20 lines
569 B
Ruby
desc "This task is called by the Heroku scheduler add-on"
|
|
|
|
task fetch_all_rss: :environment do
|
|
Rails.application.eager_load!
|
|
|
|
RssReader.get_all_articles(force: false) # don't force fetch. Fetch "random" subset instead of all of them.
|
|
end
|
|
|
|
task fetch_feeds_import: :environment do
|
|
Feeds::Import.call
|
|
end
|
|
|
|
# Temporary
|
|
# @sre:mstruve This is temporary until we have an efficient way to handle this task
|
|
# in Sidekiq for our large DEV community.
|
|
task send_email_digest: :environment do
|
|
if Time.current.wday >= 3
|
|
EmailDigest.send_periodic_digest_email
|
|
end
|
|
end
|