iv-org-mirror/invidious-copy-2022-03-16
1
0
Fork 0
mirror of https://gitea.invidious.io/iv-org/invidious-copy-2022-03-16.git synced 2024-08-15 00:53:18 +00:00
Code Issues Projects Releases Packages Wiki Activity

Optimize query for pulling popular videos

Browse source
This commit is contained in:
Omar Roth 2019-06-06 21:33:30 -05:00
parent fda619f704
commit 317d8703ca
No known key found for this signature in database
GPG key ID: B8254FB7EC3D37F2
1 changed files with 4 additions and 7 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

11
src/invidious/helpers/jobs.cr
View file

@ -200,13 +200,10 @@ end
def pull_popular_videos(db) def pull_popular_videos(db)
loop do loop do
subscriptions = db.query_all("SELECT channel FROM \ videos = db.query_all("SELECT DISTINCT ON (ucid) * FROM channel_videos WHERE ucid IN \
(SELECT UNNEST(subscriptions) AS channel FROM users) AS d \ (SELECT channel FROM (SELECT UNNEST(subscriptions) AS channel FROM users) AS d \
GROUP BY channel ORDER BY COUNT(channel) DESC LIMIT 40", as: String) GROUP BY channel ORDER BY COUNT(channel) DESC LIMIT 40) \
ORDER BY ucid, published DESC", as: ChannelVideo).sort_by { |video| video.published }.reverse
videos = db.query_all("SELECT DISTINCT ON (ucid) * FROM \
channel_videos WHERE ucid IN (#{arg_array(subscriptions)}) \
ORDER BY ucid, published DESC", subscriptions, as: ChannelVideo).sort_by { |video| video.published }.reverse
yield videos yield videos
sleep 1.minute sleep 1.minute