Page 1 of 1

Feed duplicate hash issue

Posted: 08 Oct 2016, 16:41
by Striker21
VPS, Ubuntu 14.04, PostgreSQL, TT-RSS v16.8 (main git)

Hi fox and everyone,

I'm trying to understand what is happening with the following feeds and what options I have.

On my TTRSS user I'm following these two sites:
A) http://www.mondoplay.it
B) http://www.mondoxbox.com

They belong to the same network; Website A) have all news, while website B) has only the xbox related news. All news are hosted independently on each domain/server URL and content wise (even if they clearly shared between the two sites).

They have an RSS feed each with unique links http://feeds.feedburner.com/mondoplay/news and http://feeds.feedburner.com/mondoxbox/mxnews. Now I need to track news on both sites as if they are their own sites (as they technically are), but as it turns out when e.g. tiny is fetching news from the mondoxbox.com RSS feed that have already been fetched through the mondoplay.it RSS feed it claims are are duplicate entries so they are not being added to mondoxbox.com entry in tiny which is a problem.

Now I presume this is down to the hash which seems to not care that it's different domains / separate tiny entries? I see the logic of why to expect that no users want to see duplicates if they add feeds using crossover sources, but is there a way to make an exception, a plugin or some way of having an option for this?

Chris

Re: Feed duplicate hash issue

Posted: 08 Oct 2016, 19:00
by JustAMacUser
You'll want to take a look at this:

https://tt-rss.org/forum/viewtopic.php?f=1&t=3616&p=21634#p21636

And this:

https://tt-rss.org/gitlab/fox/tt-rss/commit/5bdcb8fd7834964d69550a788d9c666c14964f21

To answer your question: the HOOK_ARTICLE_FILTER doesn't allow the guid to be modified, you might be able to catch it earlier by using HOOK_FEED_FETCHED, but you'll have to process the entire feed in the plugin. Probably the best you're going to get in this situation but others might have some ideas.

You could also consider reverting the commit I referenced above so you have the preference option again, but that could cause problems down the road as the code changes since you'd have to maintain that part.

Re: Feed duplicate hash issue

Posted: 08 Oct 2016, 19:47
by fox
personally I wouldn't recommend reverting that

plugin is the way to go here