Page 1 of 1

Feed duplicate hash issue

Posted: 08 Oct 2016, 16:41
by Striker21
VPS, Ubuntu 14.04, PostgreSQL, TT-RSS v16.8 (main git)

Hi fox and everyone,

I'm trying to understand what is happening with the following feeds and what options I have.

On my TTRSS user I'm following these two sites:

They belong to the same network; Website A) have all news, while website B) has only the xbox related news. All news are hosted independently on each domain/server URL and content wise (even if they clearly shared between the two sites).

They have an RSS feed each with unique links and Now I need to track news on both sites as if they are their own sites (as they technically are), but as it turns out when e.g. tiny is fetching news from the RSS feed that have already been fetched through the RSS feed it claims are are duplicate entries so they are not being added to entry in tiny which is a problem.

Now I presume this is down to the hash which seems to not care that it's different domains / separate tiny entries? I see the logic of why to expect that no users want to see duplicates if they add feeds using crossover sources, but is there a way to make an exception, a plugin or some way of having an option for this?


Re: Feed duplicate hash issue

Posted: 08 Oct 2016, 19:00
by JustAMacUser
You'll want to take a look at this:

And this:

To answer your question: the HOOK_ARTICLE_FILTER doesn't allow the guid to be modified, you might be able to catch it earlier by using HOOK_FEED_FETCHED, but you'll have to process the entire feed in the plugin. Probably the best you're going to get in this situation but others might have some ideas.

You could also consider reverting the commit I referenced above so you have the preference option again, but that could cause problems down the road as the code changes since you'd have to maintain that part.

Re: Feed duplicate hash issue

Posted: 08 Oct 2016, 19:47
by fox
personally I wouldn't recommend reverting that

plugin is the way to go here