Feed duplicate hash issue

Support requests, bug reports, etc. go here. Dedicated servers / VDS hosting only
Striker21
Bear Rating Trainee
Bear Rating Trainee
Posts: 42
Joined: 27 Oct 2015, 00:30

Feed duplicate hash issue

Postby Striker21 » 08 Oct 2016, 16:41

VPS, Ubuntu 14.04, PostgreSQL, TT-RSS v16.8 (main git)

Hi fox and everyone,

I'm trying to understand what is happening with the following feeds and what options I have.

On my TTRSS user I'm following these two sites:
A) http://www.mondoplay.it
B) http://www.mondoxbox.com

They belong to the same network; Website A) have all news, while website B) has only the xbox related news. All news are hosted independently on each domain/server URL and content wise (even if they clearly shared between the two sites).

They have an RSS feed each with unique links http://feeds.feedburner.com/mondoplay/news and http://feeds.feedburner.com/mondoxbox/mxnews. Now I need to track news on both sites as if they are their own sites (as they technically are), but as it turns out when e.g. tiny is fetching news from the mondoxbox.com RSS feed that have already been fetched through the mondoplay.it RSS feed it claims are are duplicate entries so they are not being added to mondoxbox.com entry in tiny which is a problem.

Now I presume this is down to the hash which seems to not care that it's different domains / separate tiny entries? I see the logic of why to expect that no users want to see duplicates if they add feeds using crossover sources, but is there a way to make an exception, a plugin or some way of having an option for this?

Chris

JustAMacUser
Bear Rating Overlord
Bear Rating Overlord
Posts: 373
Joined: 20 Aug 2013, 23:13

Re: Feed duplicate hash issue

Postby JustAMacUser » 08 Oct 2016, 19:00

You'll want to take a look at this:



And this:



To answer your question: the HOOK_ARTICLE_FILTER doesn't allow the guid to be modified, you might be able to catch it earlier by using HOOK_FEED_FETCHED, but you'll have to process the entire feed in the plugin. Probably the best you're going to get in this situation but others might have some ideas.

You could also consider reverting the commit I referenced above so you have the preference option again, but that could cause problems down the road as the code changes since you'd have to maintain that part.

User avatar
fox
^ me reading your posts ^
Posts: 6318
Joined: 27 Aug 2005, 22:53
Location: Saint-Petersburg, Russia
Contact:

Re: Feed duplicate hash issue

Postby fox » 08 Oct 2016, 19:47

personally I wouldn't recommend reverting that

plugin is the way to go here


Return to “Support”

Who is online

Users browsing this forum: Google [Bot] and 13 guests