Page 1 of 2

Spiegel RSS feed no longer working

Posted: 10 Nov 2013, 15:51
by bratscher
Hi all,

I'm interested if someone else experienced this problem. Since several days the RSS feed by Spiegel online no longer works with ttrss:

http://www.spiegel.de/schlagzeilen/index.rss

I'm running ttrss 1.10 on a self hosted machine running Ubuntu 12.04 LTS, 64-bit with apache 2.2.22. PHP is version 5.3.10.
Postgres in 9.1.10. No ttrss plugins are enabled.

The interesting thing is that I haven't performed any updates inbetween.

The android clients shows the same behaviour.

Is there more I can do to pinpoint that problem?

Regards,

bratscher

[1.10] One Feed is not updating

Posted: 10 Nov 2013, 16:18
by saedelaere
Hi,


I have installed Tiny Tiny RSS on my Debain Wheezy and I am very happy with it. So far mostly everything works perfect. I am using the update daemon (update_daemon2.php) to get the latest feeds.
I have problems with one german news portal www.spiegel.de

It offers different RSS feeds
http://www.spiegel.de/schlagzeilen/tops/index.rss
http://www.spiegel.de/schlagzeilen/index.rss

But none of them work. I don't get any updates. I can see one or two articles sometimes but thats it.
Funnily I found out they also provide an RSS Feed via their mobile website and this one is working:

http://ml.spiegel.de/rss.do

Anyone an idea what the problem could be?

Thanks for this great application!

Re: Spiegel RSS feed no longer working

Posted: 10 Nov 2013, 21:56
by Latimer
Feed validator results: This feed does not validate

Re: Spiegel RSS feed no longer working

Posted: 11 Nov 2013, 00:01
by saedelaere
Just found something on twitter
https://twitter.com/search?q=SPIEGEL%20ONLINE%20RSS&src=typd

So they say that they have changed their RSS feeds and know about the problem. Unfortunately I started using Tiny Tiny RSS on the same day and thought something would be wrong with my settings :D

Re: Spiegel RSS feed no longer working

Posted: 11 Nov 2013, 01:34
by Latimer
There was a plugin that was fixing broken ids in one of the xkcd feeds. You can try to repurpose it for Spiegel's feeds if nothing else helps.

e: af_whatif

Re: Spiegel RSS feed no longer working

Posted: 11 Nov 2013, 23:56
by Marty
On Twitter people are reporting that SPIEGEL ONLINE works again in Feedly. But still no updates in tt-rss! :x
SPON doesn't seem to have changed their feeds - all the articles have still the same <guid>!
After reading their response to my mail, I'm not sure if SPON is really working on the problem... :(

Does anyone know how to make the feeds work again - maybe using the ff_FeedCleaner or the af_whatif plugin? :?:

Re: Spiegel RSS feed no longer working

Posted: 12 Nov 2013, 01:18
by feader
Marty wrote:Does anyone know how to make the feeds work again - maybe using the ff_FeedCleaner or the af_whatif plugin? :?:


I think a similar case was discussed on the forum some time ago. You can try to use ff_FeedCleaner with

Code: Select all

[
   {
      "URL": "spiegel.de",
      "type": "xpath_regex",
      "xpath": "//item/guid",
      "pattern": "/.+/",
      "replacement": ""
   }
]

in its config. ttRSS should then use the <link> tag to create the (internal) article guids.

e: Old config didn't work.
e2: Should work with versions ≥ dded7ae.

Re: Spiegel RSS feed no longer working

Posted: 12 Nov 2013, 17:46
by sesom
Marty wrote:... maybe using the ff_FeedCleaner or the af_whatif plugin? :?:


Neither one fixes that problem for me. :(

Re: Spiegel RSS feed no longer working

Posted: 12 Nov 2013, 20:30
by Latimer
Another thing to consider would be to roll your own feed with yahoo pipes.

Re: Spiegel RSS feed no longer working

Posted: 12 Nov 2013, 20:42
by fox
One could also consider choosing one of the news outlets that don't actively shit on their userbase.

Re: Spiegel RSS feed no longer working

Posted: 12 Nov 2013, 21:35
by feader
sesom wrote:
Marty wrote:... maybe using the https://github.com/wltb/ff_feedcleaner or the af_whatif plugin? :?:


Neither one fixes that problem for me. :(

The config for ff_FeedCleaner I posted yesterday did indeed fail to remove the guids, I edited the post. This one should work.

Re: Spiegel RSS feed no longer working

Posted: 12 Nov 2013, 21:47
by reibuehl
feader wrote:The config for ff_FeedCleaner I posted yesterday did indeed fail to remove the guids, I edited the post. This one should work.


Yes, the new code works. Thanks very much for sharing it!

BTW: Do you also have a solution for the new link format of this feed that redirects you to the homepage first instead of linking to the article?

Re: Spiegel RSS feed no longer working

Posted: 12 Nov 2013, 23:55
by feader
reibuehl wrote:BTW: Do you also have a solution for the new link format of this feed that redirects you to the homepage first instead of linking to the article?

No. I believe I have seen Spiegel articles referenced by a number only, and I conjecture that in the URL http://www.spiegel.de/#ai=933259&aitype=rss&ref=rss
it is the one after the ai=. You can toy around with

Code: Select all

[
   {
      "URL": "spiegel.de",
      "type": "xpath_regex",
      "xpath": "//item/link",
      "pattern": "[(http://www.spiegel.de)#ai=([0-9]+)&.*]",
      "replacement": "$1?$2?"
   }
]

in ff_FeedCleaner, where you have to figure out what to put in the replacement part.

IMO Spiegel content is not worth the hassle, so don't expect me to do any more in this matter. FWIW, the original guid fixer should work with versions ≥ dded7ae.

Re: Spiegel RSS feed no longer working

Posted: 13 Nov 2013, 00:25
by niehztog
I experimented a bit with Yahoo Pipes, and this is my result:
http://pipes.yahoo.com/pipes/pipe.run?_ ... render=rss

fixes broken guid and links

Re: Spiegel RSS feed no longer working

Posted: 13 Nov 2013, 01:27
by xaberus
seems to work with:

Code: Select all

[
   {
      "URL": "spiegel.de",
      "type": "xpath_regex",
      "xpath": "//item/link",
      "pattern": "[(http://www.spiegel.de)#ai=([0-9]+)&.*]",
      "replacement": "$1/artikel/a-$2.html"
   }
]


feader wrote:IMO Spiegel content is not worth the hassle.

what alternatives do you suggest :-)