Spiegel RSS feed no longer working

[bratscher]

Hi all,

I'm interested if someone else experienced this problem. Since several days the RSS feed by Spiegel online no longer works with ttrss:

http://www.spiegel.de/schlagzeilen/index.rss

I'm running ttrss 1.10 on a self hosted machine running Ubuntu 12.04 LTS, 64-bit with apache 2.2.22. PHP is version 5.3.10.
Postgres in 9.1.10. No ttrss plugins are enabled.

The interesting thing is that I haven't performed any updates inbetween.

The android clients shows the same behaviour.

Is there more I can do to pinpoint that problem?

Regards,

bratscher

[saedelaere]

Hi,


I have installed Tiny Tiny RSS on my Debain Wheezy and I am very happy with it. So far mostly everything works perfect. I am using the update daemon (update_daemon2.php) to get the latest feeds.
I have problems with one german news portal www.spiegel.de

It offers different RSS feeds
http://www.spiegel.de/schlagzeilen/tops/index.rss
http://www.spiegel.de/schlagzeilen/index.rss

But none of them work. I don't get any updates. I can see one or two articles sometimes but thats it.
Funnily I found out they also provide an RSS Feed via their mobile website and this one is working:

http://ml.spiegel.de/rss.do

Anyone an idea what the problem could be?

Thanks for this great application!

[Latimer]

Feed validator results: This feed does not validate

[saedelaere]

Just found something on twitter
https://twitter.com/search?q=SPIEGEL%20ONLINE%20RSS&src=typd

So they say that they have changed their RSS feeds and know about the problem. Unfortunately I started using Tiny Tiny RSS on the same day and thought something would be wrong with my settings

[Latimer]

There was a plugin that was fixing broken ids in one of the xkcd feeds. You can try to repurpose it for Spiegel's feeds if nothing else helps.

e: af_whatif

[Marty]

On Twitter people are reporting that SPIEGEL ONLINE works again in Feedly. But still no updates in tt-rss!
SPON doesn't seem to have changed their feeds - all the articles have still the same <guid>!
After reading their response to my mail, I'm not sure if SPON is really working on the problem...

Does anyone know how to make the feeds work again - maybe using the ff_FeedCleaner or the af_whatif plugin?

[feader]

Does anyone know how to make the feeds work again - maybe using the ff_FeedCleaner or the af_whatif plugin?

I think a similar case was discussed on the forum some time ago. You can try to use ff_FeedCleaner with

Code: Select all

[
   {
      "URL": "spiegel.de",
      "type": "xpath_regex",
      "xpath": "//item/guid",
      "pattern": "/.+/",
      "replacement": ""
   }
]


in its config. ttRSS should then use the <link> tag to create the (internal) article guids.

e: Old config didn't work.
e2: Should work with versions ≥ dded7ae.

[sesom]

... maybe using the ff_FeedCleaner or the af_whatif plugin?

Neither one fixes that problem for me.

[Latimer]

Another thing to consider would be to roll your own feed with yahoo pipes.

[fox]

One could also consider choosing one of the news outlets that don't actively shit on their userbase.

[feader]

... maybe using the https://github.com/wltb/ff_feedcleaner or the af_whatif plugin?

Neither one fixes that problem for me.

The config for ff_FeedCleaner I posted yesterday did indeed fail to remove the guids, I edited the post. This one should work.

[reibuehl]

The config for ff_FeedCleaner I posted yesterday did indeed fail to remove the guids, I edited the post. This one should work.

Yes, the new code works. Thanks very much for sharing it!

BTW: Do you also have a solution for the new link format of this feed that redirects you to the homepage first instead of linking to the article?

[feader]

BTW: Do you also have a solution for the new link format of this feed that redirects you to the homepage first instead of linking to the article?

No. I believe I have seen Spiegel articles referenced by a number only, and I conjecture that in the URL http://www.spiegel.de/#ai=933259&aitype=rss&ref=rss
it is the one after the ai=. You can toy around with

Code: Select all

[
   {
      "URL": "spiegel.de",
      "type": "xpath_regex",
      "xpath": "//item/link",
      "pattern": "[(http://www.spiegel.de)#ai=([0-9]+)&.*]",
      "replacement": "$1?$2?"
   }
]

in ff_FeedCleaner, where you have to figure out what to put in the replacement part.

IMO Spiegel content is not worth the hassle, so don't expect me to do any more in this matter. FWIW, the original guid fixer should work with versions ≥ dded7ae.

[niehztog]

I experimented a bit with Yahoo Pipes, and this is my result:
http://pipes.yahoo.com/pipes/pipe.run?_ ... render=rss

fixes broken guid and links

[xaberus]

seems to work with:

Code: Select all

[
   {
      "URL": "spiegel.de",
      "type": "xpath_regex",
      "xpath": "//item/link",
      "pattern": "[(http://www.spiegel.de)#ai=([0-9]+)&.*]",
      "replacement": "$1/artikel/a-$2.html"
   }
]

IMO Spiegel content is not worth the hassle.

what alternatives do you suggest