Craigslist Feeds no longer updating

[mxb187]

I have been running ttrss on a shared hosting account (hostgator) for about 7 months. Im a web developer and use ttrss to pull feeds from across craigslist nationally for specific keywords. This makes my life EASY when finding new web dev work. About 2 days ago it stopped working. I now get a 403 error on all 400+ feeds. I used searchtempest to pull all the feeds.

Here is what I have tried so far:

1. Remove all feeds and input all new feeds using searchtempest to create the opml. (Almost immediately they all showed 403 error)
2. Check feeds directly in my browser to make sure they are still formatted properly. (They are)
ex: https://denver.craigslist.org/search/gg ... =WordPress
3. Clear cache and cookies (CCleaner)
4. Use different IP
5. Try connecting from a different location (Went to starbucks)
6. Build a vps on Digital Ocean and installed ttrss on my droplet there. (I get the same issues as on shared hosting)
7. Remove all feeds and manually enter 1 feed. I entered the example above, it worked for about 15 minutes and then stopped, any others i try to enter manually after that, i get a popup box that says: "Couldn't download the specified URL: HTTP Code: 403"

I have no ideas left at this point and would really appreciate any help or input.

Thanks!

[fox]

why are you asking here about some site blocking your access to their feeds

i mean why not ask them instead

you do know what http error 403 means, right?

[mxb187]

Yeah... Im a web developer. Fully aware what it means. Access Denied/Forbidden. If you don't actually have a solution, move along. I didnt come here to have you pump up your ego. I came here for help.

A lot of people on this forum also use ttrss combined with craigslist to do the same thing im doing. So I imagine im not the first person on here to run into this issue.

Thanks for responding, but if you dont have anything useful, what are you trying to accomplish?

[fox]

i kinda understand why craigslist doesn't want to serve you their feeds, i've only read two posts of yours and i already have a pretty similar feeling

i'm gonna give you a 4 week probation to figure out if weakly sassing admins giving you valuable advice is a particularly good idea

[JustAMacUser]

The problem is that you're posting on the TT-RSS forum an issue that is not related to TT-RSS. The program is working.

The issue is that site(s) you're pulling from are rejecting your requests. You should talk to the sysadmins at Craigslist. If I had to guess they're rate-limiting you (even though they're not returning the best status code). You could try fetching less frequently and maybe rotate between 2-3 different IPS.

e: Oops... Looks like I was too late. I was even going to suggest that being snippy with the forum admin is not the best move. ¯\_(ツ)_/¯

[sleeper_service]

If you don't actually have a solution, move along. I didnt come here to have you pump up your ego. I came here for help.

yes yes, great idea. telling the software developer to move along... piss off the person best able to help, if there were actually some problem in ttrss, not just you pissing off craigslist....

I've seen 'em start blocking access before if you're hammering on 'em more than they like.

[ziffusion]

The problem is that you're posting on the TT-RSS forum an issue that is not related to TT-RSS.

This is not true.

The website is serving the feed fine to the browser. It only returns 403 to TRSS (and only lately). I think people (including me) are just trying to find out if you folks as the core developers might have some idea why this might be happening (user agent setting or whatever), and if you may have any ideas on how to fix this.

Why do you folks behave like children when responding to questions? Is it not possible to be a little more professional? All you do is turn around and insult people.

I suppose I'll be banned for saying this now.

[JustAMacUser]

If a web site is returning 403 that's not the client's fault it's the server's. Talk to the site's admin(s).

If you're feeling particularly motivated, you can try a different user agent or fetch the content from another IP address. Usually sites block because of a rate limiting restriction or if the IP address is part of a subnet that's attacking their systems.