Craigslist Feeds no longer updating

If you run tt-rss on an officially unsupported platform (shared hosting, Windows, etc.) post here
mxb187
Bear Rating Trainee
Bear Rating Trainee
Posts: 3
Joined: 23 May 2015, 02:46

Craigslist Feeds no longer updating

Postby mxb187 » 18 Nov 2015, 18:31

I have been running ttrss on a shared hosting account (hostgator) for about 7 months. Im a web developer and use ttrss to pull feeds from across craigslist nationally for specific keywords. This makes my life EASY when finding new web dev work. About 2 days ago it stopped working. I now get a 403 error on all 400+ feeds. I used searchtempest to pull all the feeds.

Here is what I have tried so far:

1. Remove all feeds and input all new feeds using searchtempest to create the opml. (Almost immediately they all showed 403 error)
2. Check feeds directly in my browser to make sure they are still formatted properly. (They are)
ex: https://denver.craigslist.org/search/gg ... =WordPress
3. Clear cache and cookies (CCleaner)
4. Use different IP
5. Try connecting from a different location (Went to starbucks)
6. Build a vps on Digital Ocean and installed ttrss on my droplet there. (I get the same issues as on shared hosting)
7. Remove all feeds and manually enter 1 feed. I entered the example above, it worked for about 15 minutes and then stopped, any others i try to enter manually after that, i get a popup box that says: "Couldn't download the specified URL: HTTP Code: 403"

I have no ideas left at this point and would really appreciate any help or input.

Thanks!

User avatar
fox
^ me reading your posts ^
Posts: 6318
Joined: 27 Aug 2005, 22:53
Location: Saint-Petersburg, Russia
Contact:

Re: Craigslist Feeds no longer updating

Postby fox » 18 Nov 2015, 18:47

why are you asking here about some site blocking your access to their feeds

i mean why not ask them instead

you do know what http error 403 means, right?

mxb187
Bear Rating Trainee
Bear Rating Trainee
Posts: 3
Joined: 23 May 2015, 02:46

Re: Craigslist Feeds no longer updating

Postby mxb187 » 18 Nov 2015, 18:54

Yeah... Im a web developer. Fully aware what it means. Access Denied/Forbidden. If you don't actually have a solution, move along. I didnt come here to have you pump up your ego. I came here for help.

A lot of people on this forum also use ttrss combined with craigslist to do the same thing im doing. So I imagine im not the first person on here to run into this issue.

Thanks for responding, but if you dont have anything useful, what are you trying to accomplish?

User avatar
fox
^ me reading your posts ^
Posts: 6318
Joined: 27 Aug 2005, 22:53
Location: Saint-Petersburg, Russia
Contact:

Re: Craigslist Feeds no longer updating

Postby fox » 18 Nov 2015, 19:38

i kinda understand why craigslist doesn't want to serve you their feeds, i've only read two posts of yours and i already have a pretty similar feeling

i'm gonna give you a 4 week probation to figure out if weakly sassing admins giving you valuable advice is a particularly good idea

JustAMacUser
Bear Rating Overlord
Bear Rating Overlord
Posts: 373
Joined: 20 Aug 2013, 23:13

Re: Craigslist Feeds no longer updating

Postby JustAMacUser » 18 Nov 2015, 19:42

The problem is that you're posting on the TT-RSS forum an issue that is not related to TT-RSS. The program is working.

The issue is that site(s) you're pulling from are rejecting your requests. You should talk to the sysadmins at Craigslist. If I had to guess they're rate-limiting you (even though they're not returning the best status code). You could try fetching less frequently and maybe rotate between 2-3 different IPS.

e: Oops... Looks like I was too late. I was even going to suggest that being snippy with the forum admin is not the best move. ¯\_(ツ)_/¯

User avatar
sleeper_service
Bear Rating Overlord
Bear Rating Overlord
Posts: 884
Joined: 30 Mar 2013, 23:50
Location: Dallas, Texas

Re: Craigslist Feeds no longer updating

Postby sleeper_service » 19 Nov 2015, 01:39


ziffusion
Bear Rating Trainee
Bear Rating Trainee
Posts: 13
Joined: 21 Mar 2013, 03:05

Re: Craigslist Feeds no longer updating

Postby ziffusion » 10 Jul 2016, 02:25


JustAMacUser
Bear Rating Overlord
Bear Rating Overlord
Posts: 373
Joined: 20 Aug 2013, 23:13

Re: Craigslist Feeds no longer updating

Postby JustAMacUser » 10 Jul 2016, 04:45

If a web site is returning 403 that's not the client's fault it's the server's. Talk to the site's admin(s).

If you're feeling particularly motivated, you can try a different user agent or fetch the content from another IP address. Usually sites block because of a rate limiting restriction or if the IP address is part of a subnet that's attacking their systems.


Return to “Unsupported platforms”

Who is online

Users browsing this forum: No registered users and 4 guests