View Full Version : Why Craigslist Search Is Gonna Stay

08-31-2009, 09:10 AM
The way it is. I've received lots of input that I should put adwords in there or other possibilities for exploring revenue streams. One of my better friends who happens to roll in obscenely rich circles ran into a leader from Craigslist and he told him that they will not tolerate those who try to use their site in ways they don't approve. Very utopian mantra from these cats.

But here is a snippet about how Craigslist dealt with some people who were scraping their site in the past from this weeks Wired Magazine:

Buckmaster's dispassionate protest reflects his cast of mind. Emotional appeals are more likely to provoke his skepticism than his sympathy, and when the complaints come from aspiring Internet entrepreneurs he is especially prone to sarcasm. He hears many such complaints, because one of the most curious things about craigslist is that a company designed and run entirely by programmers is so hostile to outsiders who want to pull neat technical tricks to improve the site. A few years ago, independent programmer Jeff Atwood created a service that would allow people to search multiple cities at once or even search craigslist globally. Buckmaster arranged some technical interference to kill it off. Another programmer named Ryan Sit created a service called Listpic, which scraped images from craigslist and dumped them into an interface for browsing: You could scan through all the photos from the apartment listings or see pictures of all the dogs up for adoption. Buckmaster banished Listpic, too.

He had specific objections to both. Listpic ran ads, it put a high burden on craigslist servers, and when he looked at traffic records he noticed that Listpic was being used mainly to enhance enjoyment of the sexy images people posted in their erotic-services ads. Universal search subverts craigslist's mission to enable local, face-to-face transactions; it increases the risk of scams and can be exploited to snatch up bargains, giving technically sophisticated users an advantage over casual browsers. But the very surfeit of these practical objections—many of which probably have technical solutions—hints that the real explanation lies elsewhere, and with a minimum of pressure Buckmaster will state it plainly. It is the same reason that craigslist has never done any of the things that would win approval among Web entrepreneurs, the same reason he has never updated its 1999-era Web design. The reason is that craigslist's users are not asking for such changes.


08-31-2009, 09:14 AM
I use your search app all the time! great upgrade. :thumb:

08-31-2009, 09:18 AM
Thanks. Although I've always had the fear that some day somebody is gonna crack down on my IP. This article only confirms that.

08-31-2009, 11:58 AM
Very utopian mantra from these cats.

For good reason, if you were Craig you'd want to protect it too. ;)

08-31-2009, 01:33 PM
I use your search app all the time! great upgrade. :thumb:


Thanks. Although I've always had the fear that some day somebody is gonna crack down on my IP. This article only confirms that.

Let's hope not :( - I like to be able to search all of Colorado for instance...That isn't discouraging face-to-face interaction IMO, just opening up more opportunity to both buyers, and sellers.

08-31-2009, 01:41 PM
It sounds like to me that as long as your app stays small in use and doesn't include ads, you'll probably be OK. It's a great tool.

09-03-2009, 05:16 PM
I use your app all the time also its how I found my Harley for so cheap Awesome keepit going.Is there any way you can make the program able to search the whole country also So you dont have to search state by state?

09-04-2009, 02:11 PM
Actually, that is part of what this post is about. I think Craig is barely putting up with me. I would be extremely easy actually. Seriously, I bet it would be 5 minutes of programming. But the day I expose that, my IP is sourcing 100x more hits on their server and I'm blocked. I'm already serving 3,000+ unique users a day. So I'm gonna chill where it is.

09-04-2009, 04:39 PM
I hope that your utility sticks around.... its the best around... I use it every day.

09-04-2009, 05:21 PM
I use your app all the time also its how I found my Harley for so cheap Awesome keep it going.Is there any way you can make the program able to search the whole country also So you don't have to search state by state?If you want to cast a larger net, use Google and format your search like this: "search-terms site:craigslist.org". It would suck if Paul's traffic went up on the CL servers and his IP got blocked. I have enjoyed making use of the tool. Thanks Paul!

01-19-2012, 09:47 PM
Hey Paul, is this thing still working? I was using it as recently as last weekend, but tonight it's not finding anything. :confused:

01-19-2012, 10:15 PM
I'll go look . . .

01-19-2012, 10:25 PM
Well, so much for that. Craigslist has blocked my IP:

This IP has been automatically blocked.
Questions: blocks-b13269356972069@craigslist.org.

01-19-2012, 10:26 PM
Aw, crap. Sorry man! Hope I didn't break it looking for dirt bikes.. :o

01-19-2012, 10:34 PM
See that email address? I wrote them a note. Maybe if others did we could get it back up.

But if not, I'm spinning Ubuntu desktop on it for the kids.

01-20-2012, 05:06 PM
f'n A they unblocked you? sweeet?

I use this at least once a day.

02-13-2012, 03:57 PM
If the regional division lines in the U.S. were up to Craigslist, here's what the map would look like. :)

Source: http://uxblog.idvsolutions.com/2011/07/chalkboard-maps-united-states-of.html

02-13-2012, 04:03 PM
That is pretty :cool:

Caribou Sandstorm
02-14-2012, 11:11 PM
What chaps my hide are the ass hats that re-post the same car every day.

02-17-2012, 02:24 PM
Is the CL search down? Can't seem to get it to load right now. :confused:

02-17-2012, 02:38 PM
seems to be workin alright for me.


07-17-2012, 09:18 PM
Is this dead from the new CL rules? I loved this search tool.:(

07-18-2012, 10:30 AM
They blocked my IP. I've emailed and called and left messages. No feedback. Ridiculous. Their interfaces sucks ass.

07-18-2012, 11:04 AM
Shoot, sorry Paul. Hey can we host it here? what's the downside of them blocking your IP, other than them blocking your IP?

07-20-2012, 11:46 PM
the surprising thing is the craigslist app for ipad will search multiple cities. I actually really really like it as it displays a pic on the side as well so you see if it's even worth a look.

I still don't understand why their site isn't even marginally better for searches and results. It's not that hard.

09-30-2012, 02:56 PM
It's alive again. We'll see for how long. I had to edit quite a bit as CL changed their output formats significantly.

Jenny Cruiser
09-30-2012, 06:12 PM

Shark Bait
05-01-2013, 11:45 AM
Hey Paul, I think it needs a tweak, or something:

Results For: denver Instances of fj40
May 1 $11500 by owner
Apr 30 $5000 by owner
Apr 29 $13000 by owner
Apr 29 $4000 by owner
Apr 28 $2500 by owner