SEO And Web Design Tips: Build a Web Scraper with Ruby (in less than 30 minutes)

SEO And Website Design Tip: Build a Web Scraper with Ruby (in less than 30 minutes)



In this video, we’ll look at how you can build a simple yet powerful web scraping tool using Ruby, Nokogiri, and HTTParty.

In less than 30 minutes we will build a web scraper that can collect thousands of data points across dozens of web pages – in just a few seconds.

here’s a quick example I did on how you might refactor this code a little:

View the code from this video and more here:

Twitter:
Youtube:
Website:

Get More Information For SEO And Web Design Tips Here: website design edinburgh prices

Author: admin

28 thoughts on “SEO And Web Design Tips: Build a Web Scraper with Ruby (in less than 30 minutes)

  1. How would you go about test driving this? I'm also trying to separate out the functions for readability , but can't seem to get it to work – any pointers would be much appreciated!

  2. instead of splitting the string to get total job number of listings i propose use of regex in case in future they change the string structure i.e. => /[0-9,]+/.match(parsed_page.css('div.job-count').text)[0].gsub(",","")

  3. dude… Thanks a lot, your doing a great job, keep it up!

    1 quick question, how do you actually practice ruby … I know a ton of shit, but boy when I see you just quickly punch out a script its just shows me how much more skills I need to level up.

    Also what would refactor or atleast identify remember the .gsub line and either give back a better refactoring or?? thanks alot.

  4. Hey, love the tutorial I am running into one issue the script is iterating through the pages fine and when I tried the 50 jobs I can accessing them ok but it won't push job to jobs and I'm not even getting the puts below it either, not sure whats wrong. Any advice is appreciated thanks for the great tutorial learned a lot.

Leave a Reply

Your email address will not be published. Required fields are marked *