Skip to main content

Failing to Find Google Maps Scraper (that does everything)

I've built a directory listing website and I'm using WP All Import plugin to pull in data from a spreadsheet (which consists of scraped business info from their Google Maps / GBP listings).

Being that it's a directory website, I'd like the listing info to have essentially what's on the average Google Business Profile (GBP):

  • Business Name, Address and Phone Number
  • Hours
  • Website URL
  • Social Media profiles
  • Business Description (that plain text bio on GBP listings)
  • Logo
  • Gallery / Images
  • Business Attributes
  • FAQs

I've spent 10 hours straight, yesterday, trying out various tools, web apps, desktop apps, chrome extensions, pouring through YouTube vidz - keep getting stuck.

Chrome extensions are slick but they only pull in the very basics NAP type data.

1) Outscraper - it seems hit or miss. For the last test run, it exported data for a certain category + city (ie. plumbers Boston) into a spreadsheet that had a business description for ONE of the businesses. It was the correct description taken from their GBP listing but why only 1 business? I double checked the other businesses in the list, they all have descriptions on their GBP but black cells in the sheet under Description.

Outscraper just said that they can't get that data unless I manually do searches in their app via Place ID 1 business at a time. If there are 500 businesses, that would take me literally 40+ hours to do 1 by 1. Also, they don't pull in the images from the GBP listing into that spreadsheet or FAQs.

2) Octoparse - I paid for their Standard subscription and it still takes quite a while to scrape even a dozen business listings. I tell it to limit the scrape to 10 pages but 1000+ listings later, it's still going.

On their sales page, they say they extract business descriptions, social profiles, price range, images, logo etc but... my spreadsheets consisted of none of that.

3) Apify - This was the first I tried and can't remember the issues here. Google Maps Scraper said it would find FAQs, images and everything else but I know it was the worst of the 3 main apps in my experience so far. I think this also didn't work out because of the formatting of the spreadsheet when trying to import it through WP All Import. For example, WP All Import wants you to drag one field that contains all the business attributes (ie. transgender friendly, wheelchair accessible parking lot, etc) into their one spot for it in the plugin. But, the export of Apify contains many individual columns in the spreadsheet, such as:

additionalInfo/Accessibility/0/Wheelchair accessible entrance

Any suggestions? I don't mind paying for a scraper that can do this but after yesterday's marathon, I'd like to test it out for free first.

submitted by /u/LostLoveTraveler
[link] [comments]

from Search Engine Optimization: The Latest SEO News https://ift.tt/VS1sDRO
Labels:

Comments

Post a Comment

Popular posts from this blog

Local seo vs. natiowide seo?

I've done SEO for local businesses but I recently got my first client that sells an item nation wide. ​ Any suggestions for doing nationwide SEO? ​ I am used to making geopages for local towns. I was going to do the same with some input from the client about what cities or towns he would like to show up in? submitted by /u/Letmeinterviewyou [link] [comments] from Search Engine Optimization: The Latest SEO News http://bit.ly/2JHy0k0
Post a Comment
Read more

Clients site has a weird issue with 302 redirects that I haven't seen before.

Site is in Drupal, hosted on Amazon CDN & Cloudflare. So here's a quick breakdown: The site itself works normally. It's a bit dated, but you can click on links and navigate around as you'd expect. Seeing no obvious issues, I run a Screaming Frog crawl to begin my audit. Only 5 pages were picked up by the crawl which was super weird, since all internal links are regular html and there shouldn't be any issues. So I go through the site and manually collect a bunch of URLs, which I submit to SF again as a list. Every single link bar the 5 originally crawled return a 302, with the 'redirect' pointing back to the home page. Except as I said, those pages don't browser redirect. Browser side, they work fine. I guess they redirect the crawl bot though, since the rest of the site is functionally invisible. Other tools I've looked at say that the pages return simultaneous 302 and 200s, which doesn't make too much sense. These 302s are also old enough ...
Post a Comment
Read more