Glassdoor is a website where potential employees find jobs and former employees can review their previous company. These reviews include what their experience was working with that company to help guide upcoming employees on their career choices. Additionally, former employees can also state their salary on their respective position when working at the company.
There’s a lot of valuable information about plenty of companies in Glassdoor that can be used for various purposes. Manually scraping each of those web pages though would take a lot of time and effort. That’s why you need a scraper bot to extract all those review data quickly and efficiently. Most websites have strict restrictions against the use of bots though, so you need to pair your bot with a Glassdoor proxy.
A Glassdoor proxy will handle all of your web requests for you which lets you hide your IP address and any website you visit will only be able to see the IP address of the proxy server. By continuously rotating millions of IPs, your bot would have a different IP address each time it sends a request to the web server.
The best Glassdoor proxies to pair with your scraper bot would be residential proxies as these types of proxies use residential IPs from actual devices. This deceives any website into thinking that your bot’s requests came from multiple, genuine users and not just from a single IP. You can now scrape Glassdoor without the fear of being flagged and banned by the website.
Let’s set up a Glassdoor proxy server.
Note: Make sure that the web browser you’re using for Glassdoor is set to automatically copy your computer’s proxy settings. Google Chrome automatically does this, so it’s recommended to use it.
For Windows:
To set up proxies in Windows, simply search for “Proxy Settings” in your windows search bar and open the search result.
You are then given two options to choose from: Automatic proxy setup or Manual proxy setup. If you want windows to automatically detect your proxy settings, choose the first option. Choose the second option if you want to utilize a specific ip address and port number.
If you chose the first option, then:
- Turn on Automatically detect Settings
- Turn on Use setup script
- Enter the script address
- Click Save
If you chose the second option, then:
- Turn on Use a proxy server
- Input both server address and port number
- If you have any addresses you would like to visit without a proxy, enter them here
- Turn on Don’t use the proxy server for local addresses check box if you want to access a local server without a proxy
- Click Save
For Mac.
To start configuring your proxy settings in MacOS, simply:
Step 1. Click on the Apple Icon.
Step 2. On the drop down menu, click on “System Preferences”.
Step 3. Click on “Network”
Step 4. Click on “Advanced”
Note: Make sure to connect to your wi-fi first.
Step 5. Click on “Proxies”
This should then redirect you to MacOS proxy settings. MacOS is more straightforward compared to windows. You only have one option which is to manually configure your proxy server.
Here are the steps to follow:
- Select which proxy IP protocol you want to configure. This depends on which protocols your proxy service provider offers.
- Turn on Secure Web Proxy
- Input the Proxy Server Address and Port Number
- Click OK to save the configurations
Note: You may be prompted for your Mac user password to save your settings.
Image Alt Text: Configuring MacOS Proxy Settings
For Mobile:
To set up a Glassdoor proxy server for your mobile device, simply change your phone’s proxy settings. The mobile web browser you’re using for Glassdoor will automatically copy your phone’s proxy settings whenever you use it.This is applicable for both Android and IOS.
Here’s a thorough guide for Android and another one for iPhone.
Congratulations! You have now finished configuring your Glassdoor proxy server. Note that the first time you visit it, there will be a pop up asking for your login credentials.
