How to Research Competitors Anonymously

Researching a competitor from your corporate network has two costs. It tells them you are looking — your IP and its reverse DNS sit in their analytics — and it corrupts what you see, because repeat visits from one address trigger personalisation, retargeting and sometimes deliberately different treatment. A neutral residential exit removes both problems.

What your office IP reveals

Corporate IP ranges frequently resolve to a company name, and IP-to-company enrichment is a standard feature of B2B analytics products. Repeated visits from one such range are visible, attributable and, in a competitive market, informative. Beyond attribution, repeated visits build a profile: pricing pages you revisit, funnels you enter, and ads that subsequently follow your staff around.

What to collect

Public pricing and packaging. Watch for changes over time rather than taking one snapshot.
Positioning and messaging. Landing pages, especially variants served to different markets.
Search visibility. Which queries they appear for, from a neutral IP so results are not personalised by your own history.
Ad creative. What they run in each market, which requires an exit in that market.

Setting it up

Credentials are built from a separate variable below rather than pasted inline — a literal user:pass@host string in a page body can be rewritten by email-obfuscation filters.

import requests, datetime, hashlib, json

endpoint = "geo.spyderproxy.com:12321"
creds = "USERNAME:PASSWORD"
proxy = f"http://{creds}@{endpoint}"

def snapshot(url):
    r = requests.get(url, proxies={"http": proxy, "https": proxy}, timeout=30)
    return {
        "url": url,
        "fetched": datetime.datetime.utcnow().isoformat(),
        "status": r.status_code,
        "digest": hashlib.sha1(r.content).hexdigest(),
        "html": r.text,
    }

snap = snapshot("https://competitor.example/pricing")
print(snap["status"], snap["digest"])

Storing a content digest alongside each snapshot lets you detect a change without diffing whole pages, which is how you turn occasional curiosity into an actual monitoring job.

Which product

Budget Residential at $1.75/GB is the right default. Volumes are small, so this costs very little. Use Premium Residential when you need to see a specific city's version of a page, and rotating datacenter at $1.00/GB if the target has no meaningful bot protection.

Staying on the right side of it

Collect what is publicly published. Do not create accounts under false pretences, do not attempt to reach anything behind authentication you are not entitled to, and respect the volume you place on someone else's infrastructure — a monitoring job should be indistinguishable from a handful of ordinary visitors. This is not legal advice.

Frequently Asked Questions

Can competitors see that I am researching them?

From your office network, often yes. Corporate IP ranges frequently resolve to a company name and IP-to-company enrichment is standard in B2B analytics.

Which proxy type suits competitor research?

Budget Residential at $1.75/GB. Volumes are small, so the cost is negligible, and a real consumer IP avoids both attribution and personalisation.

How do I track changes over time?

Store a content hash with each snapshot and compare hashes between runs. That detects change cheaply without diffing full pages.

Is competitor research legal?

Collecting publicly published information is generally lawful. Creating accounts under false pretences or accessing material behind authentication you are not entitled to is not. This is not legal advice.