Productrise crawler user agent whitelisting and technical details

This page explains how Productrise accesses your website (for feed audits, supplemental feeds, and feed creation) and how to whitelist our crawler if your hosting or firewall blocks automated traffic.

What Productrise crawls and why

Feature	What we do
Feed audits	We request your product page URLs to check structured data (JSON-LD), prices, titles, H1/title tags, images, and to supply content for AI recommendations.
Supplemental feed generation	We request product page URLs to extract content for AI-generated titles/descriptions and to detect additional images.
Create Feed Wizard	We request your site (sitemaps, robots.txt, product URLs) to discover and scrape product pages when building a new feed.

We only send GET requests. We do not run JavaScript or use a headless browser; we only read the raw HTML your server returns.

User-Agent

All requests from Productrise use this User-Agent:

Productrise-bot/1.0

You can allow or block our crawler by this string (e.g. in your WAF, firewall, or bot management tool). We use this same User-Agent for audits, supplemental feeds, and feed creation.

Outbound IP address

All requests to your site come from the following IP address:

174.138.90.10

Whitelisting by IP address is the most reliable method to ensure Productrise can access your site. While you can also whitelist by User-Agent (Productrise-bot/1.0), IP-based whitelisting provides more precise control.

Rate and behavior

• Concurrency: Up to 3 concurrent requests to the same site.
• Caching: We cache each URL's response for 15 minutes so we don't re-request the same page repeatedly in a short time.
• Failures: If we see many consecutive failures (e.g. 403, 503, connection errors) for your domain, we may abort the entire process to avoid overloading your server and wasting resources. The glaciers are melting fast enough already—we don't want our feed audits to be responsible for the complete and impending environmental collapse.

We do not run JavaScript; we only parse the HTML we receive.

How to whitelist Productrise

By IP address (recommended)

Whitelist the following IP address in your firewall or WAF:

174.138.90.10

By User-Agent

Allow requests where the User-Agent header is exactly:

Productrise-bot/1.0

Example (WAF / firewall)

• Allow: source IP = 174.138.90.10
• Or: allow User-Agent = Productrise-bot/1.0

Troubleshooting

Audits or supplemental feed runs fail / time out

• Your firewall or WAF may be blocking our requests. Whitelist IP address 174.138.90.10 and/or User-Agent Productrise-bot/1.0.
• In your logs, look for 403, 503, or connection errors from IP 174.138.90.10.
• If you use a bot-management or anti-scraping service, add an allow rule for IP 174.138.90.10 or User-Agent Productrise-bot/1.0.

Create Feed Wizard can't discover or scrape products

Same as above: we use the same User-Agent (Productrise-bot/1.0) and IP address (174.138.90.10). Whitelist them for your domain.

You've whitelisted us but requests are still blocked

• Confirm the IP address 174.138.90.10 is allowed in your firewall or WAF rules.
• Confirm the exact User-Agent in your logs is Productrise-bot/1.0 (no extra spaces or typo).
• Contact support with your domain and, if possible, a sample blocked request (e.g. timestamp, URL, source IP, response code) so we can help verify.

Summary

Item	Value
User-Agent	Productrise-bot/1.0
IP address	174.138.90.10
Method	GET only, raw HTML (no JavaScript)
Rate	Up to 3 concurrent requests; 15-minute cache per URL
Whitelist	Allow IP 174.138.90.10 and/or User-Agent Productrise-bot/1.0