About our scraper

Gouna Realty aggregates publicly available El Gouna property listings to give buyers and renters a single, current overview of the market. We operate a friendly, transparent crawler and respect the standards set by site owners.

Our crawler identity

We identify ourselves on every request with this User-Agent string:

Gouna-Realty-Scraper/1.0 (+https://gouna-realty.vercel.app/about-scraper; contact: scraper@gouna-realty.com)

If you see this UA hitting your site, it is us. Reach out at the contact address above if you have any question or concern.

Sources we read

bayut.eg (El Gouna properties section)
propertyfinder.eg (El Gouna / Hurghada section)
nawy.com (El Gouna search results)
gouna360.com (El Gouna properties)
liaisonproperty.com (El Gouna listings)
roi-realestate.com (El Gouna inventory)

We add new sources only when they publish real El Gouna inventory and allow our crawler in their robots.txt.

robots.txt and rate-limit policy

robots.txt enforcedAt runtime per RFC 9309. Disallowed paths are skipped.
Crawl-delay honoredThe larger of your delay, our 2-second floor, or our minimum.
No bot-wall bypassWe stop at any CAPTCHA, paywall, or Cloudflare challenge.
Hotlink firstWe link to your originals to keep traffic on your CDN.

robots.txt is enforced at runtime, per RFC 9309. If a path is disallowed for our User-Agent we skip it.
Crawl-delay is honored per source. We take the larger of (a) your declared Crawl-delay, (b) our internal floor of 2 seconds, and (c) any source-specific minimum we set in code.
No CAPTCHA or paywall bypass. If we hit a bot wall, CAPTCHA, or Cloudflare challenge we stop and move on. We do not retry with a different User-Agent.
/llms.txt is checked on sources that publish one, and we respect opt-out signals there as well.
Hotlink first, self-host only on block. We link to your originals where possible to keep traffic flowing to your CDN.

Opt-out

The cleanest way to opt out is to add this to your robots.txt:

User-agent: Gouna-Realty-Scraper
Disallow: /

Or email scraper@gouna-realty.com with your domain and we will remove it from our source list within one business day. We keep a static opt-out list independent of robots.txt for cases where you want a stronger guarantee.

Truth and attribution

Every listing on this site carries a source link back to the original. We do not invent amenities, prices, or photos. If you spot a claim on our site that does not match your source listing, please email the contact address so we can correct it.

Common questions

Which crawler is reading my site?

We identify ourselves on every request as Gouna-Realty-Scraper/1.0, with a link back to this page and the contact address scraper@gouna-realty.com. If you see that User-Agent, it is us.

Do you respect robots.txt?

Yes. robots.txt is enforced at runtime per RFC 9309. If a path is disallowed for our User-Agent, we skip it, and we check /llms.txt for opt-out signals on sources that publish one.

How often do you request pages?

We honor your declared Crawl-delay and take the larger of that, our own floor of 2 seconds, and any source-specific minimum we set in code. We never bypass a CAPTCHA, paywall, or Cloudflare challenge.

How do I opt out?

Add Disallow: / for User-agent: Gouna-Realty-Scraper to your robots.txt, or email scraper@gouna-realty.com with your domain. We remove it within one business day and keep a static opt-out list independent of robots.txt.

Do you copy my photos and listing details?

We hotlink to your originals where possible to keep traffic on your CDN. Every listing carries a source link back to you, and we never invent amenities, prices, or photos.

Keep reading

Last updated 2026-05-17 · Back to home