RE: How would you go about indexing an entire website?

[Replies] [Reply] [View by Thread] [Help]
[Back To CyberArmy Help & Support]

Gamma Lt Myers

Found a program a bit similar to what you were talking about: http://www.ixacta.com/products/ixsite/images/samples/ though it may not be close.

Site maps are used to generate all pages in the website from the server it's running on. It can grab pages that you're blocking certain engines from mapping. Have a look here: http://www.xtreeme.com/sitexpert/ - gives detailed information from their experts and also do a search for Free Site Map.

Hope this helps!

Gamma Lt. Myers
CyberArmy Services & Projects
Wiki / FAQ Maintenance & Development

Replies:

How would you go about indexing an entire website? - Rec Johneh 2008-09-08 20:00:03
- httrack and google (link:domain.com) /nt - Alpha LtKer Venom 2008-09-11 20:53:39
  - unless you mean old pages, then archive.org /nt - Alpha LtKer Venom 2008-09-11 20:58:17
- >RE: How would you go about indexing an entire website? - Gamma Lt Myers 2008-09-11 16:40:31 <
- the only real way is to crawl it... - Beta Ker knoledgesponge 2008-09-09 06:01:05

CyberArmy::Forum v0.6
Generated In 0.00539 seconds