Blogs >> Technology >>
Free Google and Yahoo! Sitemap Generator for Windows
Google Sitemaps allows the webmaster to help Google index their pages optimally. The GSiteCrawler will help you generate the best Google Sitemap file for your website.
The GSiteCrawler uses different ways to find all the pages in your
website and can generate all sorts of files, statistics and more. The
sitemaps file format has lately been also adapted by Yahoo! - even
MSN/Live.com is pledging it's support.
Making sitemap files has never been so easy!
The GSiteCrawler is available for free and runs under Windows - all you need is an internet connection and the desire to make the most out of your website!
Do you only need a quick sitemap file? Just follow the steps in the integrated wizard and you'll have the sitemap file on your server in no time!
GSiteCrawler Features
In general, the GSiteCrawler will take a listing of your websites URLs, let you edit the settings and generate Google Sitemap files. However, the GSiteCrawler is very flexible and allows you to do a whole lot more than "just" that!
Capture URLs for your site using
With each page, it
Once the pages are in the database, you can...Read More
Making sitemap files has never been so easy!
The GSiteCrawler is available for free and runs under Windows - all you need is an internet connection and the desire to make the most out of your website!
Do you only need a quick sitemap file? Just follow the steps in the integrated wizard and you'll have the sitemap file on your server in no time!
Are you looking for more than just a sitemap?
The program also offers tons of options, settings, tweaks, and more - if you want to do more than generate just a simple sitemap file. How about a urllist-file for Yahoo? an RSS feed? a ROR file? a HTML sitemap page? It's all possible with the GSiteCrawler! GSiteCrawler Features
In general, the GSiteCrawler will take a listing of your websites URLs, let you edit the settings and generate Google Sitemap files. However, the GSiteCrawler is very flexible and allows you to do a whole lot more than "just" that!
Capture URLs for your site using
- a normal website crawl - emulating a Googlebot, looking for all links and pages within your website
- an import of an existing Google Sitemap file
- an import of a server log file
- an import of any text file with URLs in it
- does a text-based crawl of each page, even finding URLs in javascript
- respects your robots.txt file
- respects robots meta tags for index / follow
- can run up to 15 times in parallel
- can be throttled with a user defined wait-time between URLs
- can be controlled with filters, bans, automatic URL modifications
With each page, it
- checks date (from the server of using a date meta-tag) and size of the page
- checks title, description and keyword tags
- keeps track of the time required to download and crawl the page
Once the pages are in the database, you can...Read More
|
|
