| Use Standard Search | Advanced Search | Browse Software by Category | View Popular Search Terms |
| Field | Value |
|---|---|
| Page # | 1 |
| Items per page: | 50 |
| Sort Column: | Release Date |
| Program Type: | Freeware |
| Search: | Keywords |
| String: | crawler |
| Match: | Exact |
Show Options
| Matches: 6 · 1 page Page 1 |
| Title [ and relevant links ] |
Company | Description [ no highlighting ] |
Operating System | Program Type | Cost | File Size | Release Date | Category | ||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| #1 Auto Web Browser |
Sekhol Technologies | Auto Web Browser saves a lot of time when you are looking for something on the Internet. No need for numerous clicking, waiting for pages download and closing annoying pop-ups. Just enter the words describing what you want to find. The Auto Web Browser will consult the search engines from a user defined list, download the pages to your computer, filter and analyze them and then it will automatically surf further, downloading other potentially interesting pages using the links from the meaningful part of the relevant documents. Web crawling reveals many interesting pages, that cannot be found easily if you use search engines only. With good Internet connection hundreds of documents could be processed in minutes. If you have slow Internet, just take a break and wait for a while. After most of the routine job is done by the application, the found pages and an annotated report are available for an instant offline preview. The application contains Download and Exclude lists of URLs, that can be saved to and loaded from a file and filled by URLs from any file or clipboard. The search engines used by the application are fully customisable and a user can add the specific engines most suitable for the particular search task. The tool can also be used in a simple mode just retrieving and filtering results from search engines. The links to found documents with summaries and thumbnail images of the pages can be placed into a structured report and saved to html file. |
|
Freeware | $0.00 | 1300 kb | 2004-10-28 | Network and Internet Other | ||||||||||||||||
| #2 Web Bot Programming Library |
Chilkat Software, Inc. | Crawl the web with this free ActiveX web bot component. Advanced features include caching, "avoid" patterns, and robots.txt compliance. |
|
Freeware | $0.00 | 549 kb | 2005-08-22 | unclassified | ||||||||||||||||
| #3 Zoom Search Engine Free Edition |
Wrensoft | The Zoom Search Engine is a free package that allows web developers to add an industrial-strength custom search to their website in a matter of minutes. It is an extremely easy-to-use application that requires no complicated server-side set-up procedures. It can also be used to create search engines for intranets, CDs and DVDs as well. Zoom is capable of serving up to 300 queries a minute and it can index and search 1000?s of web site domains in a single index. Developers who choose to upgrade to the Enterprise Edition will be able to index up to 1 million pages. Features include: wildcard and exact phrase searching; ?Google-like? context search results; Highlighted found words; spelling & synonym suggestions; exclusion/negative searches; display images/thumbnails in search results; prioritize recommended links for keywords/phrases; A9 and OpenSearch compatible XML/RSS output (CGI only); Sitemap generation (Yahoo and Google compatible); international language support; statistical graphs & reports. Zoom allows searches into DOC, PDF, PPT, XLS, RTF and WPD files and is capable of indexing SWF and FlashPaper files. In addition, Zoom now supports indexing/searching of the meta-data in MP3 and various image file formats. See the Zoom website for a complete list of supported file formats. The Zoom Search Engine will index files in either spider or offline mode. Indexing options include incremental index, simultaneous broken link detection, content filtering, flexible scanning and skipping options. Zoom is available in Free (max. 50 pages), Standard $US49 (max. 100 pages), Professional $US99 (max. 200,000 pages) and Enterprise $US299 (max. 1 million pages) Editions. It supports PHP, ASP, Javascript and CGI platforms and can also create .NET search pages. |
|
Freeware | $0.00 | 3124 kb | 2007-01-04 | Network and Internet Search and Lookup Tools | ||||||||||||||||
| #4 TextCrawler |
DigitalVolcano | A tool for find and replace across across multiple text files. Supports regular expressions and provides an expression tester, library and batch processing facility. It also features an interactive file list and highlighted search results. Freeware. Features: * Find and Replace * Fast searching, even on large files. * Easy to use interface * Varied search parameters * Find and replace using Regular Expressions. Create sophisticated searches. * A Regular Expression test facility * Regular Expression library - Save your search and replace scripts. * Highlighted search results * Intellegent context menu * Export results * Rip text from files * Batch process - multiple operations on each file. |
|
Freeware | $0.00 | 1682 kb | 2007-07-01 | System Utilities Text and Document Editors | ||||||||||||||||
| #5 LicenseCrawler |
Martin Klinzmann | If you want to setup your computer system again you need to have the licenses and serial numbers at hand for all the software programs that you have purchased and registered. Instead of searching for the keys in your emails, manuals and recipes you could use another approach. License Crawler is a sweet little application that scans the Windows Registry for Windows product keys and other serial numbers and licenses. The License Crawler can discover application product keys and other serial numbers or licenses very quickly and supports all versions of Windows operating system from Windows 95 to Windows Vista. It is a portable application that can be run from any location and would be a perfect fit for an USB stick. Asking clients to find serial and license keys is often very frustrating. Instead, tech support can simply run License Crawler without having to interact with the client at all. |
|
Freeware | $0.00 | 74 kb | 2008-09-09 | System Utilities Other | ||||||||||||||||
| #6 DRKSpider |
DRK Open Source Software | DRKSpider will navigate a web site from a given URL, checking internal (and external) links, style sheets, images and other files. Broken links will be reported and the site map displayed in a tree control. * Navigation tree matches site's navigation. * Detailed information about each link found. * Detailed scan limit options. * Site scan results window. * Web lookup for any tree item. * Sitemap export tool for search engine optimization. * Export command in the File menu allows you to export scan summary to a text file. * Preferences command in the File menu for saving DRKSpider settings. * Exclude word list for URL excluding. * Number of hits while scanning. * Proxy server support. * Internet system cache control. * Referrer information field control. * Binary install distribution (NSIS Setup) * HTML Validator by World Wide Web Consortium added in the link properties dialog. * SWFRIP add-in for parsing SWF files (SWFRIP source code). |
|
Freeware | $0.00 | 1157 kb | 2008-11-17 | Web Development Other |
| Matches: 6 · 1 page Page 1 |