Xenu link sleuth mac os

Xenu link sleuth mac os

Additional features:

• Simple, no-frills user-interface
• Can re-check broken links (useful for temporary network errors)
• Simple report format, can also be e-mailed
• Executable file smaller than 1MB
• Supports SSL websites («https:// «)
• Partial testing of ftp, gopher and mail URLs
• Detects and reports redirected URLs
• Site Map

Download

To have peace of mind, I recommend that you are using an up-to-date anti-virus software on your computer (so do I!).

Ok, I have read all that, I want to download! (current version: 1.3.8 from September 4th, 2010) or try a beta version

Getting started: Unzip it and install it wherever you want. To check a site, click the toolbar icon on the left and enter a WWW address. If the address finishes with a directory name, don’t forget to put a / at the end or you will possibly get the whole parent directory spidered. You can also click the «browse» button to check a local HTML file. If you do not already use IE for browsing and are sitting behind a company firewall, don’t forget to configure your proxy before you start. If you are using a personal firewall (like ZoneAlarm or Outpost) you must enable Microsoft Internet Explorer by starting it, entering a URL and then «allowing» the application (you may also have to enable Xenu — see example for Norton Intenet Security). To find out what the software can do, simply try out the menu choices, the toolbar and the right mouse key. Or read this third-party manual, a bigger third-party manual with many pictures, a third-party report (How I check over 6,000 links every seven to ten days), a blog post by a SEO guy, or deutsche Beschreibung und noch eine, guide en français, nederlandse beschrijving, descripción en español, русское описание, Український опис, Beskrivelse på dansk, opis w języku polskim, opis na Srpsko-Hrvatskom jeziku. Good luck! If you find the software useful, please click here. You can also join the user group by sending an e-mail to xenu-usergroup-subscribe@yahoogroups.com. If you like to use a button for Xenu’s Link Sleuth on your web page, link to this page with these buttons: If you like to use a banner for Xenu’s Link Sleuth on your web page, link to this page with this banner: Frequently Asked Questions ( FAQ) 1. Who is Xenu? 2. Is Xenu’s Link Sleuth (TM) better than Incontext WebAnalyzer? The answer to the question: Yes and No. Xenu’s Link Sleuth (TM) does not have the graphic capabilities of Incontext WebAnalyzer 2.0 («Wavefront view»). But here are some of the advantages of Xenu’s Link Sleuth (TM) : It is free Simple user-interface Better error reports (not just «network error») «Save» works also while the software is busy The «broken links view» shows only broken links; In WebAnalyzer you’d have to press the button again and again as the window fills with crap. While Xenu does not offer an «update» facility (which doesn’t work anyway), it has a «recheck broken links» function that works fine. It is small, written by one person experienced in Windows software development since 1993 and who works as a professional software developer since 1983. This means that bugs will be corrected quickly. This is a matter of honour. The report can be viewed easily, even when you have long URLs. Uses much less disk space for intermediate files, executable file much smaller Loading of saved files much faster (WebAnalyzer loses time by displaying the extra graphics) Supports SSL websites («https:// «) Partial testing of ftp and gopher sites Search for local orphan files Special handling of redirected URLs Site Map Partial randomization of checking order, means less concurrent requests on a single server Check your website both with this product and with another product (Linkbot, LinkScan, LinkAlarm, Web Link Validator, Screaming Frog and InSpyder offer trial versions, LinkExaminer is free and seems to be pretty good for SEO oriented tasks), and decide what you need and what you are willing to pay. If you do find something better in a different tool, tell me, even if it hurts 🙂 3. Is Xenu better than a web-based service? Audisto.com (as of June 2013 it was known as strucr.com) is also interesting (One of the founders invited me into a restaurant and we had a very nice talk). Audisto.com focuses on «the big picture» with websites. Not so much just finding broken links (it does not check external links), but find URLs that could be a problem for SEO, or find certain common HTML problems. Their target are big, really big websites (several millions of urls), where the web team has lost the understanding about what is going on. Sadly they no longer have free subscriptions (see pricing). Server solution advantages: No need to install anything Independent of user OS No use of client bandwith Might be able to do more URLs, because servers will usually not keep all URLs in memory Features can be updated without the user having to update his own system Server solution disadvantages: Dependent of server bandwidth Cannot always be free, due to costs for hosting Passwords must be uploaded to server Cannot check intranets or local sites on HDD Security risk if server gets hacked Some server solutions insist on uploading an authorization file; might be difficult for companies with long decision delays Legal risk if service is used to analyse competition Client solution advantages: Can run a check at any time Passwords can be kept locally Can check intranets or local sites on http://localhost or HDD (before they get uploaded!) Tailored versions can be made Would still be usable if I suddenly get hit by a safe Check can be done without asking Client solution disadvantages: Security risk if software developer moves over to the dark side Client bandwith is used Dependent of having a computer that can run downloaded software Dependent of having the correct OS (unless the client is written in Java) Dependent of the RAM amount Any more ideas pro or contra one of the two solutions? Contact me. (If you want to report a bug, click here). 4. Can I support the author? Tilman Hausherr Poschingerstrasse 14 12157 Berlin Germany If you are on facebook, you can also click «like» here and here to increase the statistic near my name or near the product 🙂 Other things I need help with: if you’re an english native speaking person who understands german and knows the lingo of recipes, please check the third-party translation of this recipe of a Xenu cake by Ilse Hruby (you might try it, too! It tastes great!) 5. Why does Xenu’s Link Sleuth (TM) report http://www.site.com/../page/index.html as broken? 6. How can I configure a proxy? One user with Windows 2000 always had a timeout, he solved it by checking «Use HTTP 1.1» and also «Use HTTP 1.1 through proxy connections» in the «Advanced» tab of the Internet Options in the control panel. However, this may not work for everyone, because some web servers do not support HTTP 1.1. 7. Why does Xenu’s Link Sleuth (TM) report a URL with a space in it? 8. I use Mozilla 3.0 Gold and can’t get rid of file: URLs for images. What can I do? 9. What is the maximum number of URLs that can be checked? A 64 bit beta version is available which may or may not allow more URLs. Just unpack the ZIP file and move the XENU.EXE and ZLIBWAPI.DLL files at the place where you have the XENU.EXE file currently (rename the old XENU.EXE file first to save it). The new one is based on Microsoft Visual Studio 2010. The 64 bit EXE file is about 10 times as big as the 32 bit version that is based on the good old Visual Studio 1998. Microsoft has confirmed the problem. 10. Can the software check my site locally? The results will not always be the same as a «remote» check: Sometimes you’ll get «error 3». It happens because the WININET.DLL is unable to handle directories, i.e. links that end with «/». You can avoid this by linking to the actual «main file», usually index.html or default.html. That your browser can handle local directories and display them nicely, is because he does additional work, which I do not. Mixups of higher/lower case characters in links won’t be found, since Windows does not make a difference. But UNIX does! The main reason that you still need to make occasional «remote» checks is because you might have forgotten to upload your files to your WWW server. A user of IE 4.0 reported that when not online, the software checks every «remote» URL like a local file. This is a problem of the newer version of the WININET.DLL; the version with IE 3.0 reports «no connection» or «no such host» instead, which is more logical. 11. Does it work on Windows NT 3.51? 12. How is it so damn fast? 13. Can I have the source code? 14. Can I buy the source code? 15. Just for fun, I checked Tilman’s web site, and found many broken links. Why? 16. How do I correct broken links? 17. What about ftp and gopher sites? The method for checking gopher sites is still unreliable. When an ftp or gopher site is accessed through a proxy, this proxy builds up a web page. Sadly, it doesn’t always bring up the information whether the URL exists or not. When you access a gopher site without a proxy, it brings an error message, but not an error code. This seems to be a bug of the OpenURL() function of WININET.DLL. The output lists ftp and gopher sites as links, which allows you to make a manual check of these sites. 18. Why can’t I launch URLs? The cause is usually that you have not installed your browser properly (maybe you just transferred the files from another computer). Solution: update or reinstall your browser. Starting with version 1.1b, I have stopped displaying an error message when the registry is incomplete, because there were too many complaints. Instead, the browser will simply be launched with the page. This has the disadvantage that the page won’t be displayed in an extra window of the current active browser application. One user with Microsoft Vista 64 (UAC disabled) was unable to launch URLs (message box: «Unable to open browser for ‘URL’: error 5: Access is denied»). The cause was COMODO Firewall Pro 3.0.25.378. Without the firewall, it worked fine. Please remember that «Personal Firewalls» are mostly snake-oil. Set up an external firewall box instead — this is usually included in your router. 18a. Why does the browser not open a new window? 18b. Why does Link Sleuth freeze when launching the report? Solution: disable the site map in the options dialog, or exclude the «deep» parts of your website (e.g. a forum) in the initial dialog box. Version 1.3 has an abort dialog. 18c. Why does Link Sleuth freeze when launching the report or a URL? 19. What about cookies? If you need cookies because you have used Internet Explorer to authenticate yourself before starting a run to prevent the server from delivering URLs with a session ID then you can enable the cookies in the advanced options dialog. (This has been available since Version 1.2g) Warning: You should not use this option if you have links that delete data, e.g. a database or a shop — you are risking data loss. 20. Why are some links reported as «broken» by Xenu, that can be displayed within my browser? 21. Why can’t I connect to «secure» (https) sites ? 22. Any known problems with Windows 95? A simpler solution is to go to http://windowsupdate.microsoft.com and install whatever they tell you (you need to have IE 4.0 or higher on your system) 23. Any known problems with Windows 2000? Windows 2000 automatically sets a configuration option to use HTTP 1.1 for connecting to web sites. Many, many web sites do not use that version but continue to use HTTP 1.0, so the automatic setting may prevent connections. This is the reason why Xenu would not run for me. When I disabled that setting, Xenu performed properly. To disable that setting: Control Panel -> Internet Options -> Advanced (tab) -> HTTP 1.1 settings (list heading) -> Use HTTP 1.1 (checkbox: uncheck it) 24. Can I configure the timeout? Alternatively, try this: Start the Registry Editor (REGEDIT.EXE) Go to HKEY_CURRENT_USER \ Software \ Microsoft \ Windows \ CurrentVersion \ InternetSettings Select New > DWORD from the Edit menu Call it ReceiveTimeout with a value of * 1000 (The «hidden» default is 300000, i.e. five minutes, which is too long) Restart your system Some users have complained that if one URL hits a timeout or a failed connection, all URLs from that host also do. Starting with version 1.2h, this behaviour can be disabled by unchecking «fail all URLs with same failed host» in the advanced options dialog. (The default behaviour is «checked») 25. What about JavaScript? My solution, which was first announced in the user group, requires a change in the XENU.INI file. You need a basic understanding of regular expressions (regexp). You must put your regexp in the INI file, like this: In the example above, the substring within the first (. ) must contain the valid URL. Frank Visser suggested an improved regexp: Frank Visser has also written a better description on his site. Note: there may be no blank between within «javascript:function», because the regexp wouldn’t work. 26. What about passwords entered in a FORM? Submitting a FORM was never a technical problem for me; I have tested this years ago already, but without any user interface. My mistake was to look for a general way to catch FORMs in HTML pages, instead of just using the login FORM url as a start. I found a somewhat practicable solution at a competing site (WLV). A test version of Xenu (this may not be the most current version) with login FORMs can be found here The initial dialogbox has a new checkbox for POST and a POST query string. Note that the query string won’t be stored in the INI file. Imagine you’d want to check the (imaginary) password protected website https://www.host.com. Look at the HTML for the FORM: Thus, the start URL would be https://www.host.com/scripts/login.php and if the username is «Xenu», and the password is «Secret», the POST query string would be (The POST query string gets tricky if there are spaces or special characters in the parameters. It must be URL-encoded) Important: You must add https://www.host.com to the inclusion list. If you don’t, only URLs beginning with https://www.host.com/scripts/ will be checked; Don’t let Xenu hit the logout link! To avoid this, add the logout URL to the exclusion list: https://www.host.com/scripts/logout.php If your server doesn’t do proper URL-rewriting when sessions are disabled, then you must enable cookies in the advanced options dialog; Don’t let Xenu hit any URLs that delete or change something! 27. How about a WAP version? 28. What about these error codes? 29. Why do I get broken links with filelist.xml, editdata.mso and oledata.mso? You can also get rid of the problem by excluding them in the advanced options dialog. Xenu will exclude URLs that end with /filelist.xml, /editdata.mso and /oledata.mso. (This feature has been available since Version 1.2g) 30. Why do I get «file not found» on remote checks? 31. Can I make a foreign language version? 32. Why isn’t Xenu detecting missing URLs? One user had the problem that his Microsoft IIS server didn’t return the 404 error. He found help on this page, and then sent me his solution, which only works in .ASP under IIS: The Apache web server has a different (and better) method of doing the same thing using native HTML code for the webpage. You simply set the correct config items in the http.conf file on your box. Another user with Apache attributed the unwanted redirection to this line in the .htaccess file: 33. Running Xenu with Norton Internet Security 34. Why timeouts? 35. Any Spyware, Adware, Malware? Some debug output is stored in the file XENULOG.TXT which you will find in your %TEMP% directory. That file does not contain any passwords and it is used for support (I will sometimes ask you to attach it to an e-mail to me), primarly for problems with the launch of URLs in your browser (especially the report). The file is human-readable, so feel free to have a look. The file is not sent to me by Xenu, it just remains there and you can delete it if you wish. Here’s a green review by McAfee Siteadvisor about Xenu’s Link Sleuth. Note that until before July 11 2008, Yahoo Search (which uses input from McAfee SiteAdvisor) was redflagging every URL of the whole snafu.de domain, including my user site (this seems to have been corrected now). McAfee SiteAdvisor has redflagged the snafu.de domain, but not the user pages. This was related to three downloads (CuteFTP, GoZilla and Nok2Phone) on the customer support ftp site of snafu.de, who has been my ISP for over a decade. These downloads have been removed since then and both Yahoo and McAfee have been notified. On July 30 2008, I noticed that the snafu.de domain has been greenflagged. As of 22.8.2009, I was told by a user that Trend Micro Internet Security was redflagging this web page as «Dangerous», because Xenu is a «generic trojan». Such false positives are not an isolated problem, other people have had the same complaint. On August 27 I talked on the phone with a very friendly human from Trend Micro. He explained to me that his software wrongly considers mine to be «another antivirus software» because «it searches» (sure it does!), and that he installed the software on a test machine and understand it is harmless. He promised to «contact the lab». But after that, I was asked to make another support message on another web page, and nothing happened after that, but I haven’t had complaints from any more Trend Micro users since then. As of 30.10.2009, a McAfee Antivirus product claimed that my product is a «Trojan — Artemis». (McAfee describes this problem: «Artemis» & Other Possibly False Detections) After several complaints, it seemed that the problem had been solved with version 5836 (tested 18.12.2009). As of 21.6.2010, McAfee did it again with the new version 1.3.7, and later with 1.3.8. Despite contacting them, there was no reaction. After finding a different contact page for false alarms, McAfee contacted me the next day (on 14.10.2010) and told me that the false Artemis detection had been removed. On 21.11.2010, a user of Avira Webguard told me that my download URL was blocked. I found out that it was not blocked by the free antivurus product. After a complaint, it was unblocked two days later. To put any such «alerts» into the correct perspective, upload any Xenu.exe file to www.virustotal.com, which will check the file against 30 antivirus products. I’m not the only one «suffering» from this type of libel. Read this blog post by nirsoft.net Antivirus companies cause a big headache to small developers, or this blog by Bill Pytlovany McAfee Continues to Harm WinPatrol Users. This SARVAM blog entry shows that many AV products consider windows system files to be malware when packed. If you have any more questions about security, don’t hesitate to contact me. If you want to report a bug, click here. 36. How about wildcards in the inclusion and exclusion lists? 37. What about CSS? Attention: Similar to HTML URLs, the CSS URLs must be «internal» to the root URL, or be added to the inclusion list in the initial dialogbox. For example, if your root URL is http://www.host.com/stuff/ and your CSS URL is http://www.host.com/css/standard.css, then it won’t work — you should then add http://www.host.com/css to the inclusion list. 38. Running Xenu with Norton Security Scan 39. Why are there changing Session-IDs? To prevent having a new session generated for each new URL, all internal links must be generated dynamically. In Java servlets, this is done with HttpServletResponse.encodeURL(), which will either change the URL or leave it as it is, depending on wether cookies are enabled or not. In JSP, you should use the JSP Standard Tag Library (JSTL): of course you can still do it the hard way, with a scriptlet: In JSF, you should use the HTML tag library: If you use .php, you should use the SID constant. The manual explains how. 40. Problems in Israel A fix will be in version 1.3.9. If you can’t wait, use the current beta. Thanks, Yosi! 41. Using an external authentication server Alternatively, use the authentication URL (e.g. http://auth.host.com/blah/blahRedirect_WL.jsp?goto=http%3A%2F%2Fwww.host.com%2F.wlforward) as the root URL, and include the «real» root URL (here: http://www.host.com) in the initial dialog box. 42. Running Xenu against the Tomcat server can cause it to hang One cause were two JSF Beans that were not serializable. Another was an error message by tomcat about an aborted GET access on /Context/faces/javax.faces.resource/jsf.js?ln=javax.faces". The later cause has been removed in 1.3.9. 43. Why does my page not have any outgoing links? Bug List Future feature List The Story of Xenu’s Link Sleuth (TM) (for fellow software developers) My philosophy on software development has always been «smaller, simpler, cheaper», long before the NASA realized this (in May 2002 I was told that the actual NASA philosophy was Faster, Better, Cheaper — oops!) Because of that, I need no fancy (but totally useless) graphics like in WebAnalyzer. Just results. And they’d better be 100% correct or I’d have to kill myself 🙂 The application is written in Visual C++, and uses the MFC classes as much as possible: CDocument, CView, CListView, CObArray, CMapStringToOb, CArchive, CInternetSession, CHttpFile, etc, etc. That saved me a lot of time! Credits Links for further reading Wired article: Rotten Links Hamper Learning The study: Broken Links: Just How Rapidly Do Science Education Hyperlinks Go Extinct? Another study: Digital libraries and World Wide Web sites and page persistence Trademarks tilman at snafu dot de Источник Читайте также:  Браузер для windows сравнение Оцените статью Вам также может понравиться Windows или Linux: Что лучше выбрать? Есть много причин выбирать между Windows и Linux, но Файл владелец изменить linux Команда Chown в Linux Chown Command in Linux (File Установка шлюза по умолчанию linux Настройка сети вручную Содержание Краткое описание Чем разбить диск для linux ИТ База знаний Курс по Asterisk Полезно — Узнать IP — Правообладателям Политика конфиденциальности Контакты