sykohpath.com

Sitemap XML Generator

Forgot I made this a while back...Ok, you know how there's "free" sitemap.xml generators?  And you know how they limit it to like, 10 links?  And you know how they suck?

Time to fix that.

Instructions:

1) Open "sitexmlgen.php"
2) Change the site to scan in line number 35:  $linklist[0] = "http://www.sykohpath.com/";
3) Place on your site
4) Run the script.  Example: www.yoursite.com/sitexmlgen.php
5) Wait until it finishes, will take long on large sites with many links.
6) When finished, view source
7) Copy ALL the text under "XML IS BELOW" section.
8) Paste into new document "sitemap.xml".
9) Done with generation!  If you don't know what to do with that file, learn to SEO.
10) there is no 10.

And here's the code.  Note that there *is* a 5000 link limit, imposed by sitemap.org:

Code Sample:

1. <?php /* ---- Information ----
3. Name: sitexmlgen.php  "sitemap.xml Generator"
4. Last Updated:  20110512 080000
5. Page Version: sitexmlgen.php v1.0
6. Author: SyKoHPaTh
8. ---- Version History ----
10.   1.0  Initial Coding
12. -------------------------
13.   PURPOSE:
14.    "crawl" a site and record the links if they are valid.
15.    Note: this only picks up links between <a> tags.
17. -------------------------
18.   TODO:
20. -------------------------
21.   LICENSE:
23.    Modification: OK, but must keep credit line: "SyKoHPaTh (www.sykohpath.com)", and this License.  Any modifications MUST be written in "Version History", with your name and/or handle, and what the modification was.
24.    Free for public and commercial use.  If you paid for this, you got scammed.
26. --------------------------
27. */
30. /* -------- VARIABLES -------- */
32. $linklist = array();
34. $linklist[0] = "http://www.sykohpath.com/";
36. $sitemap_limit = 50000;  //enforced by sitemap.org, max number of <url> links in one sitemap XML file.
37.         // there is also a 10MB limit to sitemap XML files, but we're not checking for that here.
40. /* -------- FUNCTIONS -------- */
42. function digger($scanlink) {
43.   //does the work of scanning a page and putting links into an array
44.   
45.   $linkcontents = @file_get_contents($scanlink);
46.   if(!$linkcontents) {
47.    print "Unable to open: {$linkcheck}n";
48.    return array();
49.   }
51.   $linkinfo = parse_url($scanlink);
52.   $linkcore = $linkinfo['scheme'] . "://" . $linkinfo['host'];
54.   $linkcontents_strip = strip_tags($linkcontents, "<a>");
55.   $linkcontents_mod = preg_replace("/<a([^>]*)href="//is", "<a$1href="{$linkcore}/", $linkcontents_strip);
56.   $linkcontents_mod = preg_replace("/<a([^>]*)href="?/is", "<a$1href="{$scanlink}/?", $linkcontents_mod);
57.   preg_match_all("/<a(?:[^>]*)href="([^"]*)"(?:[^>]*)>(?:[^<]*)</a>/is", $linkcontents_mod, $matches);
59.   return $matches[1];
60. }
62. function checklink($linkcheck) {
63.   //simply checks a link to see if it loads up or not
64.   $linkcontents = @file_get_contents($linkcheck);
65.   if(!$linkcontents) {
66.    print "Unable to open: {$linkcheck}n";
67.    return false;
68.   }
69.   return true;
70. }
72. /* -------- Initial header thing -------- */
74. $xmloutput = "<?xml version="1.0" encoding="UTF-8" ?>n<urlset   created with SyKoHPaTh's SiteMap.XML generator  www.sykohpath.com  -->n";
76. $x = 0;
78. while(1==1){
79.   //gen list
80.   print "Scanning [$x of " . (count($linklist)-1) . "]: " . $linklist[$x] . "<br>n";
81.   $linkmatch = digger($linklist[$x]);
82.   //scan list
83.   foreach($linkmatch as $key=>$value){
84.    //print $key . ": " . $value . "n";
85.    //filter bad data
87.     //check link against $linklist[0]
88.    if(substr($value, 0, strlen($linklist[0])) == $linklist[0]){
89.     if(!(in_array($value, $linklist))){
90.      //push to array
91.      $linklist[] = $value;
92.      $xmloutput .= "<url>nt<loc>" . $value . "</loc>n</url>n";
93.     }
94.    } else {
95.     //check if it's a foreign link
96.     if(!substr($value, 0, 4) == "http"){
97.      //add scanned linklist to front, and see if it's a valid link
98.      //cut out everything after the slash:  http://w3dev.millerind.com/parts/index.php?bid=2
99.      $pattern = preg_replace("/[^/]*$/s", "", $linklist[$x]);
101.      $value = trim($value); //strip whitespace BAD CODER, BAD!
102.      $value = preg_replace("/^[/]/s", "", $value); //strip beginning / if there is one
104.      if(checklink($pattern . $value)){
105.       $value = $pattern . $value;
106.       if(substr($value, 0, strlen($linklist[0])) == $linklist[0]){
107.        if(!(in_array($value, $linklist))){
108.         //push to array
109.         $linklist[] = $value;
110.         $xmloutput .= "t<url>ntt<loc>" . $value . "</loc>n</url>n";
111.        }
112.       }    
113.      }
114.     }
115.    }
116.   }
118.   //echo "Total links: " . count($linklist) . "<br>n";
119.   //if nothing new was added, exit loop
120.   if($x + 1 >= count($linklist)){ break; }
121.   //if limit reached, exit loop
122.   if($x > $sitemap_limit - 1){ break; }
123.   $x=$x+1;
124. }
126. //Optional tags for each link.
127. //<lastmod>" . date("Y-m-d") . "</lastmod>n
128. //<changefreq>yearly</changefreq>n
129. //<priority>0.5</priority>n
131. $xmloutput .= "</urlset>";
133. print "<br>n<br>n-----------------------------------------------------------<br>n           XML IS BELOW (view source)<br>n           Copy and paste into "sitemap.xml"<br>n-----------------------------------------------------------<br>
134. n" . $xmloutput;
136. ?>

php, xml, sitemap,

0 comments.