Free Search Engines Submit URLs Project

---

• Incentives
• Data and Tools
• Requirements
• Installation
• Download
• Spread the word
• Changes Log
• Similar (free!!!) projects

Incentives

You have written a great web page and you want others to know about it? But how to accomplish that task with as little investment of time and money as possible? The choices you have:

• Pay others money to do the job for you (submit to N engines for N bucks scheme)
• Do-It-Yourself (visit each search engine submit page, type in and submit)
• Or use this free resource. Get a little script which does it for you (Or just paste the complete link into your favorite browser's location window) and get the list of URLs including the fields that needed in order to complete the submission.

I'll keep updated list of Engines here online. Feel free to pick and use them.

Please contribute by posting new Engine Entries that aren't yet listed here and updates for outdated URLs if the format of some of them has been changed. (email them to me). Please don't send me just URLs!!! I've got mllions of them! Please take a look at the entry format and submit the whole entry! Otherwise it's useless!

Just think about it: If each one of you will send only one URL in a short time you will be able to submit to hundreds of search engines for free. You get many more engines than all the existant services, who charge money, offer to you. Help Me To Help You!

Of course I provide a free script to submit the data.... See below

Data and Tools

I have completely changed the way I store the search engines Data. Now it's stored in more convenient way. I have also splitted the code and the data into a different perl packages, so if you get the updated package of search engines, all you have to do is to replace one package and not to touch your code.

Note that I have removed the support to submit from the web (cgi), It makes more sence to put the script in a crontab - so it'll run automatically for you each night. However if you still wish to submit thru the web go to the old pages and get the old script to do this for you. (It's incompatible with the new Data modules, but you can easily change the current script to do the job for you - a matter of a few lines of code)

I also wrote a convert.pl script to create new entries for the Submit::Engines . You feed the script with the URL where a new submit form located and it creates the new entry for you (Note: It's not perfect yet, but works in most of the cases).

So when you unpack the package you will find:

• Submit/Engines.pm - Submit::Engines which keeps the search engines Data, You can add more entries with the help of convert.pl. I'll try to keep this data module updated (please help me!).
• Submit/Client - Submit::Client keeps your personal data. It's the module where you specify the information about you and your site. You get it with my data as I use it, so just replace it with yours! Since from now on it's in the separate package you will have to modify it only once!
• submit.pl - script does the real submit.
• Submit/FormURLs - Submit::FormURLs keeps the URLs to submit Forms, convert.pl use it to get the URLs.
• convert.pl - Tries to save you most of the job of adding new engines to the DataBase by fetching the submit form, parsing it, and building a new entry for Submit/Engines.pm. You will have to tune , select the options from select lists and etc. Ofcourse you can use only the submit.pl script. But if you want to add new engines which aren't in my list, you have the tool now! If you will share the generated data with rest of us, the world will be very gratefull to you!

I also did some improvements to the submit.pl script. Now it has 3 reporting modes (you tweak them by changing the variables in submit.pl code, config section)

• $just_show - doesn't submit the data but shows you what's going to be submitted, convenient if you want to copy and paste the data to be submitted into your browser's location window, and debug it, if you think something is wrong
• $show_full_respond - Whether you want to see the full respond from the servers, or only OK/Not OK. This feature was requested by people who discovered that sometimes the data wasn't accepted but the server responded correctly , so my script generated 'OK' when actually it wasn't - So now you can watch the responds from each server, and to check from time to time that everything is really OK!
• $strip_html - enabling the above option, made me to add another mode where you can choose the see the whole HTML or to get only the stripped text, which can be easily viewed in the xterm or in non HTML capable editor.

So now you have a more convenient tool, for submission and monitoring of the results. I suggest to put an entry in your cron so the tool will be atomatically envoked each night and do the job for you. All is left for you is to check from time to time that the data is correct and get the updates from ths site.

Requirements

To run the script you will need

• perl5.004+
• libwww-perl (URI::URL, LWP::Simple, HTML::TreeBuilder, HTML::Parse, LWP::UserAgent, HTTP::Request::Common)

If you don't have these installed and you don't have a root access see http://stason.org/TULARC/webmaster/myfaq.html#7

Installation

• Check that you installed the packages from the above section.
• Get the distribution package.
• Unpack it
• gzip -d submit.tar.gz
• tar -xvf submit.tar
• cd submit
• configure the submit.pl
• perl location at first line (use which perl command for that)
• proxy setting if you need one
• output configuration variables ($just_show, $show_full_respond and $strip_html ) as described in the Data and Tools section.
• Enter your data in Submit/Client.pm
• Basically you are ready to run the script
• run it : ./submit.pl

Download

Current version is 2.04 (01.25.2000)

Pick the submit.tar.gz.

Spread the word

Please put a link back to this page helping others to save their time and money if you use the information provided on this page by adding this little HTML snippet to your pages:

My page was submitted for free with help of 
<A HREF="http://stason.org/TULARC/works/submit/submit-urls.html">
Free Search Engines Submit URLs Project</A>

Changes Log

• 01.25.2000 - ver 2.04
  * added and removed a few engines
• 9.14.99 - ver 2.03
  * Added a support for command line options
  * Help added
  * Now using environment variables for proxy settings
  
• 7.15.99 - ver.2.02
  * Removed some engines
  * Most of the engines have changed their submit forms - I have updated these
  * Added 15 new engines!!!
  * Now the code handles redirects as well
  * Current list of available engines: FFAHyperLinks, altavista, aolnetfind, chaotix, euroferret, excite, go, google, goto, hotbot, infomak, infoseek, intersearch, ionsearch, lycos, magellan, moshix2, netfind, northernlight, planetsearch, questfinder, register_it_netscape, scrub, searchlite, thebiglist, voila, webcrawler, webventure, whatuseek
  Note that you should add more fields to your %item! New engines require new fields!
• 1.31.99 - ver 2.01
  * new engines added (now there are 19 of them)
• 10.1.98 - ver 2.00
  * a complete rewrite of the engines DataBase representation
• 01.1.98 - ver 1.00
  * first version

Similar (free!!!) projects:

• GNet's free submission tool
• A Search Engines Galore World provides you yet another submit to many search engines at once site
• SimpleSubmit - Because only the major search engines are supported, only your URL and email are needed. You don't have to spend time entering in descriptions for your site. Unlike other submission sites, SimpleSubmit! requires no registration of any kind. After you click submit, you site goes straight to the engines. When submiting your site, SimpleSubmit! uses frames to send your information to all the search engines at once, allowing you to check the results of each engine.
• Yahoo Wizard - Yahoo! Site Submission Wizard
• Self promotion Using this site, you can automatically register your website with all the important search engines and indexes, get tips on proper website promotion techniques, improve your HTML, and much more. You will be able to do a better job of promoting your website, and do it faster and more easily as well.
• WebFarm Submit your site to Major Search Engines - free online form to submit to another about 20 search engines.