Project Goals

1
Project Goals

• Software development process
• Team work
• UML diagrams
• Some new technologies
• A web based Search Engine . Small Scale .
  For CoC web sites.

2
Basic Archtecture
JDBC SQL
MySQL Database Server
HTTP
CGI
Web Browser
Web Server
CGI Script
URLs
Crawler
Database
3
Main components and our choices

• UI HTML form, JavaScript
• CGI Shell Script, Perl
• SearchEngine application Java, JDBC, and SQL
• Crawler Crawler, Ranking algorithm, ...
• Database design Database schema
• Our starting point 0

4
Interface Design

• Logo design
• Use of external application (Photoshop)
• Keep graphics simple and small in size.
• Web Site design
• Modeled after any typical search engine found on
  the web (search input, results, etc.)
• Optimized graphics for fast loading times
• Search results use same template as found on
  major web sites.

5
Database Schema
Keyword
Ref_id
n
1
Info
Index
Ref_id
URL
Rank
Summary
6
What we have done

• Download Install MySQL database
• Download Install MM JDBC driver for MySQL
• Get CGI account
• Code the UI in HTML forms
• Code CGI in Shell Script
• Obtain HTML form parser in Perl
• Code Java Application for Database
  communication
• Database schema design
• Design and implement crawler
• Get data and populate database tables
• Testing

7
Project testing

• Based on Use Case Diagram
• Database testing
• Java Application testing
• CGI testing
• Testing from the UI
• Sources for debug
• Web server log
• Database server log.

8
Technologies used

• HTML form, JavaScript
• Shell Script, Perl
• Java, JDBC, SQL
• MySQL
• Squeak

9
Comparison with Google

• Ranking algorithm pageRank
• Language C or C
• Much more complicated URL server, Crawler,
  Store server, URL resolver, Indexer, Sorter,
  Searcher.
• Parallel processing

10
Challenges

• Good quality
• Scalability
• Availability
• Efficiency
• Performance

11
Special Thanks

• Dr. Dick Gayler
• Miss Helene Brashear
• Dr. Karen Carter