Mini-Google

Internal documentation

URL Resolver

Scope

Manages URL Identifiers for URLs. It also manages the depth of the crawling, by associating with each URL a given depth and by sending to the URL server only URLs having a depth less than a fixed limit.

Interface

Throught a declared server socket, it receives messages :

GETID _urlid_crt_ _basestring_ _url_
                  |__________|
                  if 0 it is the crt URL

and answers with message :

URLID _urlid_

Throught a declared server socket, it receives messages :
```
PUTR _urlid_ _rank_
```
and actualizes its database.
Throught a declared server socket, it receives messages :
```
GET _urlid_
```
and answers with message :
```
URL _urlid_ _rank_ _urlstring_
```
To the URL server it sends message :
```
CRW _urlid_ _urlstring_
```

URL Indexer

This is a system used to store URLs. It should be accessed only by the URL Resolver.