This document is outlinging some of the challenges faced in distributed computing in relation to a distributed web crawler. Different distribun scenarios are described and an implementation solution is presented which bases itself on mobile software agents using the open source software agent framework, JADE. The document also addresses the issues concerning resrouce connections in a distributed environment and how this can be solved in a distributed crawler.