This part of the documentation covers the installation of Crawly.
Installing crawly is simple with pip:
$ pip install crawly
or, with easy_install:
$ easy_install crawly
You can download crawly.py into your project directory.
or you can install crawly from source code:
$ hg clone https://bitbucket.org/mouad/crawly
$ cd crawly
$ python setup.py install