diff options
| author | neodarz <neodarz@neodarz.net> | 2019-02-06 19:15:36 +0100 |
|---|---|---|
| committer | neodarz <neodarz@neodarz.net> | 2019-02-06 19:15:36 +0100 |
| commit | 9a8badd5dffe47813489ab0b355f5db5faa66646 (patch) | |
| tree | bf53db13612cd7c32f2eadfe905cad83ce50a0d7 /crawler/neodarznet/spiders/__init__.py | |
| parent | f84e8fb75b8096dff5a39936ac26c933fdba3059 (diff) | |
| download | khanindexer-9a8badd5dffe47813489ab0b355f5db5faa66646.tar.xz khanindexer-9a8badd5dffe47813489ab0b355f5db5faa66646.zip | |
Add ability to update url who are one week old and content modified
Diffstat (limited to 'crawler/neodarznet/spiders/__init__.py')
0 files changed, 0 insertions, 0 deletions