Skip to content
Permalink

Comparing changes

Choose two branches to see what’s changed or to start a new pull request. If you need to, you can also or learn more about diff comparisons.

Open a pull request

Create a new pull request by comparing changes across two branches. If you need to, you can also . Learn more about diff comparisons here.
base repository: datawizard1337/ARGUS
Failed to load repositories. Confirm that selected base ref is valid, then try again.
Loading
base: 2.11
Choose a base ref
...
head repository: datawizard1337/ARGUS
Failed to load repositories. Confirm that selected head ref is valid, then try again.
Loading
compare: master
Choose a head ref
3 contributors
Loading
Showing with 1,509 additions and 586 deletions.
  1. +1 −0 ARGUS.egg-info/SOURCES.txt
  2. BIN ARGUS.exe
  3. +174 −75 ARGUS.py
  4. BIN ARGUS/__pycache__/__init__.cpython-36.pyc
  5. BIN ARGUS/__pycache__/__init__.cpython-37.pyc
  6. BIN ARGUS/__pycache__/items.cpython-36.pyc
  7. BIN ARGUS/__pycache__/items.cpython-37.pyc
  8. BIN ARGUS/__pycache__/pipelines.cpython-36.pyc
  9. BIN ARGUS/__pycache__/pipelines.cpython-37.pyc
  10. BIN ARGUS/__pycache__/settings.cpython-36.pyc
  11. BIN ARGUS/__pycache__/settings.cpython-37.pyc
  12. +45 −1 ARGUS/items.py
  13. +113 −33 ARGUS/pipelines.py
  14. +21 −2 ARGUS/settings.py
  15. BIN ARGUS/spiders/__pycache__/__init__.cpython-36.pyc
  16. BIN ARGUS/spiders/__pycache__/__init__.cpython-37.pyc
  17. BIN ARGUS/spiders/__pycache__/dualspider.cpython-36.pyc
  18. BIN ARGUS/spiders/__pycache__/dualspider.cpython-37.pyc
  19. BIN ARGUS/spiders/__pycache__/linkspider.cpython-36.pyc
  20. BIN ARGUS/spiders/__pycache__/linkspider.cpython-37.pyc
  21. BIN ARGUS/spiders/__pycache__/textspider.cpython-36.pyc
  22. BIN ARGUS/spiders/__pycache__/textspider.cpython-37.pyc
  23. +288 −79 ARGUS/spiders/{textspider.py → dualspider.py}
  24. +42 −0 ARGUS_noGUI.py
  25. +75 −58 README.md
  26. BIN __pycache__/ARGUS_noGUI.cpython-37.pyc
  27. +1 −0 bin/__init__.py
  28. BIN bin/__pycache__/aggregator.cpython-36.pyc
  29. BIN bin/__pycache__/aggregator.cpython-37.pyc
  30. BIN bin/__pycache__/kill_all_jobs.cpython-36.pyc
  31. BIN bin/__pycache__/kill_all_jobs.cpython-37.pyc
  32. BIN bin/__pycache__/postprocessing.cpython-36.pyc
  33. BIN bin/__pycache__/postprocessing.cpython-37.pyc
  34. BIN bin/__pycache__/start_crawl.cpython-36.pyc
  35. BIN bin/__pycache__/start_crawl.cpython-37.pyc
  36. BIN bin/__pycache__/start_crawl_steering.cpython-37.pyc
  37. +11 −2 bin/aggregator.py
  38. +2 −2 bin/kill_all_jobs.py
  39. +85 −157 bin/postprocessing.py
  40. +20 −0 bin/settings.txt
  41. +74 −0 bin/skipped_urls.py
  42. +64 −25 bin/start_crawl.py
  43. +87 −0 bin/start_crawl_steering.py
  44. +41 −1 build/lib/ARGUS/items.py
  45. +103 −31 build/lib/ARGUS/pipelines.py
  46. +134 −35 ARGUS/spiders/linkspider.py → build/lib/ARGUS/spiders/dualspider.py
  47. +88 −47 build/lib/ARGUS/spiders/textspider.py
  48. BIN dbs/ARGUS (conflicted copy 2020-09-15 131214).db
  49. BIN dbs/ARGUS.db
  50. BIN eggs/ARGUS/1527067694.egg
  51. BIN eggs/ARGUS/1528890667.egg
  52. BIN eggs/ARGUS/1528894935.egg
  53. BIN eggs/ARGUS/1528900102.egg
  54. BIN eggs/ARGUS/1528961892.egg
  55. BIN eggs/ARGUS/1528961989.egg
  56. BIN eggs/ARGUS/1528962170.egg
  57. BIN eggs/ARGUS/1528962505.egg
  58. BIN eggs/ARGUS/1528962908.egg
  59. BIN eggs/ARGUS/1529052464.egg
  60. BIN eggs/ARGUS/1529053776.egg
  61. BIN eggs/ARGUS/1529054125.egg
  62. BIN eggs/ARGUS/1529054569.egg
  63. BIN eggs/ARGUS/1529054695.egg
  64. BIN eggs/ARGUS/1529055429.egg
  65. BIN eggs/ARGUS/1529311398.egg
  66. BIN eggs/ARGUS/1529311772.egg
  67. BIN eggs/ARGUS/1529311837.egg
  68. BIN eggs/ARGUS/1529312404.egg
  69. BIN eggs/ARGUS/1529312553.egg
  70. BIN eggs/ARGUS/1529312626.egg
  71. BIN eggs/ARGUS/1529312735.egg
  72. BIN eggs/ARGUS/1529312746.egg
  73. BIN eggs/ARGUS/1529313092.egg
  74. BIN eggs/ARGUS/1529313447.egg
  75. BIN eggs/ARGUS/1529313920.egg
  76. BIN eggs/ARGUS/1529313961.egg
  77. BIN eggs/ARGUS/1529314377.egg
  78. BIN eggs/ARGUS/1529314500.egg
  79. BIN eggs/ARGUS/1529314518.egg
  80. BIN eggs/ARGUS/1529314595.egg
  81. BIN eggs/ARGUS/1529329569.egg
  82. BIN eggs/ARGUS/1529499317.egg
  83. BIN eggs/ARGUS/1529502877.egg
  84. BIN eggs/ARGUS/1529503250.egg
  85. BIN eggs/ARGUS/1529503439.egg
  86. BIN eggs/ARGUS/1529568305.egg
  87. BIN eggs/ARGUS/1529568688.egg
  88. BIN eggs/ARGUS/1529568888.egg
  89. BIN eggs/ARGUS/1529568968.egg
  90. BIN eggs/ARGUS/1529569033.egg
  91. BIN eggs/ARGUS/1529569427.egg
  92. BIN eggs/ARGUS/1529570258.egg
  93. BIN eggs/ARGUS/1529570427.egg
  94. BIN eggs/ARGUS/1529570605.egg
  95. BIN eggs/ARGUS/1529582687.egg
  96. BIN eggs/ARGUS/1529583706.egg
  97. BIN eggs/ARGUS/1529584041.egg
  98. BIN eggs/ARGUS/1529585649.egg
  99. BIN eggs/ARGUS/1529588512.egg
  100. BIN eggs/ARGUS/1529915423.egg
  101. BIN eggs/ARGUS/1529915579.egg
  102. BIN eggs/ARGUS/1529917379.egg
  103. BIN eggs/ARGUS/1529917882.egg
  104. BIN eggs/ARGUS/1529919489.egg
  105. BIN eggs/ARGUS/1529928545.egg
  106. BIN eggs/ARGUS/1529928673.egg
  107. BIN eggs/ARGUS/1529930714.egg
  108. BIN eggs/ARGUS/1529933079.egg
  109. BIN eggs/ARGUS/1529936496.egg
  110. BIN eggs/ARGUS/1529998500.egg
  111. BIN eggs/ARGUS/1529999000.egg
  112. BIN eggs/ARGUS/1529999120.egg
  113. BIN eggs/ARGUS/1529999263.egg
  114. BIN eggs/ARGUS/1529999541.egg
  115. BIN eggs/ARGUS/1530001697.egg
  116. BIN eggs/ARGUS/1530026090.egg
  117. BIN eggs/ARGUS/1530026479.egg
  118. BIN eggs/ARGUS/1530026628.egg
  119. BIN eggs/ARGUS/1530084034.egg
  120. BIN eggs/ARGUS/1530084894.egg
  121. BIN eggs/ARGUS/1530109309.egg
  122. BIN eggs/ARGUS/1530176281.egg
  123. BIN eggs/ARGUS/1531471333.egg
  124. BIN eggs/ARGUS/1536847759.egg
  125. BIN eggs/ARGUS/1536848005.egg
  126. BIN eggs/ARGUS/1544620557.egg
  127. BIN eggs/ARGUS/1546933739.egg
  128. BIN eggs/ARGUS/1546933834.egg
  129. BIN eggs/ARGUS/1587469314.egg
  130. BIN misc/ARGUS.ico
  131. +13 −11 misc/ISO_language_codes.txt
  132. BIN misc/info.gif
  133. BIN misc/pics/ARGUS_GUI.PNG
  134. BIN misc/pics/ARGUS_dualspider.png
  135. BIN misc/pics/ARGUS_logo.png
  136. BIN misc/pics/ARGUS_noGUI.png
  137. BIN misc/pics/ARGUS_textspider.png
  138. BIN misc/pics/scrapyd_jobs.PNG
  139. BIN misc/pics/scrapyd_jobs.png
  140. BIN misc/pics/scrapyd_server.png
  141. +27 −27 scrapyd.conf
1 change: 1 addition & 0 deletions ARGUS.egg-info/SOURCES.txt
View file
Original file line number Diff line number Diff line change
@@ -11,5 +11,6 @@ ARGUS.egg-info/dependency_links.txt
ARGUS.egg-info/entry_points.txt
ARGUS.egg-info/top_level.txt
ARGUS/spiders/__init__.py
ARGUS/spiders/dualspider.py
ARGUS/spiders/linkspider.py
ARGUS/spiders/textspider.py
Binary file modified ARGUS.exe
View file
Binary file not shown.
Loading