Skip to content
GitLab
Explore
Projects
Groups
Topics
Snippets
Projects
Groups
Topics
Snippets
/
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Register
Sign in
Toggle navigation
Menu
Tarento
delivery-excellence
digital-assets
python-webscraping-quickstart
Commits
53b4b040
Commit
53b4b040
authored
2 years ago
by
pushkar191098
Browse files
Options
Download
Patches
Plain Diff
refactor: proxy, agentContext, chromeLock
parent
9c23e379
No related merge requests found
Changes
29
Hide whitespace changes
Inline
Side-by-side
Showing
20 changed files
docs/proxy.md
+152
-0
docs/proxy.md
src/app.py
+3
-6
src/app.py
src/common/__init__.py
+3
-2
src/common/__init__.py
src/common/blob_storage.py
+8
-7
src/common/blob_storage.py
src/common/elastic_wrapper.py
+8
-6
src/common/elastic_wrapper.py
src/common/errors.py
+69
-46
src/common/errors.py
src/common/scrapy_utils.py
+33
-1
src/common/scrapy_utils.py
src/common/selenium_utils.py
+52
-3
src/common/selenium_utils.py
src/config.py
+10
-2
src/config.py
src/models/__init__.py
+1
-1
src/models/__init__.py
src/models/agent_class.py
+17
-8
src/models/agent_class.py
src/models/agent_utils.py
+3
-2
src/models/agent_utils.py
src/models/status.py
+20
-0
src/models/status.py
src/proxy_config.yml
+5
-0
src/proxy_config.yml
src/repositories/agent.py
+34
-26
src/repositories/agent.py
src/requirements.txt
+2
-0
src/requirements.txt
src/resources/agent.py
+13
-44
src/resources/agent.py
src/scripts/info/__init__.py
+3
-2
src/scripts/info/__init__.py
src/scripts/info/applied_selenium.py
+29
-22
src/scripts/info/applied_selenium.py
src/scripts/info/grainger_scrapy.py
+86
-85
src/scripts/info/grainger_scrapy.py
with
551 additions
and
263 deletions
+551
-263
Write
Preview
Supports
Markdown
0%
Try again
or
attach a new file
.
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Save comment
Cancel
Please
register
or
sign in
to comment
Menu
Explore
Projects
Groups
Topics
Snippets