Downloads:
2,739
Downloads of v 2.0:
559
Last Update:
13 Dec 2019
Package Maintainer(s):
Software Author(s):
- ERap320
Tags:
crowleer crawler crawling download cli web dump- Software Specific:
- Software Site
- Software Source
- Software License
- Package Specific:
- Possible Package Source
- Package outdated?
- Package broken?
- Contact Maintainers
- Contact Site Admins
- Software Vendor?
- Report Abuse
- Download
CrowLeer
- 1
- 2
- 3
2.0 | Updated: 13 Dec 2019
- Software Specific:
- Software Site
- Software Source
- Software License
- Package Specific:
- Possible Package Source
- Package outdated?
- Package broken?
- Contact Maintainers
- Contact Site Admins
- Software Vendor?
- Report Abuse
- Download
Downloads:
2,739
Downloads of v 2.0:
559
Maintainer(s):
Software Author(s):
- ERap320
CrowLeer 2.0
Legal Disclaimer: Neither this package nor Chocolatey Software, Inc. are affiliated with or endorsed by ERap320. The inclusion of ERap320 trademark(s), if any, upon this webpage is solely to identify ERap320 goods or services and not for commercial purposes.
- 1
- 2
- 3
Some Checks Have Failed or Are Not Yet Complete
Not All Tests Have Passed
Validation Testing Passed
Verification Testing Passed
DetailsScan Testing Resulted in Flagged:
This package was submitted (and approved) prior to automated virus scanning integration into the package moderation processs.
We recommend clicking the "Details" link to make your own decision on installing this package.
Deployment Method: Individual Install, Upgrade, & Uninstall
To install CrowLeer, run the following command from the command line or from PowerShell:
To upgrade CrowLeer, run the following command from the command line or from PowerShell:
To uninstall CrowLeer, run the following command from the command line or from PowerShell:
Deployment Method:
This applies to both open source and commercial editions of Chocolatey.
1. Enter Your Internal Repository Url
(this should look similar to https://community.chocolatey.org/api/v2/)
2. Setup Your Environment
1. Ensure you are set for organizational deployment
Please see the organizational deployment guide
2. Get the package into your environment
Option 1: Cached Package (Unreliable, Requires Internet - Same As Community)-
Open Source or Commercial:
- Proxy Repository - Create a proxy nuget repository on Nexus, Artifactory Pro, or a proxy Chocolatey repository on ProGet. Point your upstream to https://community.chocolatey.org/api/v2/. Packages cache on first access automatically. Make sure your choco clients are using your proxy repository as a source and NOT the default community repository. See source command for more information.
- You can also just download the package and push it to a repository Download
-
Open Source
-
Download the package:
Download - Follow manual internalization instructions
-
-
Package Internalizer (C4B)
-
Run: (additional options)
choco download crowleer --internalize --source=https://community.chocolatey.org/api/v2/
-
For package and dependencies run:
choco push --source="'INTERNAL REPO URL'"
- Automate package internalization
-
Run: (additional options)
3. Copy Your Script
choco upgrade crowleer -y --source="'INTERNAL REPO URL'" [other options]
See options you can pass to upgrade.
See best practices for scripting.
Add this to a PowerShell script or use a Batch script with tools and in places where you are calling directly to Chocolatey. If you are integrating, keep in mind enhanced exit codes.
If you do use a PowerShell script, use the following to ensure bad exit codes are shown as failures:
choco upgrade crowleer -y --source="'INTERNAL REPO URL'"
$exitCode = $LASTEXITCODE
Write-Verbose "Exit code was $exitCode"
$validExitCodes = @(0, 1605, 1614, 1641, 3010)
if ($validExitCodes -contains $exitCode) {
Exit 0
}
Exit $exitCode
- name: Install crowleer
win_chocolatey:
name: crowleer
version: '2.0'
source: INTERNAL REPO URL
state: present
See docs at https://docs.ansible.com/ansible/latest/modules/win_chocolatey_module.html.
chocolatey_package 'crowleer' do
action :install
source 'INTERNAL REPO URL'
version '2.0'
end
See docs at https://docs.chef.io/resource_chocolatey_package.html.
cChocoPackageInstaller crowleer
{
Name = "crowleer"
Version = "2.0"
Source = "INTERNAL REPO URL"
}
Requires cChoco DSC Resource. See docs at https://github.com/chocolatey/cChoco.
package { 'crowleer':
ensure => '2.0',
provider => 'chocolatey',
source => 'INTERNAL REPO URL',
}
Requires Puppet Chocolatey Provider module. See docs at https://forge.puppet.com/puppetlabs/chocolatey.
4. If applicable - Chocolatey configuration/installation
See infrastructure management matrix for Chocolatey configuration elements and examples.
Private CDN cached downloads available for licensed customers. Never experience 404 breakages again! Learn more...
This package was approved as a trusted package on 27 Aug 2020.
Crowleer is a fast and flexible CLI web crawler with focus on pages download. It was created with simplicity, control and interfaceability in mind.
Usage
You can find usage information on the project's GitHub page.
Donate
If this program helped you, consider offering the developer a coffee.
Log in or click on link to see number of positives.
- crowleer.2.0.nupkg (99de2b85770a) - ## / 61
- crowleer.exe (9c968cc37e9b) - ## / 72
In cases where actual malware is found, the packages are subject to removal. Software sometimes has false positives. Moderators do not necessarily validate the safety of the underlying software, only that a package retrieves software from the official distribution point and/or validate embedded software against official distribution point (where distribution rights allow redistribution).
Chocolatey Pro provides runtime protection from possible malware.
Add to Builder | Version | Downloads | Last Updated | Status |
---|---|---|---|---|
CrowLeer 2.0 | 559 | Friday, December 13, 2019 | Approved | |
CrowLeer 1.8 | 207 | Tuesday, October 15, 2019 | Approved | |
CrowLeer 1.7 | 303 | Wednesday, January 16, 2019 | Approved | |
CrowLeer 1.6.1 | 273 | Friday, October 26, 2018 | Approved | |
CrowLeer 1.6 | 240 | Friday, October 26, 2018 | Approved | |
CrowLeer 1.5 | 270 | Saturday, August 25, 2018 | Approved | |
CrowLeer 1.4 | 301 | Friday, August 10, 2018 | Approved | |
CrowLeer 1.3 | 294 | Friday, May 18, 2018 | Approved | |
CrowLeer 1.2 | 292 | Friday, May 11, 2018 | Approved |
Changelog from 1.8:
* Added link relativization for offline browsing of crawled pages
* Added crawling of URLs found in "src" tags
* Changed saved files names to include querystring and anchor
This package has no dependencies.
Ground Rules:
- This discussion is only about CrowLeer and the CrowLeer package. If you have feedback for Chocolatey, please contact the Google Group.
- This discussion will carry over multiple versions. If you have a comment about a particular version, please note that in your comments.
- The maintainers of this Chocolatey Package will be notified about new comments that are posted to this Disqus thread, however, it is NOT a guarantee that you will get a response. If you do not hear back from the maintainers after posting a message below, please follow up by using the link on the left side of this page or follow this link to contact maintainers. If you still hear nothing back, please follow the package triage process.
- Tell us what you love about the package or CrowLeer, or tell us what needs improvement.
- Share your experiences with the package, or extra configuration or gotchas that you've found.
- If you use a url, the comment will be flagged for moderation until you've been whitelisted. Disqus moderated comments are approved on a weekly schedule if not sooner. It could take between 1-5 days for your comment to show up.