Downloads:
13,753
Downloads of v 3.3.6:
1,677
Last Update:
26 Jun 2023
Package Maintainer(s):
Software Author(s):
- Apache Software Foundation
Tags:
apache admin hadoop hdfs yarn cluster mapreduce namenode datanodeHadoop
- 1
- 2
- 3
3.3.6 | Updated: 26 Jun 2023
Downloads:
13,753
Downloads of v 3.3.6:
1,677
Maintainer(s):
Software Author(s):
- Apache Software Foundation
Hadoop 3.3.6
Legal Disclaimer: Neither this package nor Chocolatey Software, Inc. are affiliated with or endorsed by Apache Software Foundation. The inclusion of Apache Software Foundation trademark(s), if any, upon this webpage is solely to identify Apache Software Foundation goods or services and not for commercial purposes.
- 1
- 2
- 3
This Package Contains an Exempted Check
Not All Tests Have Passed
Deployment Method: Individual Install, Upgrade, & Uninstall
To install Hadoop, run the following command from the command line or from PowerShell:
To upgrade Hadoop, run the following command from the command line or from PowerShell:
To uninstall Hadoop, run the following command from the command line or from PowerShell:
Deployment Method:
This applies to both open source and commercial editions of Chocolatey.
1. Enter Your Internal Repository Url
(this should look similar to https://community.chocolatey.org/api/v2/)
2. Setup Your Environment
1. Ensure you are set for organizational deployment
Please see the organizational deployment guide
2. Get the package into your environment
Option 1: Cached Package (Unreliable, Requires Internet - Same As Community)-
Open Source or Commercial:
- Proxy Repository - Create a proxy nuget repository on Nexus, Artifactory Pro, or a proxy Chocolatey repository on ProGet. Point your upstream to https://community.chocolatey.org/api/v2/. Packages cache on first access automatically. Make sure your choco clients are using your proxy repository as a source and NOT the default community repository. See source command for more information.
- You can also just download the package and push it to a repository Download
-
Open Source
-
Download the package:
Download - Follow manual internalization instructions
-
-
Package Internalizer (C4B)
-
Run: (additional options)
choco download hadoop --internalize --source=https://community.chocolatey.org/api/v2/
-
For package and dependencies run:
choco push --source="'INTERNAL REPO URL'"
- Automate package internalization
-
Run: (additional options)
3. Copy Your Script
choco upgrade hadoop -y --source="'INTERNAL REPO URL'" [other options]
See options you can pass to upgrade.
See best practices for scripting.
Add this to a PowerShell script or use a Batch script with tools and in places where you are calling directly to Chocolatey. If you are integrating, keep in mind enhanced exit codes.
If you do use a PowerShell script, use the following to ensure bad exit codes are shown as failures:
choco upgrade hadoop -y --source="'INTERNAL REPO URL'"
$exitCode = $LASTEXITCODE
Write-Verbose "Exit code was $exitCode"
$validExitCodes = @(0, 1605, 1614, 1641, 3010)
if ($validExitCodes -contains $exitCode) {
Exit 0
}
Exit $exitCode
- name: Install hadoop
win_chocolatey:
name: hadoop
version: '3.3.6'
source: INTERNAL REPO URL
state: present
See docs at https://docs.ansible.com/ansible/latest/modules/win_chocolatey_module.html.
chocolatey_package 'hadoop' do
action :install
source 'INTERNAL REPO URL'
version '3.3.6'
end
See docs at https://docs.chef.io/resource_chocolatey_package.html.
cChocoPackageInstaller hadoop
{
Name = "hadoop"
Version = "3.3.6"
Source = "INTERNAL REPO URL"
}
Requires cChoco DSC Resource. See docs at https://github.com/chocolatey/cChoco.
package { 'hadoop':
ensure => '3.3.6',
provider => 'chocolatey',
source => 'INTERNAL REPO URL',
}
Requires Puppet Chocolatey Provider module. See docs at https://forge.puppet.com/puppetlabs/chocolatey.
4. If applicable - Chocolatey configuration/installation
See infrastructure management matrix for Chocolatey configuration elements and examples.
Private CDN cached downloads available for licensed customers. Never experience 404 breakages again! Learn more...
There are versions of this package awaiting moderation . See the Version History section below.
This package was approved as a trusted package on 30 Nov 2024.
The Apache Hadoop software library is a framework that allows for the distributed processing of large data sets across clusters of computers using simple programming models. It is designed to scale up from single servers to thousands of machines, each offering local computation and storage. Rather than rely on hardware to deliver high-availability, the library itself is designed to detect and handle failures at the application layer, so delivering a highly-available service on top of a cluster of computers, each of which may be prone to failures.
The project includes these modules:
- Hadoop Common: The common utilities that support the other Hadoop modules.
- Hadoop Distributed File System (HDFS™): A distributed file system that provides high-throughput access to application data.
- Hadoop YARN: A framework for job scheduling and cluster resource management.
- Hadoop MapReduce: A YARN-based system for parallel processing of large data sets.
Notes
The package sets the HADOOP_HOME environment variable and adds HADOOP_HOME\bin to the machine path.
The package by default will unzip to C:\Hadoop. This location can be changed, see below.
Package Parameters
The following package parameters can be set:
/unzipLocation
- Unzip to a different path than default.
These parameters can be passed to the installer with the use of -params
.
For example: choco install hadoop -params '"/unzipLocation:D:\Hadoop"'
.
Please Note: This is an automatically updated package. If you find it is
out of date by more than a day or two, please contact the maintainer(s) and
let them know the package is no longer updating correctly.
$hadoop_home = $env:HADOOP_HOME
# remove from Path
$path = [Environment]::GetEnvironmentVariable("Path", 'Machine')
$newPath = ($path.Split(';') | Where-Object { $_ -notmatch '.*hadoop.*' }) -join ';'
[Environment]::SetEnvironmentVariable("Path", $newPath, 'Machine')
Install-ChocolateyEnvironmentVariable `
-VariableName "HADOOP_HOME" `
-VariableValue $null `
-VariableType 'Machine'
Install-ChocolateyEnvironmentVariable `
-VariableName "JAVA_HOME" `
-VariableValue $null `
-VariableType 'User'
Remove-Item $hadoop_home -Recurse -Force
Log in or click on link to see number of positives.
- hadoop.3.3.6.nupkg (b76030dd34e9) - ## / 63
In cases where actual malware is found, the packages are subject to removal. Software sometimes has false positives. Moderators do not necessarily validate the safety of the underlying software, only that a package retrieves software from the official distribution point and/or validate embedded software against official distribution point (where distribution rights allow redistribution).
Chocolatey Pro provides runtime protection from possible malware.
Add to Builder | Version | Downloads | Last Updated | Status |
---|---|---|---|---|
Hadoop 3.4.1 | 9 | Tuesday, November 5, 2024 |
Waiting for Maintainer
|
|
Hadoop 3.3.6 | 1677 | Monday, June 26, 2023 | Approved | |
Hadoop 3.3.5 | 640 | Thursday, March 23, 2023 | Approved | |
Hadoop 3.3.4 | 578 | Monday, August 8, 2022 | Exempted | |
Hadoop 3.3.3 | 249 | Sunday, May 22, 2022 | Exempted | |
Hadoop 3.3.2 | 340 | Monday, March 7, 2022 | Exempted | |
Hadoop 3.3.1 | 543 | Wednesday, June 16, 2021 | Exempted | |
Hadoop 3.3.0 | 1185 | Friday, July 17, 2020 | Approved | |
Hadoop 3.2.1 | 1032 | Wednesday, September 25, 2019 | Approved | |
Hadoop 3.2.0 | 638 | Wednesday, January 23, 2019 | Approved | |
Hadoop 3.1.1 | 1074 | Friday, August 10, 2018 | Approved | |
Hadoop 3.1.0 | 704 | Monday, April 9, 2018 | Approved | |
Hadoop 3.0.1 | 348 | Tuesday, March 27, 2018 | Approved | |
Hadoop 3.0.0 | 559 | Friday, December 15, 2017 | Approved | |
Hadoop 2.9.0 | 1248 | Tuesday, November 21, 2017 | Approved | |
Hadoop 2.8.2 | 429 | Monday, November 6, 2017 | Approved | |
Hadoop 2.8.1 | 572 | Monday, July 24, 2017 | Approved | |
Hadoop 2.8.0 | 546 | Saturday, April 1, 2017 | Approved | |
Hadoop 2.7.3 | 817 | Monday, February 27, 2017 | Approved |
The Apache Software Foundation
-
- chocolatey-core.extension (≥ 1.1.0)
- jdk8 (≥ 8.0)
Ground Rules:
- This discussion is only about Hadoop and the Hadoop package. If you have feedback for Chocolatey, please contact the Google Group.
- This discussion will carry over multiple versions. If you have a comment about a particular version, please note that in your comments.
- The maintainers of this Chocolatey Package will be notified about new comments that are posted to this Disqus thread, however, it is NOT a guarantee that you will get a response. If you do not hear back from the maintainers after posting a message below, please follow up by using the link on the left side of this page or follow this link to contact maintainers. If you still hear nothing back, please follow the package triage process.
- Tell us what you love about the package or Hadoop, or tell us what needs improvement.
- Share your experiences with the package, or extra configuration or gotchas that you've found.
- If you use a url, the comment will be flagged for moderation until you've been whitelisted. Disqus moderated comments are approved on a weekly schedule if not sooner. It could take between 1-5 days for your comment to show up.