joy/Hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

新增 Hadoop_Install_Guide.md

Browse Source 
Signed-off-by: joy <joy224961632@gmail.com>
This commit is contained in:
joy 2026-04-14 18:08:13 +09:00
parent ae24818f5a
commit b0b93538eb
1 changed files with 74 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

74
Hadoop_Install_Guide.md Normal file
View File

@ -0,0 +1,74 @@
# Hadoop Install Guide
## Prerequirement
OS: Linux
Memory: 4G
## package requirement
Hadoop require `openssh-server`, `ssh`, `pdsh`
```sh
$apt update
$apt install openssh-server ssh pdsh -y
```
## Java prepare
Download `java` from [Orcale](https://www.oracle.com/tw/java/technologies/downloads/#java21) [direct link](https://download.oracle.com/java/21/latest/jdk-21_linux-x64_bin.deb)
```sh
wget https://download.oracle.com/java/21/latest/jdk-21_linux-x64_bin.deb
sudo dpkg -i jdk-21_linux-x64_bin.deb
```
## Hadoop prepare
Download `Hadoop` [here](https://hadoop.apache.org/releases.html) [direct link](https://www.apache.org/dyn/closer.cgi/hadoop/common/hadoop-3.5.0/hadoop-3.5.0.tar.gz)
```sh
wget https://www.apache.org/dyn/closer.cgi/hadoop/common/hadoop-3.5.0/hadoop-3.5.0.tar.gz
tar -zxvf hadoop-3.5.0.tar.gz
```
## Configure Hadoop
```sh
cd hadoop-3.5.0
export JAVA_HOME=/usre/java/jdk-21-orcale-x64
```
## Configure remote ssh access
Connect to server first
```sh
ssh localhost
```
Generate ssh key
Configure Hadoop environment
```xml
# hadoop-3.5.0/etc/hadoop/core-site.xml
<configuration>
<property>
<name>fs.defaultFS</name>
<value>hdfs://localhost:9000</value>
</property>
</configuration>
```
```xml
# hadoop-3.5.0/etc/hadoop/hdfs-site.xml
<configuration>
<property>
<name>dfs.replication</name>
<value>1</value>
</property>
</configuration>
```