1. 鲍亮给的报告

有点罗列的嫌疑，可读性太差
Hadoop源代码分析报告.pdf

2. 设计理念相关

Hadoop分布式文件系统：架构和设计
https://hadoop.apache.org/docs/r2.7.1/hadoop-project-dist/hadoop-common/filesystem/

3. WindowsProblems

Skip to end of metadataGo to start of metadata

  • 由 ASF Infrabot创建于七月 09, 2019

    4. Problems running Hadoop on Windows

    Hadoop requires native libraries on Windows to work properly -that includes to access the file:// filesystem, where Hadoop uses some Windows APIs to implement posix-like file access permissions.
    This is implemented in HADOOP.DLL and WINUTILS.EXE.
    In particular, %HADOOP_HOME%\BIN\WINUTILS.EXE must be locatable.
    If it is not, Hadoop or an application built on top of Hadoop will fail.

    How to fix a missing WINUTILS.EXE

    You can fix this problem in two ways
  1. Install a full native windows Hadoop version. The ASF does not currently (September 2015) release such a version; releases are available externally.
  2. Or: get the WINUTILS.EXE binary from a Hadoop redistribution. There is a repository of this for some Hadoop versions on github.

Then

  1. Set the environment variable %HADOOP_HOME% to point to the directory above the BIN dir containing WINUTILS.EXE.
  2. Or: run the Java process with the system property hadoop.home.dir set to the home directory.


    5. image.png