수안이의 컴퓨터 연구실

ASCII 문서나 코드를 살펴보면 CRLF가 포함된 경우가 있다.

포함되는 이유에 대해서는 다음 문서를 참조

http://en.wikipedia.org/wiki/Newline

제거하는 방법도 위 사이트에 게시되어 있지만,

다음과 같은 방법으로 간단히 제거하면 된다.

CR=13(dec)=15(oct) 제거 방법

tr -d '\015' < infile.txt > outfile.txt

LF=NL=10(dec)=12(oct) 제거 방법

tr -d '\012' < infile.txt > outfile.txt

CRLF 제거 방법

tr -d '\015\012' < infile.txt > outfile.txt

"System" 카테고리의 다른 글

ASCII Code의 CRLF 제거 방법 (0)2009/09/04
Linux / Unix Command: signal (0)2007/07/18
시스템 관리자를 위한 기초 명령어 활용법 (0)2007/06/22
프로세스정보 얻어오기 (0)2007/05/14
여러 가지 설정으로 공격으로부터 시스템을 안전하... (0)2007/05/10

기본적으로 Hadoop에서 C++ API 예제를 돌려보려면 다음 사이트를 참고하면 된다.

http://wiki.apache.org/hadoop/C++WordCount

이 에제에서 다음과 같은 명령어를 사용한다.

ant -Dcompile.c++=yes examples

만약 ant 명령어 자체에서 에러가 발생하면, ant를 설치해주어야 한다.

sudo apt-get install ant

그 외에 퍼미션부터 시작해서 애러가 연속해서 일어난다.

more..

Buildfile: build.xml

clover.setup:

clover.info:
   [echo]
   [echo]    Clover not found. Code coverage reports disabled.
   [echo]

clover:

ivy-download:
[get] Getting: http://repo2.maven.org/maven2/org/apach ··· -rc2.jar
[get] To: /usr/local/hadoop/ivy/ivy-2.0.0-rc2.jar
[get] Not modified - so not downloaded

ivy-init-dirs:

ivy-probe-antlib:

ivy-init-antlib:

ivy-init:
[ivy:configure] :: Ivy 2.0.0-rc2 - 20081028224207 :: http://ant.apache.org/ivy/ ::
:: loading settings :: file = /usr/local/hadoop/ivy/ivysettings.xml

ivy-resolve-common:
[ivy:resolve] :: resolving dependencies :: org.apache.hadoop#Hadoop;working@blade01.kangwon.ac.kr
[ivy:resolve] confs: [common]
[ivy:resolve] found commons-logging#commons-logging;1.0.4 in maven2
[ivy:resolve] found log4j#log4j;1.2.15 in maven2
[ivy:resolve] found commons-httpclient#commons-httpclient;3.0.1 in maven2
[ivy:resolve] found commons-codec#commons-codec;1.3 in maven2
[ivy:resolve] found xmlenc#xmlenc;0.52 in maven2
[ivy:resolve] found net.java.dev.jets3t#jets3t;0.6.1 in maven2
[ivy:resolve] found commons-net#commons-net;1.4.1 in maven2
[ivy:resolve] found org.mortbay.jetty#servlet-api-2.5;6.1.14 in maven2
[ivy:resolve] found oro#oro;2.0.8 in maven2
[ivy:resolve] found org.mortbay.jetty#jetty;6.1.14 in maven2
[ivy:resolve] found org.mortbay.jetty#jetty-util;6.1.14 in maven2
[ivy:resolve] found tomcat#jasper-runtime;5.5.12 in maven2
[ivy:resolve] found tomcat#jasper-compiler;5.5.12 in maven2
[ivy:resolve] found commons-el#commons-el;1.0 in maven2
[ivy:resolve] found junit#junit;3.8.1 in maven2
[ivy:resolve] found commons-logging#commons-logging-api;1.0.4 in maven2
[ivy:resolve] found org.slf4j#slf4j-api;1.4.3 in maven2
[ivy:resolve] found org.eclipse.jdt#core;3.1.1 in maven2
[ivy:resolve] found org.slf4j#slf4j-log4j12;1.4.3 in maven2
[ivy:resolve] :: resolution report :: resolve 619ms :: artifacts dl 22ms
---------------------------------------------------------------------
| | modules || artifacts |
| conf | number| search|dwnlded|evicted|| number|dwnlded|
---------------------------------------------------------------------
| common | 19 | 0 | 0 | 0 || 19 | 0 |
---------------------------------------------------------------------

ivy-retrieve-common:
[ivy:retrieve] :: retrieving :: org.apache.hadoop#Hadoop
[ivy:retrieve] confs: [common]
[ivy:retrieve] 0 artifacts copied, 19 already retrieved (0kB/20ms)
No ivy:settings found for the default reference 'ivy.instance'. A default instance will be used
DEPRECATED: 'ivy.conf.file' is deprecated, use 'ivy.settings.file' instead
:: loading settings :: file = /usr/local/hadoop/ivy/ivysettings.xml

init:
[touch] Creating /tmp/null736510671
   [delete] Deleting: /tmp/null736510671
   [exec] src/saveVersion.sh: 34: svn: not found
   [exec] src/saveVersion.sh: 34: svn: not found

record-parser:

compile-rcc-compiler:

compile-core-classes:
[javac] Compiling 1 source file to /usr/local/hadoop/build/classes

compile-mapred-classes:
[javac] Compiling 1 source file to /usr/local/hadoop/build/classes

compile-hdfs-classes:
[javac] Compiling 4 source files to /usr/local/hadoop/build/classes

compile-core-native:

check-c++-makefiles:

create-c++-pipes-makefile:

BUILD FAILED
/usr/local/hadoop/build.xml:1414: Execute failed: java.io.IOException: Cannot run program "/usr/local/hadoop/src/c++/pipes/configure" (in directory "/usr/local/hadoop/build/c++-build/Linux-i386-32/pipes"): java.io.IOException: error=13, Permission denied

Total time: 4 seconds

위와 같은 에러가 발생 할 시 다음과 같은 순서로 해결을 하면 된다.

chmod 755 /usr/local/hadoop/src/c++/pipes/configure

chmod 755 /usr/local/hadoop/src/c++/utils/configure

두 명령어를 통해 퍼미션을 해결하였어도, utils 폴더 내에 컴파일 과정에서 에러가 발생한다면,

wget https://issues.apache.org/jira/secure/attachment/12404588/HADOOP-5611-fixed.patch

위 명령어를 통해 패치를 다운로드 한 뒤,

patch -p0 < HADOOP-5611-fixed.patch

위와 같이 패치를 하고, 다음 명령을 다시 한번 시도한다.

ant -Dcompile.c++=yes examples

"Hadoop" 카테고리의 다른 글