Install liblzo
- On Redhat based systems
sudo yum install liblzo-devel
- On Debian based systems
sudo apt-get install liblzo2-dev
Clone the hadoop-lzo from github
$ git clone https://github.com/twitter/hadoop-lzo.git
$ cd hadoop-lzo
$ mvn clean package
Place the hadoop-lzo-*.jar somewhere on your cluste classpath
$ cp hadoop-lzo/target/hadoop-lzo-0.4.20-SNAPSHOT.jar /data/lib/
Place the native hadoop-lzo binaries in hadoop native directory
$ cp hadoop-lzo/target/native/Linux-amd64-64/lib/* $HADOOP_HOME/lib/native/hadoop-lzo/
Add the following to your core-site.xml
:
<property>
<name>io.compression.codecs</name>
<value>
org.apache.hadoop.io.compress.GzipCodec,
org.apache.hadoop.io.compress.DefaultCodec,
org.apache.hadoop.io.compress.BZip2Codec,
com.hadoop.compression.lzo.LzoCodec,
com.hadoop.compression.lzo.LzopCodec
</value>
</property>
<property>
<name>io.compression.codec.lzo.class</name>
<value>com.hadoop.compression.lzo.LzoCodec</value>
</property>
Add the following to your mapred-site.xml
:
<property>
<name>mapred.child.env</name>
<value>JAVA_LIBRARY_PATH=$HADOOP_HOME/lib/native/hadoop-lzo/</value>
</property>
<property>
<name>mapred.map.output.compression.codec</name>
<value>com.hadoop.compression.lzo.LzoCodec</value>
</property>
References:
- http://www.cloudera.com/content/cloudera-content/cloudera-docs/CDH5/latest/CDH5-Installation-Guide/cdh5ig_yarn_cluster_deploy.html
- http://raseshmori.wordpress.com/2012/10/14/install-hadoop-nextgen-yarn-multi-node-cluster/
- https://www.digitalocean.com/community/articles/how-to-install-hadoop-on-ubuntu-13-10
- http://www.cloudera.com/content/cloudera-content/cloudera-docs/CDH5/latest/CDH5-Installation-Guide/cdh5ig_mapreduce_to_yarn_migrate.html
38 comments
Fortunately, Apache Hadoop is a tailor-made solution that delivers on both counts, by turning big data insights into actionable business enhancements for long-term success. To know more, visit Hadoop Training Bangalore
I think this is the best blog I have been through all this day.
Hadoop Training in Chennai
RS Trainings offers hadoop training in india by real-time experts
thx for sharing info
Hadoop Training in india
Online Hadoop Training in India
Rs training offeredhadoop online training in hyderabad
Nice and good article. It is very useful for me to learn and understand easily. Thanks for sharing your valuable information and time. Please keep updating Hadoop Admin Online Training Bangalore
I am really admired for the great info is visible in this blog that to lot of benefits for visiting the nice info in this website.
Thanks a lot for using the nice info is visible in this blog.
Digital Marketing Training in Chennai
I am really admired for the great info is visible in this blog that to lot of benefits for visiting the nice info in this website.
Thanks a lot for using the nice info is visible in this blog.latestITjobs
Hadoop Training in Chennai
Thanks for sharing this informative post! Keep us updated with more such posts.
Tally Course in Chennai
Tally Classes in Chennai
Oracle DBA Training in Chennai
Unix Training in Chennai
Embedded System Course Chennai
IoT Training in Chennai
Ionic Training in Chennai
Nice post. It is very useful and informative post.
CEH Training In Hyderbad
Nice and good article. It is very useful for me to learn and understand easily. Thanks for sharing your valuable information and time. Please keep updating Big data training
better info provided thank u for sharing oracle training in chennai
This is a nice post in an interesting line of content.Thanks for sharing this article, great way of bring this topic to discussion.
oracle training in chennai
oracle training in tambaram
oracle dba training in chennai
oracle dba training in tambaram
ccna training in chennai
ccna training in tambaram
seo training in chennai
seo training in tambaram
I see these days do not really provide anything that attracts others, but believe me the way you interact is literally awesome.You can also check my articles as well.
sap training in chennai
sap training in annanagar
azure training in chennai
azure training in annanagar
cyber security course in chennai
cyber security course in annanagar
ethical hacking course in chennai
ethical hacking course in annanagar
Excellent and very cool idea and the subject at the top of magnificence and I am happy to this post..Interesting post!
java training in chennai
java training in omr
aws training in chennai
aws training in omr
python training in chennai
python training in omr
selenium training in chennai
selenium training in omr
Thanks for the information about Blogspot very informative for everyone.
digital marketing training in Ameerpet
You should be a piece of a challenge for probably the best website on the web. I will suggest this site
best interiors
Thanks for the information about Blogspot very informative for everyone.
https://digitalbadi.com/digital-marketing-course-in-hyderabad/
https://digitalbadi.com/digital-marketing-course-in-telugu/
https://digitalbadi.com/wordpress-training-in-hyderabad/
https://digitalbadi.com/video-editing-course-in-hyderabad/
https://digitalbadi.com/seo-training-in-hyderabad/
Kocaeli
Denizli
Bartın
Kocaeli
Adana
NRTVQ4
elazığ
erzincan
bayburt
tunceli
sakarya
LCY
tekirdağ
tokat
elazığ
adıyaman
çankırı
TPDH
görüntülü.show
whatsapp ücretli show
7ARCZP
ankara parça eşya taşıma
takipçi satın al
antalya rent a car
antalya rent a car
ankara parça eşya taşıma
1DR
24C9C
Tekirdağ Parça Eşya Taşıma
Amasya Evden Eve Nakliyat
Muş Evden Eve Nakliyat
Erzincan Evden Eve Nakliyat
Niğde Lojistik
81943
Konya Lojistik
Van Evden Eve Nakliyat
Ağrı Lojistik
Bitlis Lojistik
Denizli Parça Eşya Taşıma
C1237
Ardahan Lojistik
Burdur Şehirler Arası Nakliyat
Çerkezköy Marangoz
Çerkezköy Sineklik
Mardin Lojistik
Karabük Parça Eşya Taşıma
Kayseri Şehirler Arası Nakliyat
Yalova Evden Eve Nakliyat
Silivri Duşa Kabin Tamiri
28662
Kırklareli Evden Eve Nakliyat
buy boldenone
Kars Evden Eve Nakliyat
Kalıcı Makyaj
Bartın Evden Eve Nakliyat
Sakarya Evden Eve Nakliyat
Btcturk Güvenilir mi
testosterone enanthate
Muş Evden Eve Nakliyat
20040
Osmaniye Evden Eve Nakliyat
Çerkezköy Marangoz
Shinja Coin Hangi Borsada
Adana Lojistik
Denizli Lojistik
Satoshi Coin Hangi Borsada
Çerkezköy Sineklik
Konya Şehir İçi Nakliyat
Bartın Şehir İçi Nakliyat
853BE
Hakkari Şehirler Arası Nakliyat
Çanakkale Lojistik
Karabük Şehirler Arası Nakliyat
Aydın Evden Eve Nakliyat
Niğde Şehir İçi Nakliyat
Erzincan Evden Eve Nakliyat
Mercatox Güvenilir mi
Zonguldak Parça Eşya Taşıma
Çorum Parça Eşya Taşıma
EE20C
%20 komisyon indirimi
2C097
Sinop Bedava Sohbet
Afyon Canli Sohbet
kastamonu kızlarla canlı sohbet
canlı görüntülü sohbet siteleri
rize bedava sohbet uygulamaları
bedava görüntülü sohbet sitesi
Denizli Canlı Sohbet Sitesi
yozgat bedava sohbet
en iyi ücretsiz görüntülü sohbet siteleri
6E9F2
balıkesir rastgele sohbet odaları
elazığ bedava sohbet
ardahan seslı sohbet sıtelerı
mardin ücretsiz sohbet uygulamaları
balıkesir mobil sohbet sitesi
ığdır Yabancı Görüntülü Sohbet
amasya canlı sohbet odaları
Antalya Görüntülü Sohbet Siteleri
çorum canlı sohbet sitesi
D2250
Flare Coin Hangi Borsada
Mexc Borsası Kimin
Bitcoin Nasıl Alınır
Binance Kimin
Hexa Coin Hangi Borsada
Binance Hesap Açma
Kwai Beğeni Hilesi
Soundcloud Takipçi Hilesi
Binance Referans Kodu
DAE6F
sushiswap
poocoin
satoshivm
bscpad
uwulend finance
pancakeswap
thorchain
eigenlayer
dexscreener
8EEC6BC106
takipçi fiyat
519353394D
gerçek türk takipçi instagram
C16CB7B6F7
tiktok takipci satin al