As the number of metrics in your environment grows you start to see huge impact in system IO performance. At one stage the disk utilization stays at 100% and cpu spends a lot of time waiting for IO. At this time the IO exceeds the theoratical IO supported by the disk. We might go ahead and add fast 15K disks or raid10 array. The disk contention stays as long as we keep on expanding the cluster and adding new metrics.
A simple solution would be to add the rrdcached layer in the middle. There are certain things to consider such as updating the rrdtool package and recompiling ganglia with the new rrdtool support.
Just a step by step guide of doing it.
A. Steps for building and install rrdtool and ganglia.
1. uninstall existing rrdtool
yum -y install rrdtool rrdtool-perl
2. Download latest rrdtool
wget http://apt.sw.be/redhat/el5/en/x86_64/dag/RPMS/rrdtool-1.4.7-1.el5.rf.x86_64.rpm
wget http://apt.sw.be/redhat/el5/en/x86_64/dag/RPMS/perl-rrdtool-1.4.7-1.el5.rf.x86_64.rpm
wget http://apt.sw.be/redhat/el5/en/x86_64/dag/RPMS/rrdtool-devel-1.4.7-1.el5.rf.x86_64.rpm
3. Install all three in a single go. Otherwise it will show some weird perl dependency errors.
rpm -ivh rrdtool-1.4.7-1.el5.rf.x86_64.rpm rrdtool-devel-1.4.7-1.el5.rf.x86_64.rpm perl-rrdtool-1.4.7-1.el5.rf.x86_64.rpm
4. Get the ganglia source rpm
wget http://downloads.sourceforge.net/project/ganglia/ganglia%20monitoring%20core/3.4.0/ganglia-3.4.0-1.src.rpm?r=http%3A%2F%2Fsourceforge.net%2Fprojects%2Fganglia%2Ffiles%2Fganglia%2520monitoring%2520core%2F3.4.0%2F&ts=1360839947&use_mirror=citylan
5. Install the dependencies required for building the rpm.
yum -y install libpng-devel libart_lgpl-devel python-devel libconfuse-devel pcre-devel freetype-devel
6. Build the rpm
rpm -ivh ganglia-3.4.0-1.src.rpm
rpmbuild -ba /usr/src/redhat/SPECS/ganglia.spec
7. Install the new ganglia versions
rpm -ivh /usr/src/redhat/RPMS/x86_64/ganglia-* /usr/src/redhat/RPMS/x86_64/libganglia-3.4.0-1.x86_64.rpm
B . Configuring rrdcached to work with ganglia.
1. Since gmetad runs with ganglia user and rrdcached require access to write to rrd dir and apache needs access of same directory. Add ganglia to apache group.
usermod -a -G apache ganglia
2. correct the permissions
chown -R ganglia:apache /var/lib/ganglia/rrds/
3. Update rrdcached sysconfig startup options.
cat /etc/sysconfig/rrdcached
OPTIONS="rrdcached -p /tmp/rrdcached.pid -s apache -m 664 -l unix:/tmp/rrdcached.sock -s apache -m 777 -P FLUSH,STATS,HELP -l unix:/tmp/rrdcached.limited.sock -b /var/lib/ganglia/rrds -B"
RRDC_USER=ganglia
cat /etc/sysconfig/gmetad
RRDCACHED_ADDRESS="unix:/tmp/rrdcached.sock"
grep rrdcached_socket /var/www/html/gweb/conf_default.php$conf['rrdcached_socket'] = "/tmp/rrdcached.sock";
service gmetad stop
service rrdcached start
service gmetad start
Your Java blog has explained the concepts clearly with suitable examples. Many programming languages have evolved but Java is still in NO:1 position due to its great features.
ReplyDeleteRegards:
Java Training |
JAVA Training Institutes in Chennai
Great Article. Thank you for sharing! Really an awesome post for every one.
DeleteCOOC Visual Exploration of Co Occurrence Mobility Patterns in Urban Scenarios Project For CSE
Data Prefetching and Eviction Mechanisms of In memory Storage Systems Based on Scheduling for Big Data Processing Project For CSE
Dosage Prediction in Pediatric Medication Leveraging Prescription Big Data Project For CSE
LSTM and Edge Computing for Big Data Feature Recognition of Industrial Electrical Equipment Project For CSE
Maximum Data resolution Efficiency for Fog Computing Supported Spatial Big Data Processing in Disaster Scenarios Project For CSE
Thanks for sharing informative article on Salesforce technology. Your article helped me a lot to understand the career prospects in cloud computing technology. Salesforce Training in Chennai | Salesforce Training Institutes in Chennai
ReplyDeleteGood post and I like it very much. By the way, anybody try this app development company for iOS and Android? I find it is so professional to help me boost app ranking and increase app downloads.
ReplyDeleteExcellent post!!! In this competitive market, customer relationship management plays a significant role in determining a business success. That too, cloud based CRM product offer more flexibility to business owners to main strong relationship with the consumers.
ReplyDeleteCloud computing courses in Chennai|Cloud computing Training in Chennai
nice..
ReplyDeleteinternship for bba students
internship certificate for cse students
internship training in chennai
internships in hyderabad for cse students 2020
r training in chennai
robotics course
internship for ece students in core companies
internship for aeronautical engineering students in bangalore
internship for cse students in bangalore 2019
industrial visits for college students in chennai
good.
ReplyDeletehow to hack chromebook using crosh
hack tp link wifi username and password
brac ngo written test question
whatsapp ethical hacking
react js developer resume india
integer max value javascript
binatone wifi hack
a certain sum of money amounts to rs.1300 in 2 years and to rs. 1525 in 3.5 years. find the sum and the rate of interest
she spent most of her time tomusic
she most of her time tomusic
excellent...!!!
ReplyDeleteSelenium training in chennai
Industrial visit in chennai
Internship
Internships in bangalore for cse students 2019
Free internship in chennai for cse students
Network security projects for cse
Ccna course in chennai
Inplant training in chennai for cse
Inplant training for eee students
Kaashiv infotech chennai
Nice blog!!!
ReplyDeleteInternships in pune for computer science students
Internships in pune for computer science students
Inplant training certificate format
Internships in bangalore for ece students
Industrial training for electronics and communication engineering students
Internship for computer science students in bangalore
Internship for ece students
Mba internship in chennai
Inplant training in chennai for ece
Internship in nagpur for cse
FANTASTIC!!!
ReplyDeleteRobotics training in chennai
Internship for cse students in chennai
Iot internship in chennai
Kaashiv infotech in bangalore
Free internship in chennai for mechanical engineering students
Inplant training
Ece internship in chennai
Internship for cse students in bangalore
Free internship for cse students in chennai
Internship for eee students in chennai