Wednesday, October 24, 2012
Monday, October 22, 2012
Friday, June 29, 2012
Orchestrating the Cloud : back on Content Store
This month it is back to Content Store. The content Store needs few stories to be wrapped up.
The interesting part is in these stories.
1) AWS Cloudformation :
I orchestrated the content store stack using aws cloudformation. Right from dns(route 53), Elastic load balancer, Cloud front, S3, ec2, access control,MongoDb replica set, all in < 1000 lines of code. Wow!! what powerful framework. The one think which puzzles me in this whole equation is which framework is authoritative for running script, is it the cloudinit, cfn-init or puppet . Right now I am using the hybrid approach of loading basic user-data and handing the control to cfn-init.
http://aws.amazon.com/cloudformation/aws-cloudformation-templates/
2) MongoDB Replica set:
This was another interesting story to setup mongoDB replica set.
3) EveryAuth:
Authentication and Authorization in single api,google hybrid auth :) thats cool.
Thursday, May 31, 2012
Back on Android
This month I was back on Android, I am been tasked to review the Architecture of huge Android Application which have issue with network connectivity.
Saturday, March 31, 2012
Monitoring System
This month the focus was on Monitoring System. I was looking on the over all System for preventive and Early Warning System. The first version of system was deployed to production. The teck stack is Groudworks/Nagios with function testing running in ec2.
Saturday, March 17, 2012
Monitoring System comparison & architecture
gomez:
Lookingglass
enterprisewizard (automated work flow)
xymon
bigbrother
cacti
Graphical tool.
installing cacti:
agent-less monitoring via SNMP, SSH, WMI ,Perfmon(context switches),
Windows Monitoring With WMI And Powershell
> Is RRDTool a rewrite of MRTG?
It's a rewrite of a portion of it. "Classic" MRTG has some limitations
in terms of scalability and flexibility. As it was originally designed to
count bits (or bytes) passing through an interface in two directions, it
doesn't like values less than 0, non-integer values, negative numbers,
or plotting a number of variables other then 2. Thus, using it for things
such as plotting temperature can get tricky. Also, classic MRTG draws a
new graph every interval, five minutes by default. This can impact server
performance if there are many inputs.
RRDTool (Round Robin Database Tool) allows for more flexibility in the
type of data being plotted, and also doesn't create the actual graphs
until they are requested by a web page "hit". This overcomes the limitations
of MRTG for plotting oddball or multiple values, etc. It is also more
server-friendly in terms of CPU usage provided that your graphs don't
become the Slashdot feature site and you wind up with an enormous number
of hits.
It's a rewrite of a portion of it. "Classic" MRTG has some limitations
in terms of scalability and flexibility. As it was originally designed to
count bits (or bytes) passing through an interface in two directions, it
doesn't like values less than 0, non-integer values, negative numbers,
or plotting a number of variables other then 2. Thus, using it for things
such as plotting temperature can get tricky. Also, classic MRTG draws a
new graph every interval, five minutes by default. This can impact server
performance if there are many inputs.
RRDTool (Round Robin Database Tool) allows for more flexibility in the
type of data being plotted, and also doesn't create the actual graphs
until they are requested by a web page "hit". This overcomes the limitations
of MRTG for plotting oddball or multiple values, etc. It is also more
server-friendly in terms of CPU usage provided that your graphs don't
become the Slashdot feature site and you wind up with an enormous number
of hits.
3rd Party:
finesse server:
Nagios XI:
Installation in ec2:
installing nodejs on centos
su -
yum install openssl-devel
yum install openssl-devel
yum groupinstall "Development Tools"
cd /usr/local/src
wget http://nodejs.org/dist/node-v0.4.10.tar.gz
tar zxvf node-v0.4.10.tar.gz
cd node-v0.4.10
./configure
make
make install
wget http://nodejs.org/dist/node-v0.4.10.tar.gz
tar zxvf node-v0.4.10.tar.gz
cd node-v0.4.10
./configure
make
make install
Install nodejs on groundworks VM
echo 'export PATH=$HOME/local/bin:$PATH' >> ~/.bashrc
. ~/.bashrc
mkdir ~/local
mkdir ~/node-latest-install
cd ~/node-latest-install
curl http://nodejs.org/dist/node-latest.tar.gz | tar xz --strip-components=1
./configure --prefix=~/local
make install # ok, fine, this step probably takes more than 30 seconds...
curl http://npmjs.org/install.sh | sh
Local install of nagios:
(nagios easy distribution)
Nagios docs:
How To Install Nagios 3.2.2 On Ubuntu (Under 5 Minutes Total)
http://localhost/sriramsite/omd (omdadmin/admin)
distribute monitoring
Wednesday, February 29, 2012
Thursday, February 16, 2012
Migration to AWS
Services on AWS.
After working on this for over a month on my sparse time, I finally moved 7 services to aws. It was a wonderful experience to re-architect these services. It was well received and ignited the drive to move to aws.
After working on this for over a month on my sparse time, I finally moved 7 services to aws. It was a wonderful experience to re-architect these services. It was well received and ignited the drive to move to aws.
Saturday, January 28, 2012
Performance Testing
I did performance testing of our service on aws. It's very impressive what asynchronous programming can do the performance.
Tuesday, January 3, 2012
Data Analysis Using Hadoop
I have been tasked with analyzing the huge data from Electronic Programme Guide.
Subscribe to:
Posts (Atom)