Big Data - Part 5 - AWS Athena

Athena

https://www.youtube.com/watch?v=ihVI-MZ6xR0
https://aws.amazon.com/blogs/big-data/analyzing-data-in-s3-using-amazon-athena/
https://shinesolutions.com/2016/12/09/will-athena-slay-bigquery/


Presto

https://en.wikipedia.org/wiki/Presto_(SQL_query_engine)
https://aws.amazon.com/emr/details/presto/
https://prestodb.io/docs/current/index.html

Athena Tutorial

https://medium.com/@robwitoff/athena-alb-log-analysis-b874d0958909#.jb7rj9smk


PARQUET

https://www.mapr.com/blog/how-convert-csv-file-apache-parquet-using-apache-drill

AWS Athena - ELB Log Analaysis

Thoughts

Able to get working Athena on our production logs.

No more ELK Stack, Hadoop , Map reduce, Big Query.


Create database apilogs2

CREATE EXTERNAL TABLE IF NOT EXISTS apilogs2.elb_logs_raw_native (
  request_timestamp string,
  elb_name string,
  request_ip string,
  request_port int,
  backend_ip string,
  backend_port int,
  request_processing_time double,
  backend_processing_time double,
  client_response_time double,
  elb_response_code string,
  backend_response_code string,
  received_bytes bigint,
  sent_bytes bigint,
  request_verb string,
  url string,
  protocol string,
  user_agent string,
  ssl_cipher string,
  ssl_protocol string )
ROW FORMAT SERDE 'org.apache.hadoop.hive.serde2.RegexSerDe'

WITH SERDEPROPERTIES (
         'serialization.format' = '1','input.regex' = '([^ ]*) ([^ ]*) ([^ ]*):([0-9]*) ([^ ]*):([0-9]*) ([.0-9]*) ([.0-9]*) ([.0-9]*) (-|[0-9]*) (-|[0-9]*) ([-0-9]*) ([-0-9]*) \\\"([^ ]*) ([^ ]*) (- |[^ ]*)\\\" (\"[^\"]*\") ([A-Z0-9-]+) ([A-Za-z0-9.-]*)$' )

LOCATION 's3://....';


SELECT * FROM apilogs2.elb_logs_raw_native WHERE elb_response_code = '200' LIMIT 100;


SELECT * FROM apilogs2.elb_logs_raw_native WHERE elb_response_code = '200' and url like '%serialNumber%' LIMIT 100;


SELECT * FROM apilogs2.elb_logs_raw_native WHERE elb_response_code = '200'
and url like '%serialNumber%'
and user_agent like '%ok%' LIMIT 100; --18

Big Data - Part 4

http://www.slideshare.net/AmazonWebServices/bdt310-big-data-architectural-patterns-and-best-practices-on-aws

Server less Architecture 

https://docs.aws.amazon.com/athena/latest/ug/json.html

https://medium.com/@pahud/kinesis-firehose-put-record-with-cli-e835a6e6ffe2#.j5t0okqux

http://aws.mannem.me/?p=1152

SnowPlow

http://snowplowanalytics.com/blog/2014/05/13/introducing-schemaver-for-semantic-versioning-of-schemas/

https://github.com/snowplow/snowplow

https://github.com/snowplow/snowplow/wiki/Setting-up-the-Cloudfront-collector

https://github.com/snowplow/snowplow/wiki/snowplow-tracker-protocol

http://www.slideshare.net/robkingston/a-taste-of-snowplow-analytics-data

Aws Lamda & Gateway

https://abhishek-tiwari.com/post/aws-lambda-and-endless-serverless-possibilities

https://gist.github.com/markusklems/1e7218d76d7583f1f7b3
https://claudiajs.com/tutorials/index.html


https://www.youtube.com/channel/UClLLJjpSWRRa1BosQrNVDjA

Completed Serverless Architecture course

https://www.udemy.com/serverless-architecture-on-aws/learn/v4/overview

AWS Lamda Deep Dive - Wrapping up the Course

https://linuxacademy.com/cp/coursescheduler/view/id/36121

fonts

http://www.fontlab.com/fontlab-pad/

https://creativemarket.com/blog/whats-the-difference-between-leading-kerning-and-tracking

http://old.fontlab.com/content/blogcategory/40/364/

https://www.youtube.com/watch?v=csCjP63IuSs&feature=share

http://www.1001fonts.com/web-fonts.html

https://superdevresources.com/create-font-from-handwriting/

https://bond.co/

https://github.com/dok/awesome-text-editing

https://helpx.adobe.com/animate/using/text-layout-framework-tlf-text.html

Text Layout Framework Technology Center

https://helpx.adobe.com/animate/using/text-layout-framework-tlf-text.html

http://www.adobe.com/devnet-apps/tlf/demo/

http://www.adobe.com/devnet/tlf.html

https://www.cocoanetics.com/2012/02/dtrichtexteditor-dtcoretext-news/

https://www.objc.io/issues/5-ios7/getting-to-know-textkit/

https://www.raywenderlich.com/4147/core-text-tutorial-for-ios-making-a-magazine-app

https://www.youtube.com/watch?v=RAsd8DzgtO0

https://www.youtube.com/watch?v=JeJZPAOFsJc

https://www.youtube.com/watch?v=YrLRku_zzIY

https://www.youtube.com/watch?v=YrLRku_zzIY

Publish Subscribe

https://www.pubnub.com/blog/2014-08-21-amazon-sns-pubnub-differences-pubsub/

Conversely, PubNub supports an unlimited number of PubNub channels. This allows every end-user device to have its own channel for one-to-one connectivity.

https://www.quora.com/What-are-the-competitive-advantages-of-Pusher-vs-PubNub

https://pusher.com

https://www.pubnub.com/

http://www.slant.co/versus/16339/2487/~greenhouse-ci_vs_phpci

SQL Server

SQL Server Data File, Log File

http://blog.sqlauthority.com/2013/08/14/sql-server-sql-basics-database-datafiles-and-logfiles-day-8-of-10/

Search

http://www.nextopia.com/

https://swiftype.com/pricing

SQL Server Licensing

http://ark.intel.com/products/84683/Intel-Xeon-Processor-E7-8880-v3-45M-Cache-2_30-GHz

https://sqlserverperformance.wordpress.com/2010/10/09/what-are-physical-sockets-physical-cores-and-logical-cores-and-why-does-it-matter/

windows Memory Usage

https://prashantd.wordpress.com/2013/11/14/solved-high-memory-usage-by-metafile-on-windows-2008-r2/

https://channel9.msdn.com/Events/TechEd/NorthAmerica/2011/WCL405

http://superuser.com/questions/437918/how-do-i-find-whats-eating-up-all-of-my-systems-memory-not-superfetch

Redis

https://github.com/MSOpenTech/Redis

https://github.com/StackExchange/StackExchange.Redis

http://objectrocket.com/blog/how-to/10-quick-tips-about-redis/

https://gist.github.com/JonCole/925630df72be1351b21440625ff2671f

http://www.slideshare.net/noahd1/redis-in-practice



Redis on Windows

https://github.com/MicrosoftArchive/redis/releases

SQL Server Maintenance & Trouble Shooting

https://ola.hallengren.com/

http://sqlblog.com/blogs/adam_machanic/archive/2016/01/04/sqlquerystress-the-source-code.aspx

https://www.brentozar.com/archive/2010/09/sql-server-dba-scripts-how-to-find-slow-sql-server-queries/

EXEC sp_WhoIsActive


http://www.solarwinds.com/
http://www.solarwinds.com/aws-dpa

installed solarwinds for mysql




https://www.mssqltips.com/sqlservertip/2730/sql-query-stress-tool/

Elastic Search

http://siddhumehta.blogspot.com/2014/05/elasticsearch-tutorial-elasticsearch-gui-tools.html

https://www.elastic.co/

https://aws.amazon.com/elasticsearch-service/


https://github.com/fullscale/elastic.js/

https://github.com/danpaz/bodybuilder

https://www.elastic.co/blog/found-sense-a-cool-json-aware-interface-to-elasticsearch

https://github.com/KunihikoKido/atom-elasticsearch-client


https://www.elastic.co/guide/en/elasticsearch/plugins/2.4/cloud-aws-best-practices.html

http://appbaseio.github.io/dejaVu/

http://appbaseio.github.io/mirage/

https://github.com/ozlerhakan/mongolastic


https://www.elastic.co/guide/en/elasticsearch/plugins/2.4/integrations.html

http://stackoverflow.com/questions/37413901/which-javascript-node-module-is-best-for-elastic-search-query-dsl

https://www.elastic.co/guide/en/elasticsearch/client/javascript-api/current/api-reference.html

searchedit

client.search([params, [callback]])

Return documents matching a query, aggregations/facets, highlighted snippets, suggestions, and more. Write your queries as either simple query strings in the q parameter, or by specifying a full request definition using the Elasticsearch Query DSL in the body parameter.

elastic.js, esq, or bodybuilder can be used to make building query bodies easier.

The default method is POST and the usual params and return values apply. See the elasticsearch docs for more about this method.

No More redis cli

https://www.redsmin.com/
https://redsmin.uservoice.com/knowledgebase/articles/734646-amazon-redis-elasticache-and-redsmin

Big Data - Part3

https://www.quora.com/What-can-you-do-with-Amazon-Kinesis

https://www.dominodatalab.com/

https://aws.amazon.com/blogs/aws/all-your-data-fluentd/

http://www.fluentd.org/guides/recipes/elasticsearch-and-s3

https://www.quora.com/Which-is-better-Cloud-Data-Science-Platform-or-dominodatalab-com-Are-there-any-other-platforms-that-I-should-consider

http://logz.io/blog/fluentd-logstash/

Fluentd

http://www.slideshare.net/treasure-data/the-basics-of-fluentd

http://docs.fluentd.org/articles/kinesis-stream
http://www.slideshare.net/sonots/fluentd-hacking-guide-at-rubykaigi-20140920?next_slideshow=1
http://www.slideshare.net/treasure-data/fluentd-loves-mongodb-at-mongosv-july172012/39-Fluentd_Plugin_forTuesday_July_17
http://www.slideshare.net/tamuraaa/life-of-an-fluentd-event?qid=31ec332f-bc6b-4940-bdf2-fa9b5b04ae22&v=&b=&from_search=11

https://www.quora.com/Which-is-better-Cloud-Data-Science-Platform-or-dominodatalab-com-Are-there-any-other-platforms-that-I-should-consider

https://www.dominodatalab.com/resource/data-science-experiments#

http://searchengineland.com/google-data-studio-258871

http://www.iacquire.com/blog/15-google-analytics-alternatives



Event Tracking:


https://mixpanel.com/help/reference/tracking-an-event
https://firebase.google.com/docs/analytics/ios/events
https://www.quora.com/Were-considering-using-Mixpanel-as-an-analytics-platform-for-our-new-app-Someone-has-recommended-we-use-Firebase-instead-Are-they-comparable

https://blog.treasuredata.com/blog/2016/03/09/evaluating-analytics-saas-raw-data-access-capabilities/


BigQuery

https://www.youtube.com/watch?v=D-YrpJkuGqE

https://www.thinkful.com/learn/google-bigquery-tutorial/#Exploring-GitHub-Data



https://www.safaribooksonline.com/library/view/the-deep-learning/9781491965115/video246708.html


9 Data Platform

http://www.confluent.io/
http://www.h2o.ai/
http://www.atscale.com/
https://algorithmia.com/
https://www.bedrockdata.com/product/overview
https://rjmetrics.com/product



http://my-netdata.io/


---


https://obviate.io/2015/08/05/tutorial-aws-api-gateway-to-lambda-to-dynamodb/
http://www.davekonopka.com/2016/serverless-aws-lambda-api-gateway.html


https://www.datawire.io/3-reasons-aws-lambda-not-ready-prime-time/



Tutorials:

https://www.quora.com/Can-we-become-data-scientist-by-going-through-online-tutorials

User Feedback tool

http://stackoverflow.com/questions/4912092/using-html5-canvas-javascript-to-take-screenshots/6678156#6678156


user snap

http://www.smartinsights.com/goal-setting-evaluation/customer-feedback/website-feedback-tools-review/

SQL Server Performance

https://app.pluralsight.com/library/courses/sql-server-performance-every-developer-should-know/table-of-contents

Image Resize CDN

https://news.ycombinator.com/item?id=10145502

https://docs.imgix.com/

Rest Api Testing

https://www.quora.com/What-is-the-best-platform-tools-for-testing-a-REST-API

https://www.slant.co/topics/2615/~javascript-client-side-error-logging-services


https://www.slant.co/topics/978/~books-to-read-on-user-experience-and-design

Elastic Search

https://www.youtube.com/watch?v=52G5ZzE0XpY#t=1471

https://www.timroes.de/2015/02/07/kibana-4-tutorial-part-1-introduction/

NewRelic

1. Integrated Newrelic on tech stack 
2. 
   

Load Testing

Using this

https://chrome.google.com/webstore/detail/restful-stress/lljgneahfmgjmpglpbhmkangancgdgeb?hl=en]

https://loadimpact.com/

https://www.blitz.io/login

https://loader.io/

http://alternativeto.net/software/blitz-io/


https://www.slant.co/topics/138/~load-testing-services

http://stackshare.io/load-and-performance-testing

Lauch App from Browser

https://msdn.microsoft.com/subscriptions/json/GetDownloadRequest?brand=MSDN&locale=en-us&fileId=69105&activexDisabled=true&akamaiDL=false


http://stackoverflow.com/questions/916925/how-to-launch-an-exe-from-web-page-asp-net

Magento Cloud

Reference

https://www.digitalocean.com/community/tutorials/how-to-install-linux-apache-mysql-php-lamp-stack-on-ubuntu-14-04

1. install 2 vm ubuntu 14 LTS (https://www.digitalocean.com/community/tutorials/how-to-install-and-configure-magento-on-ubuntu-14-04)
1. web open port 80 & 22
2. db : open port 22 & 3306
2. web :  (reference https://www.digitalocean.com/community/tutorials/how-to-install-linux-apache-mysql-php-lamp-stack-on-ubuntu-14-04)
1. sudo apt-get update
2. sudo apt-get install apache2 (apache/2.4.7)
3. sudo apt-get install php5 libapache2-mod-php5 php5-mcrypt
4. sudo nano /etc/apache2/mods-enabled/dir.conf
5. sudo service apache2 restart
6. sudo apt-get install php5-cli
7. sudo nano /etc/apache2/sites-available/magento.conf
8. sudo a2ensite magento.conf
9. sudo a2dissite 000-default.conf
10. sudo apt-get install libcurl3 php5-curl php5-gd php5-mcrypt
11. sudo a2enmod rewrite
12. sudo php5enmod mcrypt
13. cd ~ && wget http://www.magentocommerce.com/downloads/assets/1.9.0.1/magento-1.9.0.1.tar.gz
14. tar xzvf magento-1.9.0.1.tar.gz
15. sudo rsync -avP ~/magento/. /var/www/html/
16. sudo chown -R www-data:www-data /var/www/html/
17. sudo apt-get install mysql-client
18. apt-get install php5-mysql

3. db :
1. sudo apt-get update
2. sudo apt-get install mysql-server
3. sudo mysql_install_db
4. mysql -u root -p
1. CREATE DATABASE magento;
2. CREATE USER 'mangento2'@'localhost' IDENTIFIED BY 'password';
3. GRANT ALL PRIVILEGES ON *.* TO 'mangento2'@'localhost' WITH GRANT OPTION;
4. CREATE USER 'mangento2'@'%' IDENTIFIED BY 'password';
5. GRANT ALL PRIVILEGES ON *.* TO 'mangento2'@'%' WITH GRANT OPTION;
6. FLUSH PRIVILEGES;
7. exit;
5. sudo nano /etc/mysql/my.cnf (Bind address 0.0.0.0)
6. mysqld --help --verbose

1. Install ubuntu 14.04 LTS
2. Install apache2
3. install php
4. seed the mysql DB :
5. unzip the shopping in web root
6. Change the config file

http://www.comtechies.com/2014/03/how-to-install-magento-on-amazon-ec2.html

http://www.comtechies.com/2012/12/how-to-launch-ubuntu-instance-on-amazon.html

http://www.bulletproof.net.au/managed-cloud/managed-aws/managed-aws-magento/

http://www.neevtech.com/blog/2012/11/24/hosting-magento-enterprise-on-aws/

http://www.bulletproof.net.au/wp-content/uploads/2013/10/Bulletproof_AWS_Magento-2_Final.png

http://www.elastera.com/blog/running-and-scaling-magento-on-aws-video-from-reinvent-2014/

http://www.mgt-commerce.com/magento-aws-managed-plans-and-pricing.html

http://www.tenzing.com/ecommerce-hosting/magento-optimized-hosting-on-aws/

Chef :

https://github.com/yevgenko/cookbook-magento

https://github.com/inviqa/chef-magento

https://s3.amazonaws.com/cloudformation-examples/IntegratingAWSCloudFormationWithOpscodeChef.pdf

CloudFormation Template:

https://s3-us-west-2.amazonaws.com/cloudformation-templates-us-west-2/WordPress_Single_Instance.template

1. install aws command line tools
1. http://docs.aws.amazon.com/cli/latest/userguide/cli-chap-welcome.html
2. $ curl "https://s3.amazonaws.com/aws-cli/awscli-bundle.zip" -o "awscli-bundle.zip"
   $ unzip awscli-bundle.zip
   $ sudo ./awscli-bundle/install -i /usr/local/aws -b /usr/local/bin/aws
3. aws cloudformation create-stack --stack-name myteststack2 --template-body file://///Projects/cc/cf/shop.json
4. aws cloudformation delete-stack --stack-name myteststack2

Chef + cloudformation

http://www.opinionatedprogrammer.com/2011/06/chef-solo-tutorial-managing-a-single-server-with-chef/

https://github.com/jcwilk/chef_solo_deploy

http://www.slideshare.net/aoepeople/highperformance-magento-in-the-cloud

Setting up chef

http://stackful-dev.com/three-ways-to-get-chef-chef-solo-installed-on-your-server.html

Vagrant:

http://sourabhbajaj.com/mac-setup/Vagrant/README.html

• vagrant box add win81 http://aka.ms/vagrant-win81-ie11

Mac Setup

$ brew tap caskroom/cask
$ brew install brew-cask
$ brew cask install google-chrome
$ brew update && brew upgrade brew-cask && brew cleanup

http://sourabhbajaj.com/mac-setup/Homebrew/Cask.html

1. brew cask install virtualbox
2. brew cask install vagrant
3. brew cask install vagrant-manager
4. vagrant box add precise64 http://files.vagrantup.com/precise64.box
5. vagrant init precise64
6. vagrant up
7. vagrant ssh
1. vagrant halt

8. http://www.mechanicalfish.net/configure-a-server-with-chef-solo-in-five-minutes/
9. mkdir -p ~/chef/cookbooks/helloworld/recipes
   $ echo '
   file "/tmp/helloworld.txt" do
    owner "ubuntu"
    group "ubuntu"
    mode 00544
    action :create
    content "Hello, Implementor!"
   end' > ~/chef/cookbooks/helloworld/recipes/default.rb
10. echo '
    {
     "run_list": [ "recipe[helloworld]" ]
    }' > ~/chef/node.json
11. echo '
     file_cache_path "/home/vagrant/chef"
     cookbook_path "/home/vagrant/chef/cookbooks"
     json_attribs "/home/vagrant/chef/node.json"
    ' > ~/chef/solo.rb

RUBY

http://linhmtran168.github.io/blog/2014/02/27/moving-from-rbenv-to-chruby/

https://blog.safaribooksonline.com/2014/11/27/opscode-chef-vagrant-test-kitchen/

//setting up chefdk for Ruby

http://jtimberman.housepub.org/blog/2014/04/30/chefdk-and-ruby/

1. brew install chruby
2. brew install ruby-install
3. ruby-install ruby 2.2

Chef DK

install chef & Ruby

http://misheska.com/blog/2013/12/26/set-up-a-sane-ruby-cookbook-authoring-environment-for-chef/

https://sethvargo.com/the-future-of-vagrant-berkshelf/

• brew cask install virtualbox
• brew cask install vagrant
• brew cask install vagrant-manager
• brew cask install chefdk
• vagrant plugin install vagrant-berkshelf
• vagrant plugin install vagrant-omnibus
• vagrant plugin install vagrant-chef-zero
• vagrant plugin install vagrant-vbguest

Good one

VBoxManage dhcpserver remove --netname HostInterfaceNetworking-vboxnet0

https://github.com/mitchellh/vagrant/issues/3083

brew cask install sublime-text

https://gorails.com/guides/using-vagrant-for-rails-development

http://misheska.com/blog/2013/06/23/getting-started-writing-chef-cookbooks-the-berkshelf-way-part2/

http://www.prashantrajan.com/posts/2013/06/leveling-up-chef-best-practices/

https://blog.safaribooksonline.com/2014/11/27/opscode-chef-vagrant-test-kitchen/

Test app:

http://berkshelf.com/index.html

https://github.com/MiniCodeMonkey/Vagrant-LAMP-Stack

http://misheska.com/blog/2013/06/23/getting-started-writing-chef-cookbooks-the-berkshelf-way-part2/

https://www.coveros.com/what-does-berkshelf-do-for-me/

https://box.scotch.io/ (this works)

https://github.com/r-baker/simple-magento-vagrant (this works)

http://magento-quickies.alanstorm.com/

good one

https://gordonlesti.com/developing-with-vagrant/

https://gordonlesti.com/developing-with-vagrant-part-2/

http://blog.3m.compec.pe/wp-content/uploads/2014/02/No_Frills_Magento_Layout.pdf

https://www.youtube.com/watch?v=pqgqxUuaBqo&list=PLZur_lHjB8biFVdYncLbvFg_vKPUqio40&index=4

https://www.youtube.com/playlist?list=PLZur_lHjB8biFVdYncLbvFg_vKPUqio40

http://code.tutsplus.com/courses/magento-fundamentals/lessons/course-introduction

https://tutsplus.com/subscription_sign_up/student

http://www.kingletas.com/2012/09/magento-and-vagrantup.html

https://github.com/magento-hackathon/magento-composer-installer

http://blog.syntaxc4.net/post/2014/09/03/windows-boxes-for-vagrant-courtesy-of-modern-ie.aspx

https://www.robbritton.com/2013/12/10/why-we-ditched-socket-io

http://automata.cc/osc-web

Performance & Scalability:

http://www.magentocommerce.com/knowledge-base/entry/understanding-magento-scalability-and-performance

http://www.mgt-commerce.com/blog/magento-on-steroids-best-practice-for-highest-performance/

http://www.rackspace.com/knowledge_center/whitepaper/building-secure-scalable-and-highly-available-magento-stores-powered-by-rackspace

http://www.quora.com/What-is-your-typical-Magento-performance-scalability-scenario

http://www.elastera.com/blog/running-and-scaling-magento-on-aws-video-from-reinvent-2014/

http://www.elastera.com/blog/the-aurora-database-from-aws-for-ecommerce-using-magento/

https://docs.nexcess.net/article/optimizing-magento-performance.html

http://www.mgt-commerce.com/blog/better-search-engine-ranking-with-https-and-varnish/

http://www.mgt-commerce.com/blog/magento-auto-scaling-with-varnish-on-amazon-aws/

http://gtmetrix.com/magento-optimization-guide.html

http://www.nitrogento.com/media/benchmark-Nitrogento-1.0.pdf

http://support.metacdn.com/hc/en-us/articles/204514135-Slow-Magento-Speed-up-Magento-with-our-Magento-Optimization-guide

https://github.com/magento/magento-performance-toolkit/tree/master/1.14

http://info.magento.com/rs/magentocommerce/images/Conquer_the_5_Most_Common_Magento_Coding_Issues_to_Optimize_Your_Site_for_Performance.pdf

http://stackoverflow.com/questions/1403184/what-are-the-best-steps-to-improve-magento-performance

Tools

http://tools.pingdom.com/

1. FastCGI

 

VPC:

AWS re:Invent 2014 | (SDD422) Amazon VPC Deep Dive

https://www.youtube.com/watch?v=HexrVfuIY1k

VPC Security

https://linuxacademy.com/cp/courses/lesson/course/41/lesson/4/module/3

Network ACL : Stateless lives on network level, outbound and inbound rules need to be specified

Security Group : Stateful default outbound rules are allowed

3 Security Groups

DB security groups,

VPC security groups, and

EC2 security groups

cd /etc/apache2/site-enabled

NAT Instance

https://linuxacademy.com/cp/courses/lesson/course/41/lesson/5/completed/4/module/3

DB Subnet Groups

https://linuxacademy.com/cp/courses/lesson/course/41/lesson/6/module/3

RDS Essentials

https://linuxacademy.com/cp/courses/lesson/course/99/lesson/1/module/3

Magento Install

sudo apt-get install -y ssh

sudo apt-get install -y apache2

sudo apt-get install -y php5 libapache2-mod-php5

sudo apt-get install -y php5-mysqlnd php5-curl php5-gd php5-intl php-pear php5-imap php5-mcrypt php5-ming

sudo apt-get install -y php5-ps php5-pspell php5-snmp php5-recode php5-sqlite php5-tidy php5-xmlrpc php5-xsl php-soap

http://www.quora.com/Why-does-Amazon-not-allow-assigning-an-Elastic-IP-to-an-Elastic-Load-Balancer

http://alestic.com/2009/08/runurl

VPC:

https://www.youtube.com/watch?v=vhgJIUzXMzI

https://www.youtube.com/watch?v=B0GQZK2UqZc&list=PLv2a_5pNAko3IkErhnF7zLhW3tlroTr2R&index=1

Building A Non-Default VPC

https://www.youtube.com/watch?v=4X5CV6aFxXg&index=2&list=PLv2a_5pNAko3IkErhnF7zLhW3tlroTr2R

Database:

Load test on DB

http://www.laurencegellert.com/2013/04/aws-benchmark-of-mysql-5-5-rds-vs-ec2/

http://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/CHAP_BestPractices.html

Best Practice

1. Have a subnet block that does not overlap with local network
2. VPC for Dev,Stage,Prod (VPC peering)
3. Security
1. Firewall Virtual appliance
2. VM encryption

https://cloudacademy.com/

https://www.udemy.com/

https://www.youtube.com/user/AmazonWebServices/videos

DNS

http://stackoverflow.com/questions/5832260/ahost-records-with-aws-load-balancer

Deployment

https://medium.com/aws-activate-startup-blog/upgrades-without-tears-part-1-introduction-to-blue-green-deployment-on-aws-e5bcf90eb60b

BOTO

http://www.wekanban.com/amazon-web-services-auto-scaling-cli-based-dashboard/

Reference:

https://linuxacademy.com/cp/courses/lesson/course/123/lesson/8/module/11

https://app.pluralsight.com/library/courses/aws-vpc-operations/table-of-contents

http://docs.aws.amazon.com/AmazonVPC/latest/UserGuide/VPC_ACLs.html

http://docs.aws.amazon.com/AmazonVPC/latest/UserGuide/VPC_Route_Tables.html

http://docs.aws.amazon.com/AmazonVPC/latest/GettingStartedGuide/getting-started-create-security-group.html#getting-started-inbound-outbound-rules

Vagrant local dev

http://www.webguys.de/magento/tuerchen-19-kickstart-magento-dev-system-vagrant/

https://danemacmillan.com/how-to-configure-xdebug-in-phpstorm-through-vagrant/

https://github.com/fideloper/Vaprobash

SMTP Config

SMTP USER

https://console.aws.amazon.com/iam/home?region=us-west-2#users/ses-smtp-user.dev4

SSL Config