Create your own awesome maps

Even on the go

with our free apps for iPhone, iPad and Android

Get Started

Already have an account?
Log In

New Twitter Infrastructure by Mind Map: New Twitter Infrastructure
0.0 stars - reviews range from 0 to 5

New Twitter Infrastructure

Code

Producer

Manage Twitter Stream (connection, error logging, ...)

Manage RabbitMQ (connection, error logging)

Transfer serialized tweets to the queue

Test suite

Documentation

Consumer

Manage RabbitMQ (connection, error logging)

Manage DB-agnostic layer (connection, error logging)

Deserialize and process tweets

Store tweet to DB-agnostic interface, MySQL implementation, NoSQL implementation

Test suite

Documentation

Prerequisites

Environment setup

RabbitMQ

WAMP

Twitter account and api key

Git/GitHub

Backup MySQL (185G)

RabbitMQ learning

Study NoSQL alternatives

Cassandra

MongoDB

Voldemort

Backup

Create regular data Backup from the Database

How often ?

Where to store it ?

Which format ?

Server Configuration

Launch at startup

RabbitMQ

Artifactory

MySQL

Continuous Integration

Jenkins

Installation

Builds setup