Install MongoDB, Xdebug and PHP 5.3.3 on Ubuntu 9.10
Here is a nice video that shows you how to install PHP 5.3.*, Xdebug, MongoDB and getting started with Lithium, the most RAD framework for PHP 5.3+.I will note down some of the steps here anyway on how I did on Ubuntu. I started from Ubuntu Server installation and hence already had Apache on the system. Hence, some steps might be different.
sudo apt-get install apache2-prefork-dev
Now the web server must be running at http://localhost. The document root that is setup by default on Ubuntu is /var/www.
1. PHP 5.3.3
Now head over to the php website and grab the PHP 5.3.* source. At the time of writing this post, it was 5.3.3. Here is the command line I used:
cd ~
wget http://www.php.net/get/php-5.3.3.tar.gz/from/us.php.net/mirror
tar -xzvf php-5.3.3.tar.gz
cd php-5.3.3
wget http://www.php.net/get/php-5.3.3.tar.gz/from/us.php.net/mirror
tar -xzvf php-5.3.3.tar.gz
cd php-5.3.3
You can create a config.clean script in this directory and add the lines shown.
nano config.clean
and paste the following lines:
#! /bin/sh
#
# ..-. .- .. .-.. ..-. .- ... -
#
'./configure'
'--prefix=/usr'
'--with-config-file-path=/etc/php5/'
'--with-config-file-scan-dir=/etc/php5/'
'--with-apxs2=/usr/bin/apxs2'
'--with-bz2'
'--with-curl'
'--with-gd'
'--with-iconv'
'--with-mysql'
'--with-mysqli'
'--with-openssl'
'--with-pcre-regex'
'--with-pdo-mysql'
'--with-pear'
'--with-xmlrpc'
'--with-xsl'
'--with-zlib'
'--enable-ftp'
'--enable-mbstring'
'--enable-soap'
'--enable-sockets'
"$@"
#
# ..-. .- .. .-.. ..-. .- ... -
#
'./configure'
'--prefix=/usr'
'--with-config-file-path=/etc/php5/'
'--with-config-file-scan-dir=/etc/php5/'
'--with-apxs2=/usr/bin/apxs2'
'--with-bz2'
'--with-curl'
'--with-gd'
'--with-iconv'
'--with-mysql'
'--with-mysqli'
'--with-openssl'
'--with-pcre-regex'
'--with-pdo-mysql'
'--with-pear'
'--with-xmlrpc'
'--with-xsl'
'--with-zlib'
'--enable-ftp'
'--enable-mbstring'
'--enable-soap'
'--enable-sockets'
"$@"
Now you can run the following:
sudo apt-get install libxml2-dev libbz2-dev libcurl4-gnutls-dev libjpeg62-dpg libpng12-dev libxslt1-dev
sudo sh ./config.clean
make -i install
sudo sh ./config.clean
make -i install
Now PHP 5.3.3 installation is complete.
2. Xdebug Installation
# install dependancies
sudo apt-get install php5-dev
#install xdebug
sudo pecl install xdebug
# copy and start editing php.ini to add xdebug module
sudo cp /etc/php5/apache2/php.ini /etc/php5
sudo nano /etc/php5.ini
# Add the following to the end:
[xdebug]
zend_extension=/usr/lib/php/extensions/no-debug-non-zts-20090626/xdebug.so
sudo apt-get install php5-dev
#install xdebug
sudo pecl install xdebug
# copy and start editing php.ini to add xdebug module
sudo cp /etc/php5/apache2/php.ini /etc/php5
sudo nano /etc/php5.ini
# Add the following to the end:
[xdebug]
zend_extension=/usr/lib/php/extensions/no-debug-non-zts-20090626/xdebug.so
3. MongoDB Installation
sudo mkdir -p /data/db
# Download Mongo
curl http://downloads.mongodb.org/linux/mongodb-linux-i686-1.4.4.tgz > mongo.tgz
tar xzf mongo.tgz
cd
# start mongod server
bin/mongod
# start mongo client
bin/mongo
# Download Mongo
curl http://downloads.mongodb.org/linux/mongodb-linux-i686-1.4.4.tgz > mongo.tgz
tar xzf mongo.tgz
cd
# start mongod server
bin/mongod
# start mongo client
bin/mongo
Now you can try out mongodb by referring to the documentation on their website at http://mongodb.org
Tags: mongodb,php - Visits: 2523 - No Comments
MongoDB - Nginx module for serving files from MongoDB's GridFS
Nginx is a fast web server that is especially popular for its low footprint even under heavy loads. I have tested this on few server setups and found this to be a true statement.As mentioned on an earlier post, you can store files in MongoDB using GridFS. This module adds the functionality in Nginx to serve files directly from MongoDB's GridFS as if it were being served from a regular directory. You can get all the information and the files from the following git location:
This is the configuration I tried:
location /gridfs/
gridfs my_db
field=filename
type=string
user=foo
pass=bar;
mongo 127.0.0.1:27017;
}
gridfs my_db
field=filename
type=string
user=foo
pass=bar;
mongo 127.0.0.1:27017;
}
When a user visits my site and goes to http://mysite/gridfs/image1.jpg, nginx takes this file from my mongodb database my_db and serves it.
Tags: mongodb - Visits: 2840 - No Comments
MongoDB - GridFS
Intro from the MongoDB website:GridFS is a storage specification for large objects in MongoDB. It works by splitting large object into small chunks, usually 256k in size. Each chunk is stored as a separate document in a chunks collection. Metadata about the file, including the filename, content type, and any optional information needed by the developer, is stored as a document in a files collection.
So for any given file stored using GridFS, there will exist one
document in files collection and one or more documents in the chunks
collection.
GridFS links from the MongoDB website:
http://www.mongodb.org/display/DOCS/GridFS
http://www.mongodb.org/display/DOCS/GridFS+Specification
PHP MongoGridGS Class
http://php.net/manual/en/class.mongogridfs.php
Example:
http://www.lightcubesolutions.com/blog/?p=209
I tested this out in PHP and following are some sample codes that may help.
1. PHP code to store uploaded file into the MongoDB GridFS.
if (isset($_POST["PHPSESSID"])) {
session_id($_POST["PHPSESSID"]);
}
session_start();
$conn = new Mongo("127.0.0.1:27017"); // Connect
$db = $conn->uniform_server; // Select DB
$db->authenticate("user","password"); // Authenticate to MongoDB
$grid = $db->getGridFS(); // Initialize GridFS
$name = $_FILES['Filedata']['name']; // Get Uploaded file name
$type = $_FILES['Filedata']['type']; // Try to get file extension
$id = $grid->storeUpload('Filedata',$name); // Store uploaded file to GridFS
/* Mime types did not work properly on my setup, hence the following logic */
$ext = substr($name,-3);
switch($ext) {
case "jpg": $type = "image/jpeg"; break;
case "gif": $type = "image/gif"; break;
case "png": $type = "image/png"; break;
case "txt": $type = "text/plain"; break;
case "pdf": $type = "application/pdf"; break;
case "zip": $type = "application/x-zip"; break;
}
/* Add additional metadata related to the file if required */
$files = $db->fs->files;
$files->update(array("filename" => $name), array('$set' => array("contentType" => $type, "aliases" => null, "metadata" => null)));
$conn->close(); // Close connection
exit(0);
?>
session_id($_POST["PHPSESSID"]);
}
session_start();
$conn = new Mongo("127.0.0.1:27017"); // Connect
$db = $conn->uniform_server; // Select DB
$db->authenticate("user","password"); // Authenticate to MongoDB
$grid = $db->getGridFS(); // Initialize GridFS
$name = $_FILES['Filedata']['name']; // Get Uploaded file name
$type = $_FILES['Filedata']['type']; // Try to get file extension
$id = $grid->storeUpload('Filedata',$name); // Store uploaded file to GridFS
/* Mime types did not work properly on my setup, hence the following logic */
$ext = substr($name,-3);
switch($ext) {
case "jpg": $type = "image/jpeg"; break;
case "gif": $type = "image/gif"; break;
case "png": $type = "image/png"; break;
case "txt": $type = "text/plain"; break;
case "pdf": $type = "application/pdf"; break;
case "zip": $type = "application/x-zip"; break;
}
/* Add additional metadata related to the file if required */
$files = $db->fs->files;
$files->update(array("filename" => $name), array('$set' => array("contentType" => $type, "aliases" => null, "metadata" => null)));
$conn->close(); // Close connection
exit(0);
?>
2. PHP code to list all the files in the GridFS (in a particular database)
$conn = new Mongo("127.0.0.1:27017"); // Connect
$db = $conn->uniform_server; // Select DB
$db->authenticate("user","password"); // Authenticate to MongoDB
$grid = $db->getGridFS(); // Initialize GridFS
$cursor = $grid->find();
foreach ($cursor as $obj) { // iterate through the results
echo 'Filename: '.$obj->getFilename().' Size: '.$obj->getSize().'
';
}
$conn->close(); // Disconnect from Server
exit(0);
?>
$db = $conn->uniform_server; // Select DB
$db->authenticate("user","password"); // Authenticate to MongoDB
$grid = $db->getGridFS(); // Initialize GridFS
$cursor = $grid->find();
foreach ($cursor as $obj) { // iterate through the results
echo 'Filename: '.$obj->getFilename().' Size: '.$obj->getSize().'
';
}
$conn->close(); // Disconnect from Server
exit(0);
?>
3. PHP code to download files stored in GridFS
$conn = new Mongo("127.0.0.1:27017"); // Connect
$db = $conn->uniform_server; // Select DB
$db->authenticate("user","password"); // Authenticate to MongoDB
$grid = $db->getGridFS(); // Initialize GridFS
$ask = $_REQUEST['file']; // Get filename requested
$file = $grid->findOne(array('filename' => $ask));
$files = $db->fs->files;
$file1 = $files->findOne(array('filename' => $ask));
$id = $file->file['_id'];
if ( (substr($ask,-3) == 'zip') || (substr($ask,-3) == 'pdf') ) {
/* Any file types you want to be downloaded can be listed in this */
header('Content-Type: application/octet-stream');
header('Content-Disposition: attachment; filename='.$ask);
header('Content-Transfer-Encoding: binary');
$cursor = $db->fs->chunks->find(array("files_id" => $id))->sort(array("n" => 1));
foreach($cursor as $chunk) {
echo $chunk['data']->bin;
}
}
else {
header('Content-Type: '.$file1["contentType"]);
echo $file->getBytes();
}
$conn->close(); // Disconnect from Server
exit(0);
?>
$db = $conn->uniform_server; // Select DB
$db->authenticate("user","password"); // Authenticate to MongoDB
$grid = $db->getGridFS(); // Initialize GridFS
$ask = $_REQUEST['file']; // Get filename requested
$file = $grid->findOne(array('filename' => $ask));
$files = $db->fs->files;
$file1 = $files->findOne(array('filename' => $ask));
$id = $file->file['_id'];
if ( (substr($ask,-3) == 'zip') || (substr($ask,-3) == 'pdf') ) {
/* Any file types you want to be downloaded can be listed in this */
header('Content-Type: application/octet-stream');
header('Content-Disposition: attachment; filename='.$ask);
header('Content-Transfer-Encoding: binary');
$cursor = $db->fs->chunks->find(array("files_id" => $id))->sort(array("n" => 1));
foreach($cursor as $chunk) {
echo $chunk['data']->bin;
}
}
else {
header('Content-Type: '.$file1["contentType"]);
echo $file->getBytes();
}
$conn->close(); // Disconnect from Server
exit(0);
?>
4. PHP code to delete a file from GridFS
$conn = new Mongo("127.0.0.1:27017"); // Connect
$db = $conn->uniform_server; // Select DB
$db->authenticate("user","password"); // Authenticate to MongoDB
$grid = $db->getGridFS(); // Initialize GridFS
$filename = $_REQUEST["file"]; // Get requested filename
$file = $grid->findOne($filename); // Find file in GridFS
$id = $file->file['_id']; // Get the files ID
$grid->delete($id); // Delete the file
$conn->close(); // Disconnect from Server
exit(0);
?>
$db = $conn->uniform_server; // Select DB
$db->authenticate("user","password"); // Authenticate to MongoDB
$grid = $db->getGridFS(); // Initialize GridFS
$filename = $_REQUEST["file"]; // Get requested filename
$file = $grid->findOne($filename); // Find file in GridFS
$id = $file->file['_id']; // Get the files ID
$grid->delete($id); // Delete the file
$conn->close(); // Disconnect from Server
exit(0);
?>
Tags: mongodb,programming - Visits: 5626 - No Comments
MongoDB - Replica Pair
Intro from the MongoDB website:Mongo supports a concept of replica pairs. These databases automatically coordinate which is the master and which is the slave at a given point in time.
At startup, the databases will negotiate which is master and which is slave. Upon an outage of one database server, the other will automatically take over and become master from that point on. In the event of another failure in the future, master status would transfer back to the other server. The databases manage this themselves internally.
You can read about the replica pair from the MongoDB website at the below link:
http://www.mongodb.org/display/DOCS/Replica+Pairs
Following is an example of how to run a replica pair. A replica pair is different from the master-slave configuration. In a master slave config, the slave is read-only and acts like a backup database. In a replica pair, if any of the databases go down, then the other takes over as master.
./mongod --pairwith localhost:27018 --arbiter
localhost:27019 --dbpath ~/data1
./mongod --port 27018 --pairwith localhost:27017 --arbiter localhost:27019 --dbpath ~/data2
./mongod --port 27019 #arbiter
./mongod --port 27018 --pairwith localhost:27017 --arbiter localhost:27019 --dbpath ~/data2
./mongod --port 27019 #arbiter
The arbiter is a mongodb server that runs on a third machine that helps negitiate between the paired servers to determine which one should be master.
Following is the PHP example code to connect when using a replica pair:
I tested this by stopping one server at a time and the other took over as master and the application continued to work without any failures or unavailability.
Tags: mongodb,programming - Visits: 933 - No Comments
MongoDB - Master Slave Setup
You can read more about the master-slave configuration at the MongoDB website:http://www.mongodb.org/display/DOCS/Master+Slave
Following commands to start a master slave setup in Ubuntu and monitor outputs if the logs are the same.
Start the master:
sudo /usr/bin/mongod --master --rest --config /etc/mongodb.conf
Start the slave:
sudo /usr/bin/mongod --rest --slave --source 127.0.0.1:27017 --dbpath /data/slavedb/ --fastsync --autoresync --config /etc/mongodb2.conf
Monitor logs from command line:
tail -f /var/log/mongodb/mongodb.log
Also,
when I had authentication issues, the following webpage helped resolve:sudo /usr/bin/mongod --master --rest --config /etc/mongodb.conf
Start the slave:
sudo /usr/bin/mongod --rest --slave --source 127.0.0.1:27017 --dbpath /data/slavedb/ --fastsync --autoresync --config /etc/mongodb2.conf
Monitor logs from command line:
tail -f /var/log/mongodb/mongodb.log
http://myadventuresincoding.wordpress.com/2010/04/26/mongodb-connecting-a-slave-to-a-master-running-in-auth-mode/
In auth mode, for replication to work, you need to add the following kind of similar users to the "local" db of both the master and the slave.
db.addUser("repl","replpassword")
Tags: mongodb,programming - Visits: 1070 - No Comments