Difference between revisions of "KosmosFS"

From Notes_Wiki
(Created page with "==Installing kosmosfs== #Download lastest kosmosfs source code. ( http://code.google.com/p/kosmosfs/downloads/list ) #<tt>yum install boost cmake log4cpp xfsprogs-devel</tt> ...")
 
m
Line 1: Line 1:
<yambe:breadcrumb>Filesystem or partition tools</yambe:breadcrumb>
==Installing kosmosfs==
==Installing kosmosfs==


Line 51: Line 52:


Most of above instructions are learned from http://code.google.com/p/kosmosfs/w/list
Most of above instructions are learned from http://code.google.com/p/kosmosfs/w/list
<yambe:breadcrumb>Filesystem or partition tools</yambe:breadcrumb>

Revision as of 14:45, 28 May 2013

<yambe:breadcrumb>Filesystem or partition tools</yambe:breadcrumb>

Installing kosmosfs

  1. Download lastest kosmosfs source code. ( http://code.google.com/p/kosmosfs/downloads/list )
  2. yum install boost cmake log4cpp xfsprogs-devel
  3. Extract kfs tar.gz file
  4. Go into extract source folder.
  5. mkdir build; cd build; cmake -D CMAKE_BUILD_TYPE=RelWithDebInfo $PWD/..
  6. gmake
  7. gmake install
  8. Enable password less root login from current system to all other nodes
  9. Login as root
  10. Go to folder '/home/saurabh/Desktop/kfs-0.5/scripts'
  11. Create file 'my_machines.cfg' with contents like:
    [metaserver]
    node: lab320-pc9
    clusterkey: kfs-test-cluster
    rundir: /opt/kfs/meta
    baseport: 20000
    backup_path: dev105:/opt/kfs/meta_bkup
    loglevel: INFO
    numservers: 2
    [chunkserver_defaults]
    rundir: /opt/kfs/chunk
    chunkDir: /opt/kfs/chunk/bin/kfschunk1 /opt/kfs/chunk/bin/kfschunk2
    baseport: 30000
    space: 2 G
    loglevel: INFO
  12. Enter proper IP address of node names labpc7, lab320-pc9, lab320-pc10 etc. in /etc/hosts
  13. Verify that password less root ssh to all other machines via name is working. Also accept ssh keys during this process.
  14. Create file machines.txt with IP addresses of all chunkserver machines, like
    10.3.3.241
    10.3.3.196
    10.3.3.139
  15. Create file named 'all-machines.txt' which IPs of all machines on which chunkserver should be running. For example:
    10.3.3.241
    10.3.3.196
    10.3.3.139
    This file should exist on all systems after setup.
  16. Follow all above steps on all servers (metaservers + chunkservers)
  17. Use command 'python kfssetup.py -f my_machines.cfg -m machines.txt -b ../build -w ../webui' to setup all other machines for kfs
  18. Use command 'python kfslaunch.py -f my_machines.cfg -m machines.txt -s' to launch all kfs servers
  19. Go to folder 'build/bin/tools' and use command './kfsping -m -s lab320-pc9 -p 20000' where 'lab320-pc9' is name of metaserver and 20000 is metaserver port.
  20. One can also visit page 'http://lab320-pc9:20050/cluster-view' to see which nodes are started and which are not running.


Most of above instructions are learned from http://code.google.com/p/kosmosfs/w/list



<yambe:breadcrumb>Filesystem or partition tools</yambe:breadcrumb>