Network Aware Container Distribution System

Project Goal And Outline

“Network Aware Container Distribution System” is a project which aims at creating a solution to use idle networking resource of a datacenter to distribute data inside that datacenter. The Goals of the Project are to design and implement Network Monitoring, File Transmission Control, and Network Congestion Management. This project is mentored by Andrey Turkovsky.

Usage

Please note that at this stage of development we can only distribute one file at a time

Environment Set Up

For Master Node(a fresh copy of Ubuntu):

· Modifing config.py:

    file_path = "/home/your_user_name/Desktop/"     #The absolute path of the file that will be distributed 
    file_name = "test.jpg"                          #The name of the file that will be distributed 

· Setting up Master-end Environment:

    ./master_env_setup.sh

· To add slave node:

    ./master_add_slave.sh 

· Enter slave id

    001                                              #the same id as configured on the slave machine

· Run master.py

    python master.py

For Worker Node(a fresh copy of Ubuntu):

· Modify config.py:

 
    master_ip = "0.0.0.0"                           #Master-end IP address
    slave_id = 'slave_xxx'                          #Input slave id, must be the same as you will enter in ./master_add_slave.sh
                                                    #Must wrap slave_xxx with ''
    download_path = "~/Desktop/"                    #The file directory that you want to keep 

· Setting up Slave-end Environment:

    ./slave_env_setup

· Run slave.py

    python slave.py

As you finish above step, the file will starting to be distributed, if the network condition is idle on worker node, the master will send file to this node, if the network is not idle, the master will wait for the worker's network to become idle then start to distribute file to worker