Here are what I did to create my first openstack development environment:
1. git clone https://github.com/bcwaldon/vagrant_devstack
2. cd vagrant_devstack
based on the README, I also added submodules
git submodule init
git submodule update
3. vagrant up
1. git clone https://github.com/bcwaldon/vagrant_devstack
2. cd vagrant_devstack
based on the README, I also added submodules
git submodule init
git submodule update
3. vagrant up
In the Vagrantfile, it tries to download vagrant box from http://c479942.r42.cf2.rackcdn.com/precise64.box, but the file is not there anymore. I googled again and found this one http://dl.dropbox.com/u/1537815/precise64.box. I changed Vagrantfile to use the new box and restarted "vagrant up".
After waiting for sometime, I see following error message
"Mounting NFS shared folders failed. This is most often caused by the NFS client software not being installed on the guest machine. Please verify that the NFS client software is properly installed, and consult any resources specific to the linux distro you're using for more information on how to do this."
Most likely, you have a dirty vagrant environment, try vagrant reload to see if the problem goes away.
After a good a mount of time waiting on devstack to be installed, I hit on following error:
"+ sudo rm -rf /home/vagrant/cache /home/vagrant/devstack /home/vagrant/postinstall.sh
rm: cannot remove `/home/vagrant/cache': Device or resource busy
++ failed
++ local r=1
+++ jobs -p
++ kill
++ set +o xtrace
---- End output of su -c 'set -e; cd /home/vagrant/devstack; RECLONE=yes bash stack.sh > devstack.log' vagrant ----
Ran su -c 'set -e; cd /home/vagrant/devstack; RECLONE=yes bash stack.sh > devstack.log' vagrant returned 1
Chef never successfully completed! Any errors should be visible in the
output above. Please fix your recipes so that they properly complete.
"
To understand the problem, I did vagrant ssh and login to my VM. It seems that the original devstack directory has been removed. I did another git clone git://github.com/openstack-dev/devstack.git to get the devstack. Then I manually run stack.sh. It seems that at the end of lib/nova:cleanup_nova, the function tries to clean out the instances directory and the cache directory is among the deleting directories. But this directory is really mounted from my host machine by vagrant. The quick and dirty fix for this is to not to cleanup directory
agrant@precise64:~/devstack/lib$ git diff .
diff --git a/lib/nova b/lib/nova index fbb5a01..ae4554d 100644 --- a/lib/nova +++ b/lib/nova @@ -102,7 +102,7 @@ function cleanup_nova() { sudo iscsiadm --mode node | grep $VOLUME_NAME_PREFIX | cut -d " " -f2 | sudo iscsiadm --mode node --op delete || true # Clean out the instances directory. - sudo rm -rf $NOVA_INSTANCES_PATH/* + #sudo rm -rf $NOVA_INSTANCES_PATH/* fi }
diff --git a/lib/nova b/lib/nova index fbb5a01..ae4554d 100644 --- a/lib/nova +++ b/lib/nova @@ -102,7 +102,7 @@ function cleanup_nova() { sudo iscsiadm --mode node | grep $VOLUME_NAME_PREFIX | cut -d " " -f2 | sudo iscsiadm --mode node --op delete || true # Clean out the instances directory. - sudo rm -rf $NOVA_INSTANCES_PATH/* + #sudo rm -rf $NOVA_INSTANCES_PATH/* fi }
Since I have a changed devstack tree in my VM, I don't want cookbook script to re-clone the devstack tree. I have changed vagrant_devstack/cookbooks/devstack/recipes/default.rb to not clone devstack source code by disable following commands:
execute "git clone #{node[:devstack][:repository]}" do
cwd node[:devstack][:dir]
cwd node[:devstack][:dir]
user node[:devstack][:user]
group node[:devstack][:group]
not_if { File.directory?("#{node[:devstack][:dir]}/devstack") }
end
execute "git checkout #{node[:devstack][:branch]}" do
cwd "#{node[:devstack][:dir]}/devstack"
user node[:devstack][:user]
group node[:devstack][:group]
end
I'm not familiar with cookbook, I thought that "not_if { File.directory?("#{node[:devstack][:dir]}/devstack")" will avoid to overwrite my devstack directory on VM. But it seems that my devstack directory got wipe out everytime. Anyway, quickly disable lines above,solved my problem.
After changed script, I did vagrant reload in my host directory, the vagrant reload failed immediately while the cookbook tries to relink my host public key to the VM ~/.ssh/id_rsa. The quick fix for this is go to vagrant-openstack/recipes/cache.rb and fix following commands
execute "ln -s /home/#{u}/.host-ssh/id_rsa /home/#{u}/.ssh/id_rsa"
do
user u
group u
not_if { File.exists?("/home/#{u}/.ssh/id_rsa") }
do
user u
group u
not_if { File.exists?("/home/#{u}/.ssh/id_rsa") }
end
Again, I thought not_if statement should avoid the file relink is id_rsa is there already. But it seems that not_if does not work.
After all these changes, my vagrant up finished successfully. I have devstack up running. By default, the devstack does not enable quantum. But it is what I really need. To enable quantum + openvswitch, I did following changes:
diff --git a/stackrc b/stackrc
index 01e9556..f47ad40 100644
--- a/stackrc
+++ b/stackrc
@@ -14,7 +14,9 @@ DATABASE_TYPE=mysql
# ``disable_service`` functions in ``localrc``.
# For example, to enable Swift add this to ``localrc``:
# enable_service swift
-ENABLED_SERVICES=g-api,g-reg,key,n-api,n-crt,n-obj,n-cpu,n-net,cinder,c-sch,c-api,c-vol,n-sch,n-novnc,n-xvnc,n-cauth,horizon,rabbit,$DATABASE_TYPE
+ENABLED_SERVICES=g-api,g-reg,key,n-api,n-crt,n-obj,n-cpu,n-net,cinder,c-sch,c-api,c-vol,n-sch,n-novnc,n-xvnc,n-cauth,horizon,rabbit,$DATABASE_TYPE,quantum,q-svc,q-agt
+Q_PLUGIN=openvswitch
+ENABLE_TENANT_TUNNELS=True
After restart devstack, the quantum is up running.
Now on my host directory, I have a cache/stack directory that has all the devstack source code. The /opt/stack on the VM has a running copy of the devstack. I did a git branch work; git checkout work on all the directories under cache/stack so that we can have a dev branch.
Next, I will need to find a IDE to do my developemnt. eclipse+pydev+egit seems a good choice for me. First. I installed eclipse, then from http://pydev.org/updates, I installed pydev. From http://download.eclipse.org/egit/updates, I installed egit.
I used egit to import all the git repos from cache/stack directory. And then convert each of repo into general project. Switching to pydev perspective, right click on project names that just imported, select PyDev and set the project as PyDev project.
That is it, next, I will need to find out what "not_if" means and how fix the cookbook script so that I can make a right patch.
