~azzar1/unity/add-show-desktop-key

1164.2.7 by Matt Giuca
Added doc/man/(config|install).rst. Bit more of man/index.rst.
1
.. IVLE - Informatics Virtual Learning Environment
2
   Copyright (C) 2007-2009 The University of Melbourne
3
4
.. This program is free software; you can redistribute it and/or modify
5
   it under the terms of the GNU General Public License as published by
6
   the Free Software Foundation; either version 2 of the License, or
7
   (at your option) any later version.
8
9
.. This program is distributed in the hope that it will be useful,
10
   but WITHOUT ANY WARRANTY; without even the implied warranty of
11
   MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
12
   GNU General Public License for more details.
13
14
.. You should have received a copy of the GNU General Public License
15
   along with this program; if not, write to the Free Software
16
   Foundation, Inc., 51 Franklin St, Fifth Floor, Boston, MA  02110-1301  USA
17
1348 by David Coles
Configuration documentation - fixing a few references
18
.. _ref-install:
19
1164.2.7 by Matt Giuca
Added doc/man/(config|install).rst. Bit more of man/index.rst.
20
************
21
Installation
22
************
23
1164.2.9 by Matt Giuca
doc/man: More headings!
24
System requirements
1164.2.7 by Matt Giuca
Added doc/man/(config|install).rst. Bit more of man/index.rst.
25
===================
26
1164.2.14 by William Grant
Add dependencies to docs.
27
Given versions are those on which IVLE is known to work; earlier versions
28
might work too. Debian/Ubuntu package names are given after the name of the
29
software.
30
1408 by William Grant
Update installation docs to prefer use of ivle-dev-setup.
31
.. If this list changes, you also need to change the list below, and
32
   the list in bin/ivle-dev-setup.
1164.2.41 by Matt Giuca
doc/man/install: Added package names for Apache and Python. Added a full apt-get install command to save typing.
33
1164.2.14 by William Grant
Add dependencies to docs.
34
* Ubuntu 8.04 or later (other distros should work with some tweaking, but are untested)
1164.2.41 by Matt Giuca
doc/man/install: Added package names for Apache and Python. Added a full apt-get install command to save typing.
35
* Apache 2.x (``apache2``) with modules:
1164.2.14 by William Grant
Add dependencies to docs.
36
   + mod_python (``libapache2-mod-python``)
37
   + mod_dav_svn and mod_authz_svn (``libapache2-svn``)
1164.2.41 by Matt Giuca
doc/man/install: Added package names for Apache and Python. Added a full apt-get install command to save typing.
38
* Python 2.5 (``python2.5``) or 2.6 (``python2.6``) with modules:
1164.2.14 by William Grant
Add dependencies to docs.
39
   + cjson (``python-cjson``)
40
   + ConfigObj (``python-configobj``)
41
   + docutils (``python-docutils``)
42
   + epydoc (``python-epydoc``)
1164.2.24 by William Grant
Add FormEncode to dependencies, and sort alphabetically.
43
   + FormEncode (``python-formencode``)
44
   + Genshi (``python-genshi``)
45
   + psycopg2 (``python-psycopg2``)
46
   + pysvn (``python-svn``)
1164.2.14 by William Grant
Add dependencies to docs.
47
   + Storm (``python-storm``)
48
* jQuery (``libjs-jquery``)
49
* PostgreSQL 8.3 or later (``postgresql``)
50
* Subversion (``subversion``)
51
* debootstrap (``debootstrap``)
1164.2.25 by William Grant
Need rsync too.
52
* rsync (``rsync``)
1164.2.14 by William Grant
Add dependencies to docs.
53
* GCC and related build machinery (``build-essential``)
1164.2.7 by Matt Giuca
Added doc/man/(config|install).rst. Bit more of man/index.rst.
54
1164.2.9 by Matt Giuca
doc/man: More headings!
55
Master versus slave servers
56
===========================
57
1574 by William Grant
Document the master vs. slave distinction.
58
IVLE is normally deployed in a cluster of several machines, split into
59
two different roles: master and slave.
60
61
There must be exactly one master server per cluster. The master normally
62
runs the PostgreSQL database server, the Subversion server, and the IVLE User
63
Management Server (``ivle-usrmgt-server``). It might also export shared data
64
directories to the slaves over NFS.
65
66
There may be any number of slaves in a cluster. They run the IVLE web
67
application, which also starts console host processes. Each slave makes use
68
of the shared services on the master.
69
70
For a small instance a slave may be run on the same machine as the master.
71
This is the setup described on this page.
72
73
1164.2.7 by Matt Giuca
Added doc/man/(config|install).rst. Bit more of man/index.rst.
74
Installing from a Debian package
75
================================
76
1349 by Matt Giuca
Added sample data infrastructure, with a little bit of sample data. The sample data is in examples/db/sample.sql. Documentation in doc/man/sample.rst details the infrastructure for importing and exporting sample data.
77
.. _database-setup:
78
1408 by William Grant
Update installation docs to prefer use of ivle-dev-setup.
79
1164.2.7 by Matt Giuca
Added doc/man/(config|install).rst. Bit more of man/index.rst.
80
Installing from source
81
======================
82
1408 by William Grant
Update installation docs to prefer use of ivle-dev-setup.
83
When setting up a development IVLE environment on Ubuntu 9.04 or later,
84
there are scripts to automate most of the process. First get and extract
85
a release, or check out the latest code from the bzr branch: ::
86
87
   bzr get lp:ivle
88
89
This will create a new directory, ``ivle``, containing a pristine
90
source tree. The remaining steps assume that you are in this new
91
directory.
92
93
The ``ivle-dev-setup`` script will configure PostgreSQL, Apache, IVLE
94
and the filesystem to cooperate, getting you most of the way to a
95
working system in just one step: ::
96
97
   bin/ivle-dev-setup
98
99
.. warning::
100
   This reconfigures parts of your system, and has the potential to
101
   break other applications using Apache or PostgreSQL. It may also
102
   fail to execute if you have existing incompatible configurations
103
   of those services.
104
   
105
106
This may take a few minutes, and will ask you to confirm installation
107
of the dependency packages.
108
109
Upon completion, you must build a self-contained jail in which to run
110
untrusted user code. ``ivle-dev-setup`` will have configured most of
111
the necessary settings, but you may wish to use a local Ubuntu mirror
112
to improve speed or minimise download costs. If you don't wish to use
113
a special mirror, you may omit the first step. ::
114
115
   sudo ivle-config --jail/mirror http://url.to.mirror/ubuntu
116
   sudo ivle-buildjail -r
117
118
.. warning::
119
   ``ivle-buildjail`` will download a large volume of package data --
120
   potentially some hundreds of megabytes.
121
122
``ivle-buildjail`` will download, unpack and install a minimal Ubuntu
123
system and configure it for IVLE usage. This could take a while.
124
125
Once the jail has been successfully built, IVLE is up and running,
126
but with no user accounts or other data in place. For development
127
or demonstration purposes, sample data (including fictitious users,
128
subjects, and projects) can be loaded.
129
130
For other environments, it may be more appropriate to start with an
131
empty database and just create users as required.
132
133
To load the sample data: ::
134
135
   sudo ivle-loadsampledata examples/db/sample.sql
136
137
.. warning::
138
   If you answer 'yes' to the ``ivle-loadsampledata`` prompt, any
139
   existing data in your IVLE database will be **permanently
140
   destroyed**.
141
142
... or to add a new admin user: ::
143
144
   sudo ivle-adduser --admin -p password username 'Full Name'
145
146
You should then be able to browse to http://ivle.localhost/, and
1459 by William Grant
Correct the default username in the install docs.
147
log in with username ``admin`` and password ``password``, or the
1408 by William Grant
Update installation docs to prefer use of ivle-dev-setup.
148
username and password that you gave to ``ivle-adduser``.
149
150
151
Manual steps
152
------------
153
154
If the automatic installation scripts do not work, or if you want more
155
control over the whole process, these manual steps are probably for
156
you. But you need not read this section at all if you were able to log
157
in after following the steps above.
158
159
.. If this list changes, you also need to change the list above, and
160
   the command in bin/ivle-dev-setup.
1164.2.41 by Matt Giuca
doc/man/install: Added package names for Apache and Python. Added a full apt-get install command to save typing.
161
162
If you want to grab all of the required packages in one command, use::
163
164
    sudo apt-get install apache2 libapache2-mod-python libapache2-svn \
165
    python2.6 python-cjson python-configobj python-docutils python-epydoc \
1355 by William Grant
Drop python-routes dependency.
166
    python-formencode python-genshi python-psycopg2 python-svn python-storm \
167
    libjs-jquery postgresql subversion debootstrap rsync build-essential
1164.2.41 by Matt Giuca
doc/man/install: Added package names for Apache and Python. Added a full apt-get install command to save typing.
168
1164.2.15 by William Grant
Add some initial installation docs.
169
While installing from a distribution package is often a better idea for
170
users, developers will need to install from a plain source tree.
171
172
To get the tree, either grab and extract a release tarball, or get the
173
very latest code using bzr: ::
174
175
   bzr get lp:ivle
176
177
You should then change into the new source directory.
178
179
As IVLE needs to compile some binaries, you must first build, then
180
install it: ::
181
182
   ./setup.py build
183
   sudo ./setup.py install
184
185
Unlike the package, you will have to manually set up the database and
186
configuration.
187
1164.2.46 by Matt Giuca
doc/man/install: New instructions for setting up Postgres DB and user. Now the database is created under the new username, so there are no problems when IVLE runs as a different database user.
188
First, it is recommended that you create a separate database user for IVLE.
189
You may use any name for the user. ::
190
191
   sudo -u postgres createuser ivleuser     # Answer 'n' to all questions
192
   sudo -u postgres psql -c "ALTER USER ivleuser WITH ENCRYPTED PASSWORD 'ivle-password';"
193
194
Now, you must create a PostgreSQL database, and populate it with the
195
IVLE schema. You may use any name for the database (here we use ``ivle``). ::
196
197
   sudo -u postgres createdb -O ivleuser ivle
1164.2.15 by William Grant
Add some initial installation docs.
198
   sudo -u postgres createlang plpgsql ivle
1164.2.46 by Matt Giuca
doc/man/install: New instructions for setting up Postgres DB and user. Now the database is created under the new username, so there are no problems when IVLE runs as a different database user.
199
   psql -h localhost -W ivle ivleuser < userdb/users.sql
1164.2.15 by William Grant
Add some initial installation docs.
200
201
The configuration wizard - ``ivle-config`` - will ask you a series of
1164.2.46 by Matt Giuca
doc/man/install: New instructions for setting up Postgres DB and user. Now the database is created under the new username, so there are no problems when IVLE runs as a different database user.
202
questions. You should give the database username and password as configured
203
above. Apart from database settings, the defaults should be correct
1164.2.15 by William Grant
Add some initial installation docs.
204
for a development system. If deploying IVLE properly - particularly on
205
multiple nodes - several options will need to be changed. Watching
206
carefully, run: ::
207
208
   sudo ivle-config
209
210
1164.2.7 by Matt Giuca
Added doc/man/(config|install).rst. Bit more of man/index.rst.
211
Basic configuration
212
===================
213
214
.. Note: Place here only the configuration required to get the system
215
   installed and running. Any further configuration should go in config.rst.
216
1164.2.15 by William Grant
Add some initial installation docs.
217
IVLE needs a directory hierarchy in which to store filesystem data, which
218
by default lives in ``/var/lib/ivle``. Create it now. ::
219
220
   sudo ivle-createdatadirs
221
1164.2.22 by William Grant
Document configuration of the jail creation process.
222
223
Configuring the jail environment
224
--------------------------------
1164.2.15 by William Grant
Add some initial installation docs.
225
226
You will require a self-contained jail environment in which to safely
1164.2.22 by William Grant
Document configuration of the jail creation process.
227
execute student code. 
228
Before you can actually build the jail, a few configuration options are
1164.2.42 by Matt Giuca
doc/man/install: Minor confusion avoidance.
229
needed. Open up ``/etc/ivle/ivle.conf``, and find the ``[jail]`` section
230
(**not** the ``[[jails]]`` section).
1164.2.22 by William Grant
Document configuration of the jail creation process.
231
Add to it: ::
232
233
   devmode = True
234
   suite = jaunty # Replace this with the codename of your Ubuntu release.
235
   mirror = http://url.to.archive/mirror # Replace with a fast Ubuntu mirror.
236
   extra_packages = python-configobj, python-svn, python-cjson
237
1164.2.28 by William Grant
Add a TODO about jailbuilding instructions for the packages.
238
.. TODO: Move this around a bit, as the config options required differ for
239
   the packaged version.
240
1164.2.22 by William Grant
Document configuration of the jail creation process.
241
Now we can actually build the jail. The creation process basically downloads
242
a minimal Ubuntu system and installs it in ``/var/lib/ivle/jails/__base__``.
243
Note that this could download a couple of hundred megabytes. ::
244
245
   sudo ivle-buildjail -r
1164.2.15 by William Grant
Add some initial installation docs.
246
1164.2.16 by William Grant
Add docs on configuring Apache.
247
Configuring Apache
248
------------------
249
250
IVLE makes use of two Apache virtual hosts: one for the application itself,
251
and one for the Subversion services. There are example configuration files
252
in ``examples/config/apache.conf`` and ``examples/config/apache-svn.conf``,
1408 by William Grant
Update installation docs to prefer use of ivle-dev-setup.
253
which will run IVLE at http://ivle.localhost/.
1164.2.16 by William Grant
Add docs on configuring Apache.
254
255
On a Debian or Ubuntu system, just copy those two files into
256
``/etc/apache2/sites-available`` under appropriate names (eg. ``ivle`` and
257
``ivle-svn``). Then you need to activate them: ::
258
259
   sudo a2ensite ivle
260
   sudo a2ensite ivle-svn
261
   sudo /etc/init.d/apache2 reload
262
263
1164.2.17 by William Grant
Add /etc/hosts augmentation docs.
264
Configuring hostname resolution
265
--------------------------------
266
267
All of IVLE's hostnames need to be resolvable from the local system. For a
268
production environment, this would be done in DNS. For a development system,
1164.2.22 by William Grant
Document configuration of the jail creation process.
269
this is usually done in ``/etc/hosts``. Add this line to that file: ::
1164.2.17 by William Grant
Add /etc/hosts augmentation docs.
270
271
   127.0.1.1 ivle.localhost public.ivle.localhost svn.ivle.localhost
272
1164.2.18 by William Grant
Also edit /etc/hosts inside the jail.
273
Code running inside the jail environment also needs to be able to resolve
274
those names. Add, to ``/var/lib/ivle/jails/__base_build__/etc/hosts``: ::
275
276
   127.0.1.1 svn.ivle.localhost
277
278
Then refresh the active copy of the jail: ::
279
280
   sudo ivle-buildjail
281
1164.2.20 by William Grant
Document installation of the usrmgt-server init script.
282
283
Configuring the user management server
284
--------------------------------------
285
286
You need to have the IVLE user management server (``usrmgt-server``) running
287
for many parts of IVLE to operate properly, so it should be configured to
288
start on boot. There is an example init script in
289
``examples/config/usrmgt-server.init``. For Debian or Ubuntu, copy it to
1164.2.44 by Matt Giuca
doc/man/install: Conflicting advice for installing usrmgt-server init script. Now recommend installation to /etc/init.d/ivle-usrmgt-server.
290
``/etc/init.d/ivle-usrmgt-server``. Start it now, and set it to start
291
automatically: ::
1164.2.20 by William Grant
Document installation of the usrmgt-server init script.
292
1164.2.44 by Matt Giuca
doc/man/install: Conflicting advice for installing usrmgt-server init script. Now recommend installation to /etc/init.d/ivle-usrmgt-server.
293
   sudo /etc/init.d/ivle-usrmgt-server start
294
   sudo update-rc.d ivle-usrmgt-server defaults 99
1164.2.20 by William Grant
Document installation of the usrmgt-server init script.
295
1164.2.27 by William Grant
Document user creation.
296
297
Creating the initial user
298
-------------------------
299
1164.2.30 by William Grant
Document creating an admin user, now issue #151 is fixed.
300
The final step in getting a usable IVLE set up is creating a user. You'll
301
probably want admin privileges - if not, drop the ``--admin``. ::
302
1164.2.45 by Matt Giuca
doc/man/install: s/ivle-makeuser/ivle-adduser/g.
303
   sudo ivle-adduser --admin -p password username 'Full Name'
1164.2.27 by William Grant
Document user creation.
304
1408 by William Grant
Update installation docs to prefer use of ivle-dev-setup.
305
You should then be able to browse to http://ivle.localhost/, and
1164.2.27 by William Grant
Document user creation.
306
log in with that username and password.
307
1359 by Matt Giuca
Added a script ivle-loadsampledata.
308
*Alternatively*, you may wish to import the IVLE sample data, for a complete
309
working IVLE environment (not for production use). See :ref:`sample-data`.
310
1164.2.7 by Matt Giuca
Added doc/man/(config|install).rst. Bit more of man/index.rst.
311
.. note::
312
   For more advanced configuration, see :ref:`Configuring IVLE
313
   <ref-configuring-ivle>`.