A toolbox for the automatic monitoring of elderly in a nursing home or in the natural home environment is proposed. Rather than monitoring vital signs or other biomedical parameters, the toolbox is focussed on the monitoring of activity patterns and changes therein. Activity information is derived from visual information using image processing algorithms. The visual information is acquired using 3D camera technology. Besides a traditional visual image, 3D cameras also provide highly accurate depth information. The 3D position of the subject is derived and serves as the primary information source for the different components in the toolbox.