It's easier to show what the system does than try to explain it.
Video synthesizer controlled by light sensor position in three dimensions.
Example of the video effects that become possible with individual sensing on all five fingers.
Finger position sensors can be used to control audio synthesizers.
See build log for schematics, PCBs, and design explanations.
Before building the glove I did a simple proof of concept using the NES Zapper.