Well, I figured out how to change the rules for when devices are plugged in (during boot and hotplug)... in /etc/udev/rules.d add a rules file... I named my 20-test.rules
THe 20 is because there was one named 10- and the default one was named 50-, so I picked a random numer there.. Not sure of any significance. Anyway, the test is just becase that, it is a test rule files right now.
Anyway, the contents:
# udev rules for allowing "games" group read/write access to the joystick device event
BUS=="usb", KERNEL=="event*", GROUP="games", MODE="0660", NAME="input/%k"
A reboot for me was in order for the rule to be followed.
Basically, this is not complete.. But, what it does as is right now is create any USB event device (USB mouse, joystick, tablet, etc etc) with group "games" and has a setting of 660 (owner/group read/write, other none). This can be refined more I'm sure, for specific bus, id etc information to only let certain controls read/write.