Update the low power playbook
tune ansible playbook currently sets all low_power tagged nodes to 180w, need to update to dynamically set to 80% of whatever that max GPU power is, can be calculate from nvidia-smi but subsequent runs will continue to shrink the power by 80% Likely will need to update ansible global variables to include the reccomend low power
Create global vars for each GPU that has power issues for example will create variable for 3090s to use 280w instead of 350w
3090 = "280.00"
set nautilusg02.sci.cwru.edu with new vars once finished
} ok: [csusb-sci-103-11.csusb.edu] => (item=[5, True]) => { "msg": "Setting power limit for GPU 5 to 0 W" } ok: [csusb-sci-103-11.csusb.edu] => (item=[6, True]) => { "msg": "Setting power limit for GPU 6 to 0 W" } ok: [csusb-sci-103-11.csusb.edu] => (item=[7, True]) => { "msg": "Setting power limit for GPU 7 to 0 W" } ok: [csusb-sci-103-11.csusb.edu] => (item=[8, '350.00']) => { "msg": "Setting power limit for GPU 8 to 280 W" } ok: [csusb-sci-103-11.csusb.edu] => (item=[9, '350.00']) => { "msg": "Setting power limit for GPU 9 to 280 W" } ok: [csusb-sci-103-11.csusb.edu] => (item=[10, '350.00']) => { "msg": "Setting power limit for GPU 10 to 280 W" } ok: [csusb-sci-103-11.csusb.edu] => (item=[11, '350.00']) => { "msg": "Setting power limit for GPU 11 to 280 W" } ok: [csusb-sci-103-11.csusb.edu] => (item=[12, '350.00']) => { "msg": "Setting power limit for GPU 12 to 280 W" } ok: [csusb-sci-103-11.csusb.edu] => (item=[13, '350.00']) => { "msg": "Setting power limit for GPU 13 to 280 W" } ok: [csusb-sci-103-11.csusb.edu] => (item=[14, '350.00']) => { "msg": "Setting power limit for GPU 14 to 280 W" } ok: [csusb-sci-103-11.csusb.edu] => (item=[15, '350.00']) => { "msg": "Setting power limit for GPU 15 to 280 W"