Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

BONSAI: System.InvalidOperationException: Spinnaker camera with serial number 23347803 was not found. #1239

Open
alexpiet opened this issue Dec 23, 2024 · 5 comments
Open

BONSAI: System.InvalidOperationException: Spinnaker camera with serial number 23347803 was not found. #1239

alexpiet opened this issue Dec 23, 2024 · 5 comments
Labels
medium priority - auto-generated autogenerated issues that have occurred more than once in a month

Comments

@alexpiet
Copy link
Collaborator

This issue was automatically generated from GUI logs.

file: Foraging.py
function: log_subprocess_output
line 4915
logfile: W10DT714688/W10DT714688-D_gui_log_2024-12-20_12-57-37.txt
boxes: 8D
count: 2
text: BONSAI: System.InvalidOperationException: Spinnaker camera with serial number 23347803 was not found.

GUI Log snippet (click for full log)

01:00:46 PM:INFO:rigcontrol:rigcontrol.py:msg_handler:line 56:['/ManualRightWaterStartTime', 14318744.825984, '127.0.0.1', 4033]
01:00:46 PM:INFO:rigcontrol:rigcontrol.py:msg_handler:line 56:['/RightRewardDeliveryTimeHarp', 14318744.82848, '127.0.0.1', 4033]
01:00:55 PM:INFO:rigcontrol:rigcontrol.py:msg_handler:line 56:['/ManualLeftWaterStartTime', 14318754.341984, '127.0.0.1', 4033]
01:00:55 PM:INFO:rigcontrol:rigcontrol.py:msg_handler:line 56:['/ManualLeftWaterStartTime', 14318754.342976, '127.0.0.1', 4033]
01:00:55 PM:INFO:rigcontrol:rigcontrol.py:msg_handler:line 56:['/LeftRewardDeliveryTimeHarp', 14318754.34448, '127.0.0.1', 4033]
01:00:55 PM:INFO:rigcontrol:rigcontrol.py:msg_handler:line 56:['/LeftRewardDeliveryTimeHarp', 14318754.345504, '127.0.0.1', 4033]
01:00:56 PM:INFO:rigcontrol:rigcontrol.py:msg_handler:line 56:['/ManualRightWaterStartTime', 14318754.824, '127.0.0.1', 4033]
01:00:56 PM:INFO:rigcontrol:rigcontrol.py:msg_handler:line 56:['/ManualRightWaterStartTime', 14318754.824, '127.0.0.1', 4033]
01:00:56 PM:INFO:rigcontrol:rigcontrol.py:msg_handler:line 56:['/RightRewardDeliveryTimeHarp', 14318754.825504, '127.0.0.1', 4033]
01:00:56 PM:INFO:rigcontrol:rigcontrol.py:msg_handler:line 56:['/RightRewardDeliveryTimeHarp', 14318754.826496, '127.0.0.1', 4033]
01:01:05 PM:INFO:rigcontrol:rigcontrol.py:msg_handler:line 56:['/ManualLeftWaterStartTime', 14318764.336992, '127.0.0.1', 4033]
01:01:05 PM:INFO:rigcontrol:rigcontrol.py:msg_handler:line 56:['/ManualLeftWaterStartTime', 14318764.336992, '127.0.0.1', 4033]
01:01:05 PM:INFO:rigcontrol:rigcontrol.py:msg_handler:line 56:['/LeftRewardDeliveryTimeHarp', 14318764.338496, '127.0.0.1', 4033]
01:01:05 PM:INFO:rigcontrol:rigcontrol.py:msg_handler:line 56:['/LeftRewardDeliveryTimeHarp', 14318764.339488, '127.0.0.1', 4033]
01:01:06 PM:INFO:rigcontrol:rigcontrol.py:msg_handler:line 56:['/ManualRightWaterStartTime', 14318764.824, '127.0.0.1', 4033]
01:01:06 PM:INFO:rigcontrol:rigcontrol.py:msg_handler:line 56:['/ManualRightWaterStartTime', 14318764.824, '127.0.0.1', 4033]
01:01:06 PM:INFO:rigcontrol:rigcontrol.py:msg_handler:line 56:['/RightRewardDeliveryTimeHarp', 14318764.826496, '127.0.0.1', 4033]
01:01:06 PM:INFO:rigcontrol:rigcontrol.py:msg_handler:line 56:['/RightRewardDeliveryTimeHarp', 14318764.827488, '127.0.0.1', 4033]
01:01:06 PM:INFO:Dialogs:Dialogs.py:_start_preview:line 1213:Camera is on
01:01:07 PM:ERROR:Foraging:Foraging.py:log_subprocess_output:line 4915:BONSAI: System.InvalidOperationException: Spinnaker camera with serial number 23347803 was not found.
Full GUI log 
12:57:37 PM:INFO:Foraging:Foraging.py:start_gui_log_file:line 4796:Starting logfile!
12:57:39 PM:INFO:Foraging:Foraging.py:log_git_hash:line 4807:Python version: 3.11.9 | packaged by Anaconda, Inc. | (main, Apr 19 2024, 16:40:41) [MSC v.1916 64 bit (AMD64)]
12:57:39 PM:INFO:Foraging:Foraging.py:log_git_hash:line 4824:Current git commit branch, hash: main, 698fb9fecded812fcf96d570658d9bc3766b14c6
12:57:39 PM:INFO:Foraging:Foraging.py:log_git_hash:line 4828:Current foraging_gui version: 1.6.19
12:57:39 PM:WARNING:Foraging:Foraging.py:log_git_hash:line 4838:local repository is clean
12:57:39 PM:INFO:Foraging:Foraging.py:<module>:line 4944:Setting QApplication attributes
12:57:39 PM:INFO:Foraging:Foraging.py:<module>:line 4952:Starting QApplication and Window
12:57:39 PM:INFO:Foraging:Foraging.py:__init__:line 77:Creating Window
12:57:39 PM:INFO:Foraging:Foraging.py:_GetSettings:line 1211:Loaded settings_box file
12:57:39 PM:INFO:Foraging:Foraging.py:_GetSettings:line 1239:Loaded settings file
12:57:39 PM:WARNING:Foraging:Foraging.py:_GetSettings:line 1249:Missing setting (FIP_settings), using default: C:\Users\svc_aind_behavior\Documents\FIPSettings
12:57:39 PM:WARNING:Foraging:Foraging.py:_GetSettings:line 1249:Missing setting (bonsai_config_path), using default: C:\Users\svc_aind_behavior\Documents\GitHub\dynamic-foraging-task\bonsai\Bonsai.config
12:57:39 PM:WARNING:Foraging:Foraging.py:_GetSettings:line 1249:Missing setting (metadata_dialog_folder), using default: C:\Users\svc_aind_behavior\Documents\ForagingSettings\metadata_dialog\
12:57:39 PM:WARNING:Foraging:Foraging.py:_GetSettings:line 1249:Missing setting (rig_metadata_folder), using default: C:\Users\svc_aind_behavior\Documents\ForagingSettings\rig_metadata\
12:57:39 PM:WARNING:Foraging:Foraging.py:_GetSettings:line 1249:Missing setting (project_info_file), using default: C:\Users\svc_aind_behavior\Documents\ForagingSettings\Project Name and Funding Source v2.csv
12:57:39 PM:WARNING:Foraging:Foraging.py:_GetSettings:line 1249:Missing setting (schedule_path), using default: Z:\dynamic_foraging\DynamicForagingSchedule.csv
12:57:39 PM:WARNING:Foraging:Foraging.py:_GetSettings:line 1249:Missing setting (go_cue_decibel_box1), using default: 60
12:57:39 PM:WARNING:Foraging:Foraging.py:_GetSettings:line 1249:Missing setting (go_cue_decibel_box2), using default: 60
12:57:39 PM:WARNING:Foraging:Foraging.py:_GetSettings:line 1249:Missing setting (go_cue_decibel_box3), using default: 60
12:57:39 PM:WARNING:Foraging:Foraging.py:_GetSettings:line 1249:Missing setting (lick_spout_distance_box1), using default: 5000
12:57:39 PM:WARNING:Foraging:Foraging.py:_GetSettings:line 1249:Missing setting (lick_spout_distance_box2), using default: 5000
12:57:39 PM:WARNING:Foraging:Foraging.py:_GetSettings:line 1249:Missing setting (lick_spout_distance_box3), using default: 5000
12:57:39 PM:WARNING:Foraging:Foraging.py:_GetSettings:line 1249:Missing setting (lick_spout_distance_box4), using default: 5000
12:57:39 PM:WARNING:Foraging:Foraging.py:_GetSettings:line 1249:Missing setting (name_mapper_file), using default: C:\Users\svc_aind_behavior\Documents\ForagingSettings\name_mapper.json
12:57:39 PM:WARNING:Foraging:Foraging.py:_GetSettings:line 1249:Missing setting (create_rig_metadata), using default: True
12:57:39 PM:WARNING:Foraging:Foraging.py:_GetSettings:line 1249:Missing setting (AutomaticUpload), using default: True
12:57:39 PM:WARNING:Foraging:Foraging.py:_GetSettings:line 1249:Missing setting (manifest_flag_dir), using default: C:\Users\svc_aind_behavior\Documents\aind_watchdog_service\manifest
12:57:39 PM:WARNING:Foraging:Foraging.py:_GetSettings:line 1249:Missing setting (auto_engage), using default: True
12:57:39 PM:WARNING:Foraging:Foraging.py:_GetSettings:line 1249:Missing setting (clear_figure_after_save), using default: True
12:57:39 PM:WARNING:Foraging:Foraging.py:_GetSettings:line 1249:Missing setting (add_default_project_name), using default: True
12:57:39 PM:INFO:Foraging:Foraging.py:_LoadSchedule:line 1137:Loaded behavior schedule
12:57:39 PM:INFO:Foraging:Foraging.py:_GetWaterCalibration:line 1101:Loaded Water Calibration
12:57:39 PM:INFO:Foraging:Foraging.py:_load_most_recent_rig_json:line 1572:Found existing rig.json: rig_446-8-D_2024-12-17_14_12_12.json
12:57:39 PM:INFO:RigJsonBuilder:RigJsonBuilder.py:build_rig_json_core:line 60:building rig json
12:57:39 PM:INFO:RigJsonBuilder:RigJsonBuilder.py:build_rig_json_core:line 624:finished building rig json
12:57:39 PM:INFO:RigJsonBuilder:RigJsonBuilder.py:build_rig_json:line 53:Using existing rig json
12:57:39 PM:INFO:Foraging:Foraging.py:_LoadUI:line 299:Using ForagingGUI.ui interface
12:57:39 PM:INFO:Foraging:Foraging.py:__init__:line 143:Setting Window title: 446-8-D
12:57:39 PM:INFO:Foraging:Foraging.py:_InitializeBonsai:line 1409:Trying to connect to already running Bonsai
12:57:39 PM:INFO:Foraging:Foraging.py:_ConnectOSC:line 1456:connecting to GUI and Bonsai through OSC
12:57:40 PM:INFO:Foraging:Foraging.py:_InitializeBonsai:line 1413:Could not connect: timed out
12:57:40 PM:INFO:Foraging:Foraging.py:_InitializeBonsai:line 1422:Starting Bonsai
12:57:40 PM:INFO:Foraging:Foraging.py:log_subprocess_output:line 4911:BONSAI logging starting
12:57:41 PM:INFO:Foraging:Foraging.py:_ConnectOSC:line 1456:connecting to GUI and Bonsai through OSC
12:57:42 PM:INFO:Foraging:Foraging.py:_InitializeBonsai:line 1436:Could not connect, total waiting time 0.5 seconds: timed out
12:57:42 PM:INFO:Foraging:Foraging.py:_ConnectOSC:line 1456:connecting to GUI and Bonsai through OSC
12:57:43 PM:INFO:Foraging:Foraging.py:_InitializeBonsai:line 1436:Could not connect, total waiting time 1.0 seconds: timed out
12:57:44 PM:INFO:Foraging:Foraging.py:_ConnectOSC:line 1456:connecting to GUI and Bonsai through OSC
12:57:44 PM:INFO:Foraging:Foraging.py:_InitializeBonsai:line 1439:Connected to Bonsai after 1.5 seconds
12:57:44 PM:INFO:Foraging:Foraging.py:_InitializeBonsai:line 1440:Bonsai started successfully
12:57:44 PM:INFO:Foraging:Foraging.py:_ConnectSlims:line 1318:Attempting to connect to Slims
12:57:45 PM:INFO:Foraging:Foraging.py:_ConnectSlims:line 1335:Successfully connected to Slims
12:57:45 PM:WARNING:Dialogs:Dialogs.py:_LoadCalibrationParameters:line 480:could not find water calibration parameters: C:\Users\svc_aind_behavior\Documents\ForagingSettings\WaterCalibrationPar_4.json
12:57:45 PM:INFO:Foraging:Foraging.py:_InitializeMotorStage:line 912:Scanning for newscale stages
12:57:45 PM:INFO:Foraging:Foraging.py:_InitializeMotorStage:line 922:Could not find any instances of NewScale Stage
12:57:45 PM:INFO:Foraging:Foraging.py:_insert_stage_widget:line 279:Inserting Stage Widget
12:57:45 PM:INFO:connection:connection.py:_connect:line 688:Connecting to aibspi(10.128.108.106):2181, use_ssl: False
12:57:45 PM:INFO:client:client.py:_session_callback:line 561:Zookeeper connection established, state: CONNECTED
12:57:46 PM:INFO:connection:connection.py:_connect_attempt:line 655:Closing connection to aibspi:2181
12:57:46 PM:INFO:client:client.py:_session_callback:line 567:Zookeeper session closed, state: CLOSED
12:57:46 PM:INFO:main:main.py:get_stage_widget:line 23:Getting Stage Controller Widget - 1.0.4.dev1+g5cafa8d.b163669
12:57:46 PM:INFO:stepper_motor_device:stepper_motor_device.py:__init__:line 52:Skipping COM3 - device may be being used by another program
12:57:46 PM:INFO:stepper_motor_device:stepper_motor_device.py:__init__:line 70:Connected to COM4, device id: 1130
12:57:46 PM:INFO:stepper_motor_device:stepper_motor_device.py:load_registers:line 151:Getting available registers on device
12:57:46 PM:WARNING:stepper_motor_device:stepper_motor_device.py:load_registers:line 159:Firmware version 0.5 doesn't match config version 0.7.
    Registers may be defined incorrectly
12:57:46 PM:INFO:stage_model:stage_model.py:configure_device:line 81:Configuring registers with default values (can be modified in config file)
12:57:46 PM:INFO:move_worker:move_worker.py:goto_origin:line 195:(move to origin): Moving stage to origin
12:57:46 PM:INFO:move_worker:move_worker.py:move_relative:line 337:(move relative): Moved motors by steps specified in [0, -27200, -27200, 0]
12:57:46 PM:INFO:move_worker:move_worker.py:move_relative:line 337:(move relative): Moved motors by steps specified in [-27200, 0, 0, 0]
12:57:46 PM:INFO:move_worker:move_worker.py:move_relative:line 337:(move relative): Moved motors by steps specified in [0, 0, 0, -27200]
12:57:46 PM:INFO:stage_model:stage_model.py:configure_device:line 87:Zeroed all motor positions
12:57:46 PM:INFO:stage_model:stage_model.py:configure_device:line 88:Finished configuring stepper motor device
#############################################################
12:57:46 PM:INFO:Foraging:Foraging.py:keyPressEvent:line 1901:processing parameter changes
12:57:46 PM:INFO:Foraging:Foraging.py:_StopPhotometry:line 3522:Checking that photometry is not running
12:57:46 PM:INFO:Foraging:Foraging.py:_StopPhotometry:line 3532:Photometry excitation stopped
12:57:46 PM:INFO:Foraging:Foraging.py:_load_most_recent_rig_json:line 1572:Found existing rig.json: rig_446-8-D_2024-12-17_14_12_12.json
12:57:46 PM:INFO:Foraging:Foraging.py:_ReconnectBonsai:line 1008:attempting to close bonsai connection
12:57:46 PM:INFO:Foraging:Foraging.py:_ReconnectBonsai:line 1016:bonsai connection closed
12:57:46 PM:INFO:Foraging:Foraging.py:_ReconnectBonsai:line 1018:attempting to restart bonsai
12:57:46 PM:INFO:Foraging:Foraging.py:_InitializeBonsai:line 1409:Trying to connect to already running Bonsai
12:57:46 PM:INFO:Foraging:Foraging.py:_ConnectOSC:line 1456:connecting to GUI and Bonsai through OSC
12:57:46 PM:INFO:Foraging:Foraging.py:_InitializeBonsai:line 1416:Connected to already running Bonsai
12:57:46 PM:INFO:Foraging:Foraging.py:_InitializeBonsai:line 1417:Bonsai started successfully
12:57:46 PM:INFO:Foraging:Foraging.py:__init__:line 243:Start up complete
12:57:48 PM:INFO:aws_util:aws_util.py:import_df_from_s3:line 115:Dataframe imported from s3://aind-behavior-data/foraging_nwb_bonsai_processed/df_sessions.pkl, len(df) = 10063
12:57:48 PM:INFO:aws_util:aws_util.py:import_df_from_s3:line 115:Dataframe imported from s3://aind-behavior-data/foraging_auto_training/df_manager_447_demo.pkl, len(df) = 4686
12:57:49 PM:INFO:aws_util:aws_util.py:download_dir_from_s3:line 140:134 objects downloaded from s3://aind-behavior-data/foraging_auto_training/saved_curriculums/ to C:\Users\svc_aind_behavior/capsule/scratch/saved_curriculums/
12:57:49 PM:INFO:curriculum_manager:curriculum_manager.py:download_curriculums:line 162:Found 26 curriculums in C:\Users\svc_aind_behavior/capsule/scratch/saved_curriculums/
12:57:50 PM:INFO:aws_util:aws_util.py:download_dir_from_s3:line 140:134 objects downloaded from s3://aind-behavior-data/foraging_auto_training/saved_curriculums/ to C:\Users\svc_aind_behavior/.aind_auto_train/curriculum_manager/
12:57:50 PM:INFO:curriculum_manager:curriculum_manager.py:download_curriculums:line 162:Found 26 curriculums in C:\Users\svc_aind_behavior/.aind_auto_train/curriculum_manager/
12:57:50 PM:INFO:Dialogs:Dialogs.py:update_auto_train_fields:line 2292:No entry found in df_training_manager for subject_id: 0
12:57:50 PM:INFO:Dialogs:Dialogs.py:_override_curriculum_clicked:line 2640:Override stage clicked: state=2
12:57:50 PM:INFO:Dialogs:Dialogs.py:_update_stage_to_apply:line 2666:Current stage to apply: unknown training stage @unknown curriculum
12:57:56 PM:INFO:move_worker:move_worker.py:move_to_preset_position:line 178:(move to preset position): Moving stage to preset initialize with coordinates [15, 16, 16, 12]
12:57:59 PM:INFO:move_worker:move_worker.py:move_absolute:line 307:(move absolute): Moved motors from [0, 0, 0, 0] to [0, 12800, 12800, 0]
12:58:03 PM:INFO:move_worker:move_worker.py:move_absolute:line 307:(move absolute): Moved motors from [0, 12800, 12800, 0] to [12000, 12800, 12800, 0]
12:58:05 PM:INFO:move_worker:move_worker.py:move_absolute:line 307:(move absolute): Moved motors from [12000, 12800, 12800, 0] to [12000, 12800, 12800, 9600]
12:59:28 PM:INFO:rigcontrol:rigcontrol.py:msg_handler:line 56:['/RightLickTime', 14318667.530752, '127.0.0.1', 4033]
01:00:45 PM:INFO:rigcontrol:rigcontrol.py:msg_handler:line 56:['/ManualLeftWaterStartTime', 14318744.348, '127.0.0.1', 4033]
01:00:45 PM:INFO:rigcontrol:rigcontrol.py:msg_handler:line 56:['/LeftRewardDeliveryTimeHarp', 14318744.350496, '127.0.0.1', 4033]
01:00:46 PM:INFO:rigcontrol:rigcontrol.py:msg_handler:line 56:['/ManualRightWaterStartTime', 14318744.825984, '127.0.0.1', 4033]
01:00:46 PM:INFO:rigcontrol:rigcontrol.py:msg_handler:line 56:['/RightRewardDeliveryTimeHarp', 14318744.82848, '127.0.0.1', 4033]
01:00:55 PM:INFO:rigcontrol:rigcontrol.py:msg_handler:line 56:['/ManualLeftWaterStartTime', 14318754.341984, '127.0.0.1', 4033]
01:00:55 PM:INFO:rigcontrol:rigcontrol.py:msg_handler:line 56:['/ManualLeftWaterStartTime', 14318754.342976, '127.0.0.1', 4033]
01:00:55 PM:INFO:rigcontrol:rigcontrol.py:msg_handler:line 56:['/LeftRewardDeliveryTimeHarp', 14318754.34448, '127.0.0.1', 4033]
01:00:55 PM:INFO:rigcontrol:rigcontrol.py:msg_handler:line 56:['/LeftRewardDeliveryTimeHarp', 14318754.345504, '127.0.0.1', 4033]
01:00:56 PM:INFO:rigcontrol:rigcontrol.py:msg_handler:line 56:['/ManualRightWaterStartTime', 14318754.824, '127.0.0.1', 4033]
01:00:56 PM:INFO:rigcontrol:rigcontrol.py:msg_handler:line 56:['/ManualRightWaterStartTime', 14318754.824, '127.0.0.1', 4033]
01:00:56 PM:INFO:rigcontrol:rigcontrol.py:msg_handler:line 56:['/RightRewardDeliveryTimeHarp', 14318754.825504, '127.0.0.1', 4033]
01:00:56 PM:INFO:rigcontrol:rigcontrol.py:msg_handler:line 56:['/RightRewardDeliveryTimeHarp', 14318754.826496, '127.0.0.1', 4033]
01:01:05 PM:INFO:rigcontrol:rigcontrol.py:msg_handler:line 56:['/ManualLeftWaterStartTime', 14318764.336992, '127.0.0.1', 4033]
01:01:05 PM:INFO:rigcontrol:rigcontrol.py:msg_handler:line 56:['/ManualLeftWaterStartTime', 14318764.336992, '127.0.0.1', 4033]
01:01:05 PM:INFO:rigcontrol:rigcontrol.py:msg_handler:line 56:['/LeftRewardDeliveryTimeHarp', 14318764.338496, '127.0.0.1', 4033]
01:01:05 PM:INFO:rigcontrol:rigcontrol.py:msg_handler:line 56:['/LeftRewardDeliveryTimeHarp', 14318764.339488, '127.0.0.1', 4033]
01:01:06 PM:INFO:rigcontrol:rigcontrol.py:msg_handler:line 56:['/ManualRightWaterStartTime', 14318764.824, '127.0.0.1', 4033]
01:01:06 PM:INFO:rigcontrol:rigcontrol.py:msg_handler:line 56:['/ManualRightWaterStartTime', 14318764.824, '127.0.0.1', 4033]
01:01:06 PM:INFO:rigcontrol:rigcontrol.py:msg_handler:line 56:['/RightRewardDeliveryTimeHarp', 14318764.826496, '127.0.0.1', 4033]
01:01:06 PM:INFO:rigcontrol:rigcontrol.py:msg_handler:line 56:['/RightRewardDeliveryTimeHarp', 14318764.827488, '127.0.0.1', 4033]
01:01:06 PM:INFO:Dialogs:Dialogs.py:_start_preview:line 1213:Camera is on
01:01:07 PM:ERROR:Foraging:Foraging.py:log_subprocess_output:line 4915:BONSAI: System.InvalidOperationException: Spinnaker camera with serial number 23347803 was not found.
@alexpiet alexpiet added the low priority - auto-generated autogenerated issues that have only occurred once label Dec 23, 2024
@ellahiltonvano
Copy link

@micahwoodard if Nathan replaced a camera a couple of weeks ago could that cause this?

8D was crashing a lot last week so fewer mice were run in there, not what was causing the problem

@XX-Yin
Copy link
Collaborator

XX-Yin commented Dec 23, 2024

The camera is not detected. One thing we can try is to restart the computer.

@alexpiet
Copy link
Collaborator Author

@ellahiltonvano This error message means that the updated camera serial number was not set in the Settings_box.csv file. Instructions for finding the serial number here: https://github.com/AllenNeuralDynamics/aind-behavior-blog/wiki/Computer-Configuration#if-using-high-speed-cameras

If the updated serial number if "23347803", and this problem persists, then we have a different issue. But I suspect thats the old serial number

@alexpiet
Copy link
Collaborator Author

This issue reoccurred:

file: Foraging.py
function: log_subprocess_output
line 4915
logfile: W10DT714688/W10DT714688-D_gui_log_2024-12-23_15-03-27.txt
boxes: 8D
count: 4
text: BONSAI: System.InvalidOperationException: Spinnaker camera with serial number 23347803 was not found.

GUI Log snippet (click for full log)

03:03:36 PM:INFO:Foraging:Foraging.py:_load_most_recent_rig_json:line 1572:Found existing rig.json: rig_446-8-D_2024-12-17_14_12_12.json
03:03:36 PM:INFO:Foraging:Foraging.py:_ReconnectBonsai:line 1008:attempting to close bonsai connection
03:03:38 PM:INFO:Foraging:Foraging.py:_ReconnectBonsai:line 1016:bonsai connection closed
03:03:38 PM:INFO:Foraging:Foraging.py:_ReconnectBonsai:line 1018:attempting to restart bonsai
03:03:38 PM:INFO:Foraging:Foraging.py:_InitializeBonsai:line 1409:Trying to connect to already running Bonsai
03:03:38 PM:INFO:Foraging:Foraging.py:_ConnectOSC:line 1456:connecting to GUI and Bonsai through OSC
03:03:38 PM:INFO:Foraging:Foraging.py:_InitializeBonsai:line 1416:Connected to already running Bonsai
03:03:38 PM:INFO:Foraging:Foraging.py:_InitializeBonsai:line 1417:Bonsai started successfully
03:03:38 PM:INFO:Foraging:Foraging.py:__init__:line 243:Start up complete
03:03:40 PM:INFO:aws_util:aws_util.py:import_df_from_s3:line 115:Dataframe imported from s3://aind-behavior-data/foraging_nwb_bonsai_processed/df_sessions.pkl, len(df) = 11636
03:03:41 PM:INFO:aws_util:aws_util.py:import_df_from_s3:line 115:Dataframe imported from s3://aind-behavior-data/foraging_auto_training/df_manager_447_demo.pkl, len(df) = 4708
03:03:42 PM:INFO:aws_util:aws_util.py:download_dir_from_s3:line 140:134 objects downloaded from s3://aind-behavior-data/foraging_auto_training/saved_curriculums/ to C:\Users\svc_aind_behavior/capsule/scratch/saved_curriculums/
03:03:42 PM:INFO:curriculum_manager:curriculum_manager.py:download_curriculums:line 162:Found 26 curriculums in C:\Users\svc_aind_behavior/capsule/scratch/saved_curriculums/
03:03:42 PM:INFO:aws_util:aws_util.py:download_dir_from_s3:line 140:134 objects downloaded from s3://aind-behavior-data/foraging_auto_training/saved_curriculums/ to C:\Users\svc_aind_behavior/.aind_auto_train/curriculum_manager/
03:03:42 PM:INFO:curriculum_manager:curriculum_manager.py:download_curriculums:line 162:Found 26 curriculums in C:\Users\svc_aind_behavior/.aind_auto_train/curriculum_manager/
03:03:42 PM:INFO:Dialogs:Dialogs.py:update_auto_train_fields:line 2292:No entry found in df_training_manager for subject_id: 0
03:03:42 PM:INFO:Dialogs:Dialogs.py:_override_curriculum_clicked:line 2640:Override stage clicked: state=2
03:03:42 PM:INFO:Dialogs:Dialogs.py:_update_stage_to_apply:line 2666:Current stage to apply: unknown training stage @unknown curriculum
03:28:12 PM:INFO:Dialogs:Dialogs.py:_start_preview:line 1213:Camera is on
03:28:12 PM:ERROR:Foraging:Foraging.py:log_subprocess_output:line 4915:BONSAI: System.InvalidOperationException: Spinnaker camera with serial number 23347803 was not found.
Full GUI log 
03:03:27 PM:INFO:Foraging:Foraging.py:start_gui_log_file:line 4796:Starting logfile!
03:03:29 PM:INFO:Foraging:Foraging.py:log_git_hash:line 4807:Python version: 3.11.9 | packaged by Anaconda, Inc. | (main, Apr 19 2024, 16:40:41) [MSC v.1916 64 bit (AMD64)]
03:03:29 PM:INFO:Foraging:Foraging.py:log_git_hash:line 4824:Current git commit branch, hash: main, 698fb9fecded812fcf96d570658d9bc3766b14c6
03:03:29 PM:INFO:Foraging:Foraging.py:log_git_hash:line 4828:Current foraging_gui version: 1.6.19
03:03:29 PM:WARNING:Foraging:Foraging.py:log_git_hash:line 4838:local repository is clean
03:03:29 PM:INFO:Foraging:Foraging.py:<module>:line 4944:Setting QApplication attributes
03:03:29 PM:INFO:Foraging:Foraging.py:<module>:line 4952:Starting QApplication and Window
03:03:29 PM:INFO:Foraging:Foraging.py:__init__:line 77:Creating Window
03:03:29 PM:INFO:Foraging:Foraging.py:_GetSettings:line 1211:Loaded settings_box file
03:03:29 PM:INFO:Foraging:Foraging.py:_GetSettings:line 1239:Loaded settings file
03:03:29 PM:WARNING:Foraging:Foraging.py:_GetSettings:line 1249:Missing setting (FIP_settings), using default: C:\Users\svc_aind_behavior\Documents\FIPSettings
03:03:29 PM:WARNING:Foraging:Foraging.py:_GetSettings:line 1249:Missing setting (bonsai_config_path), using default: C:\Users\svc_aind_behavior\Documents\GitHub\dynamic-foraging-task\bonsai\Bonsai.config
03:03:29 PM:WARNING:Foraging:Foraging.py:_GetSettings:line 1249:Missing setting (metadata_dialog_folder), using default: C:\Users\svc_aind_behavior\Documents\ForagingSettings\metadata_dialog\
03:03:29 PM:WARNING:Foraging:Foraging.py:_GetSettings:line 1249:Missing setting (rig_metadata_folder), using default: C:\Users\svc_aind_behavior\Documents\ForagingSettings\rig_metadata\
03:03:29 PM:WARNING:Foraging:Foraging.py:_GetSettings:line 1249:Missing setting (project_info_file), using default: C:\Users\svc_aind_behavior\Documents\ForagingSettings\Project Name and Funding Source v2.csv
03:03:29 PM:WARNING:Foraging:Foraging.py:_GetSettings:line 1249:Missing setting (schedule_path), using default: Z:\dynamic_foraging\DynamicForagingSchedule.csv
03:03:29 PM:WARNING:Foraging:Foraging.py:_GetSettings:line 1249:Missing setting (go_cue_decibel_box1), using default: 60
03:03:29 PM:WARNING:Foraging:Foraging.py:_GetSettings:line 1249:Missing setting (go_cue_decibel_box2), using default: 60
03:03:29 PM:WARNING:Foraging:Foraging.py:_GetSettings:line 1249:Missing setting (go_cue_decibel_box3), using default: 60
03:03:29 PM:WARNING:Foraging:Foraging.py:_GetSettings:line 1249:Missing setting (lick_spout_distance_box1), using default: 5000
03:03:29 PM:WARNING:Foraging:Foraging.py:_GetSettings:line 1249:Missing setting (lick_spout_distance_box2), using default: 5000
03:03:29 PM:WARNING:Foraging:Foraging.py:_GetSettings:line 1249:Missing setting (lick_spout_distance_box3), using default: 5000
03:03:29 PM:WARNING:Foraging:Foraging.py:_GetSettings:line 1249:Missing setting (lick_spout_distance_box4), using default: 5000
03:03:29 PM:WARNING:Foraging:Foraging.py:_GetSettings:line 1249:Missing setting (name_mapper_file), using default: C:\Users\svc_aind_behavior\Documents\ForagingSettings\name_mapper.json
03:03:29 PM:WARNING:Foraging:Foraging.py:_GetSettings:line 1249:Missing setting (create_rig_metadata), using default: True
03:03:29 PM:WARNING:Foraging:Foraging.py:_GetSettings:line 1249:Missing setting (AutomaticUpload), using default: True
03:03:29 PM:WARNING:Foraging:Foraging.py:_GetSettings:line 1249:Missing setting (manifest_flag_dir), using default: C:\Users\svc_aind_behavior\Documents\aind_watchdog_service\manifest
03:03:29 PM:WARNING:Foraging:Foraging.py:_GetSettings:line 1249:Missing setting (auto_engage), using default: True
03:03:29 PM:WARNING:Foraging:Foraging.py:_GetSettings:line 1249:Missing setting (clear_figure_after_save), using default: True
03:03:29 PM:WARNING:Foraging:Foraging.py:_GetSettings:line 1249:Missing setting (add_default_project_name), using default: True
03:03:29 PM:INFO:Foraging:Foraging.py:_LoadSchedule:line 1137:Loaded behavior schedule
03:03:29 PM:INFO:Foraging:Foraging.py:_GetWaterCalibration:line 1101:Loaded Water Calibration
03:03:29 PM:INFO:Foraging:Foraging.py:_load_most_recent_rig_json:line 1572:Found existing rig.json: rig_446-8-D_2024-12-17_14_12_12.json
03:03:29 PM:INFO:RigJsonBuilder:RigJsonBuilder.py:build_rig_json_core:line 60:building rig json
03:03:29 PM:INFO:RigJsonBuilder:RigJsonBuilder.py:build_rig_json_core:line 624:finished building rig json
03:03:29 PM:INFO:RigJsonBuilder:RigJsonBuilder.py:build_rig_json:line 53:Using existing rig json
03:03:29 PM:INFO:Foraging:Foraging.py:_LoadUI:line 299:Using ForagingGUI.ui interface
03:03:30 PM:INFO:Foraging:Foraging.py:__init__:line 143:Setting Window title: 446-8-D
03:03:30 PM:INFO:Foraging:Foraging.py:_InitializeBonsai:line 1409:Trying to connect to already running Bonsai
03:03:30 PM:INFO:Foraging:Foraging.py:_ConnectOSC:line 1456:connecting to GUI and Bonsai through OSC
03:03:31 PM:INFO:Foraging:Foraging.py:_InitializeBonsai:line 1413:Could not connect: timed out
03:03:31 PM:INFO:Foraging:Foraging.py:_InitializeBonsai:line 1422:Starting Bonsai
03:03:31 PM:INFO:Foraging:Foraging.py:log_subprocess_output:line 4911:BONSAI logging starting
03:03:31 PM:INFO:Foraging:Foraging.py:_ConnectOSC:line 1456:connecting to GUI and Bonsai through OSC
03:03:32 PM:INFO:Foraging:Foraging.py:_InitializeBonsai:line 1436:Could not connect, total waiting time 0.5 seconds: timed out
03:03:33 PM:INFO:Foraging:Foraging.py:_ConnectOSC:line 1456:connecting to GUI and Bonsai through OSC
03:03:34 PM:INFO:Foraging:Foraging.py:_InitializeBonsai:line 1436:Could not connect, total waiting time 1.0 seconds: timed out
03:03:34 PM:INFO:Foraging:Foraging.py:_ConnectOSC:line 1456:connecting to GUI and Bonsai through OSC
03:03:35 PM:INFO:Foraging:Foraging.py:_InitializeBonsai:line 1439:Connected to Bonsai after 1.5 seconds
03:03:35 PM:INFO:Foraging:Foraging.py:_InitializeBonsai:line 1440:Bonsai started successfully
03:03:35 PM:INFO:rigcontrol:rigcontrol.py:msg_handler:line 52:['/PhotometryFalling', 14585313.677536, '127.0.0.1', 4033], displaying at 0.5 Hz
03:03:35 PM:INFO:Foraging:Foraging.py:_ConnectSlims:line 1318:Attempting to connect to Slims
03:03:35 PM:INFO:rigcontrol:rigcontrol.py:msg_handler:line 56:['/RightRewardDeliveryTimeHarp', 14585313.685504, '127.0.0.1', 4033]
03:03:35 PM:INFO:Foraging:Foraging.py:_ConnectSlims:line 1335:Successfully connected to Slims
03:03:35 PM:WARNING:Dialogs:Dialogs.py:_LoadCalibrationParameters:line 480:could not find water calibration parameters: C:\Users\svc_aind_behavior\Documents\ForagingSettings\WaterCalibrationPar_4.json
03:03:36 PM:INFO:Foraging:Foraging.py:_InitializeMotorStage:line 912:Scanning for newscale stages
03:03:36 PM:INFO:Foraging:Foraging.py:_InitializeMotorStage:line 922:Could not find any instances of NewScale Stage
03:03:36 PM:INFO:Foraging:Foraging.py:_insert_stage_widget:line 279:Inserting Stage Widget
03:03:36 PM:INFO:connection:connection.py:_connect:line 688:Connecting to aibspi(10.128.108.106):2181, use_ssl: False
03:03:36 PM:INFO:client:client.py:_session_callback:line 561:Zookeeper connection established, state: CONNECTED
03:03:36 PM:INFO:connection:connection.py:_connect_attempt:line 655:Closing connection to aibspi:2181
03:03:36 PM:INFO:client:client.py:_session_callback:line 567:Zookeeper session closed, state: CLOSED
03:03:36 PM:INFO:main:main.py:get_stage_widget:line 23:Getting Stage Controller Widget - 1.0.4.dev1+g5cafa8d.b163669
03:03:36 PM:INFO:stepper_motor_device:stepper_motor_device.py:__init__:line 52:Skipping COM3 - device may be being used by another program
03:03:36 PM:INFO:stepper_motor_device:stepper_motor_device.py:__init__:line 70:Connected to COM4, device id: 1130
03:03:36 PM:INFO:stepper_motor_device:stepper_motor_device.py:load_registers:line 151:Getting available registers on device
03:03:36 PM:WARNING:stepper_motor_device:stepper_motor_device.py:load_registers:line 159:Firmware version 0.5 doesn't match config version 0.7.
    Registers may be defined incorrectly
03:03:36 PM:INFO:stage_model:stage_model.py:configure_device:line 81:Configuring registers with default values (can be modified in config file)
03:03:36 PM:INFO:move_worker:move_worker.py:goto_origin:line 195:(move to origin): Moving stage to origin
03:03:36 PM:INFO:move_worker:move_worker.py:move_relative:line 337:(move relative): Moved motors by steps specified in [0, -27200, -27200, 0]
03:03:36 PM:INFO:move_worker:move_worker.py:move_relative:line 337:(move relative): Moved motors by steps specified in [-27200, 0, 0, 0]
03:03:36 PM:INFO:move_worker:move_worker.py:move_relative:line 337:(move relative): Moved motors by steps specified in [0, 0, 0, -27200]
03:03:36 PM:INFO:stage_model:stage_model.py:configure_device:line 87:Zeroed all motor positions
03:03:36 PM:INFO:stage_model:stage_model.py:configure_device:line 88:Finished configuring stepper motor device
#############################################################
03:03:36 PM:INFO:Foraging:Foraging.py:keyPressEvent:line 1901:processing parameter changes
03:03:36 PM:INFO:Foraging:Foraging.py:_StopPhotometry:line 3522:Checking that photometry is not running
03:03:36 PM:INFO:Foraging:Foraging.py:_StopPhotometry:line 3532:Photometry excitation stopped
03:03:36 PM:INFO:Foraging:Foraging.py:_load_most_recent_rig_json:line 1572:Found existing rig.json: rig_446-8-D_2024-12-17_14_12_12.json
03:03:36 PM:INFO:Foraging:Foraging.py:_ReconnectBonsai:line 1008:attempting to close bonsai connection
03:03:38 PM:INFO:Foraging:Foraging.py:_ReconnectBonsai:line 1016:bonsai connection closed
03:03:38 PM:INFO:Foraging:Foraging.py:_ReconnectBonsai:line 1018:attempting to restart bonsai
03:03:38 PM:INFO:Foraging:Foraging.py:_InitializeBonsai:line 1409:Trying to connect to already running Bonsai
03:03:38 PM:INFO:Foraging:Foraging.py:_ConnectOSC:line 1456:connecting to GUI and Bonsai through OSC
03:03:38 PM:INFO:Foraging:Foraging.py:_InitializeBonsai:line 1416:Connected to already running Bonsai
03:03:38 PM:INFO:Foraging:Foraging.py:_InitializeBonsai:line 1417:Bonsai started successfully
03:03:38 PM:INFO:Foraging:Foraging.py:__init__:line 243:Start up complete
03:03:40 PM:INFO:aws_util:aws_util.py:import_df_from_s3:line 115:Dataframe imported from s3://aind-behavior-data/foraging_nwb_bonsai_processed/df_sessions.pkl, len(df) = 11636
03:03:41 PM:INFO:aws_util:aws_util.py:import_df_from_s3:line 115:Dataframe imported from s3://aind-behavior-data/foraging_auto_training/df_manager_447_demo.pkl, len(df) = 4708
03:03:42 PM:INFO:aws_util:aws_util.py:download_dir_from_s3:line 140:134 objects downloaded from s3://aind-behavior-data/foraging_auto_training/saved_curriculums/ to C:\Users\svc_aind_behavior/capsule/scratch/saved_curriculums/
03:03:42 PM:INFO:curriculum_manager:curriculum_manager.py:download_curriculums:line 162:Found 26 curriculums in C:\Users\svc_aind_behavior/capsule/scratch/saved_curriculums/
03:03:42 PM:INFO:aws_util:aws_util.py:download_dir_from_s3:line 140:134 objects downloaded from s3://aind-behavior-data/foraging_auto_training/saved_curriculums/ to C:\Users\svc_aind_behavior/.aind_auto_train/curriculum_manager/
03:03:42 PM:INFO:curriculum_manager:curriculum_manager.py:download_curriculums:line 162:Found 26 curriculums in C:\Users\svc_aind_behavior/.aind_auto_train/curriculum_manager/
03:03:42 PM:INFO:Dialogs:Dialogs.py:update_auto_train_fields:line 2292:No entry found in df_training_manager for subject_id: 0
03:03:42 PM:INFO:Dialogs:Dialogs.py:_override_curriculum_clicked:line 2640:Override stage clicked: state=2
03:03:42 PM:INFO:Dialogs:Dialogs.py:_update_stage_to_apply:line 2666:Current stage to apply: unknown training stage @unknown curriculum
03:28:12 PM:INFO:Dialogs:Dialogs.py:_start_preview:line 1213:Camera is on
03:28:12 PM:ERROR:Foraging:Foraging.py:log_subprocess_output:line 4915:BONSAI: System.InvalidOperationException: Spinnaker camera with serial number 23347803 was not found.

@alexpiet alexpiet added medium priority - auto-generated autogenerated issues that have occurred more than once in a month and removed low priority - auto-generated autogenerated issues that have only occurred once labels Dec 24, 2024
@alexpiet
Copy link
Collaborator Author

This issue reoccurred:

file: Foraging.py
function: log_subprocess_output
line 4915
logfile: W10DT714688/W10DT714688-D_gui_log_2024-12-28_13-32-50.txt
boxes: 8D
count: 1
text: BONSAI: System.InvalidOperationException: Spinnaker camera with serial number 23347803 was not found.

GUI Log snippet (click for full log)

01:33:00 PM:INFO:Foraging:Foraging.py:_load_most_recent_rig_json:line 1572:Found existing rig.json: rig_446-8-D_2024-12-17_14_12_12.json
01:33:00 PM:INFO:Foraging:Foraging.py:_ReconnectBonsai:line 1008:attempting to close bonsai connection
01:33:00 PM:INFO:Foraging:Foraging.py:_ReconnectBonsai:line 1016:bonsai connection closed
01:33:00 PM:INFO:Foraging:Foraging.py:_ReconnectBonsai:line 1018:attempting to restart bonsai
01:33:00 PM:INFO:Foraging:Foraging.py:_InitializeBonsai:line 1409:Trying to connect to already running Bonsai
01:33:00 PM:INFO:Foraging:Foraging.py:_ConnectOSC:line 1456:connecting to GUI and Bonsai through OSC
01:33:00 PM:INFO:Foraging:Foraging.py:_InitializeBonsai:line 1416:Connected to already running Bonsai
01:33:00 PM:INFO:Foraging:Foraging.py:_InitializeBonsai:line 1417:Bonsai started successfully
01:33:00 PM:INFO:Foraging:Foraging.py:__init__:line 243:Start up complete
01:33:02 PM:INFO:aws_util:aws_util.py:import_df_from_s3:line 115:Dataframe imported from s3://aind-behavior-data/foraging_nwb_bonsai_processed/df_sessions.pkl, len(df) = 12699
01:33:02 PM:INFO:aws_util:aws_util.py:import_df_from_s3:line 115:Dataframe imported from s3://aind-behavior-data/foraging_auto_training/df_manager_447_demo.pkl, len(df) = 4740
01:33:03 PM:INFO:aws_util:aws_util.py:download_dir_from_s3:line 140:134 objects downloaded from s3://aind-behavior-data/foraging_auto_training/saved_curriculums/ to C:\Users\svc_aind_behavior/capsule/scratch/saved_curriculums/
01:33:03 PM:INFO:curriculum_manager:curriculum_manager.py:download_curriculums:line 162:Found 26 curriculums in C:\Users\svc_aind_behavior/capsule/scratch/saved_curriculums/
01:33:03 PM:INFO:aws_util:aws_util.py:download_dir_from_s3:line 140:134 objects downloaded from s3://aind-behavior-data/foraging_auto_training/saved_curriculums/ to C:\Users\svc_aind_behavior/.aind_auto_train/curriculum_manager/
01:33:03 PM:INFO:curriculum_manager:curriculum_manager.py:download_curriculums:line 162:Found 26 curriculums in C:\Users\svc_aind_behavior/.aind_auto_train/curriculum_manager/
01:33:03 PM:INFO:Dialogs:Dialogs.py:update_auto_train_fields:line 2292:No entry found in df_training_manager for subject_id: 0
01:33:03 PM:INFO:Dialogs:Dialogs.py:_override_curriculum_clicked:line 2640:Override stage clicked: state=2
01:33:03 PM:INFO:Dialogs:Dialogs.py:_update_stage_to_apply:line 2666:Current stage to apply: unknown training stage @unknown curriculum
01:34:06 PM:INFO:Dialogs:Dialogs.py:_start_preview:line 1213:Camera is on
01:34:06 PM:ERROR:Foraging:Foraging.py:log_subprocess_output:line 4915:BONSAI: System.InvalidOperationException: Spinnaker camera with serial number 23347803 was not found.
Full GUI log 
01:32:50 PM:INFO:Foraging:Foraging.py:start_gui_log_file:line 4796:Starting logfile!
01:32:52 PM:INFO:Foraging:Foraging.py:log_git_hash:line 4807:Python version: 3.11.9 | packaged by Anaconda, Inc. | (main, Apr 19 2024, 16:40:41) [MSC v.1916 64 bit (AMD64)]
01:32:52 PM:INFO:Foraging:Foraging.py:log_git_hash:line 4824:Current git commit branch, hash: main, 698fb9fecded812fcf96d570658d9bc3766b14c6
01:32:52 PM:INFO:Foraging:Foraging.py:log_git_hash:line 4828:Current foraging_gui version: 1.6.19
01:32:52 PM:WARNING:Foraging:Foraging.py:log_git_hash:line 4838:local repository is clean
01:32:52 PM:INFO:Foraging:Foraging.py:<module>:line 4944:Setting QApplication attributes
01:32:52 PM:INFO:Foraging:Foraging.py:<module>:line 4952:Starting QApplication and Window
01:32:52 PM:INFO:Foraging:Foraging.py:__init__:line 77:Creating Window
01:32:52 PM:INFO:Foraging:Foraging.py:_GetSettings:line 1211:Loaded settings_box file
01:32:52 PM:INFO:Foraging:Foraging.py:_GetSettings:line 1239:Loaded settings file
01:32:52 PM:WARNING:Foraging:Foraging.py:_GetSettings:line 1249:Missing setting (FIP_settings), using default: C:\Users\svc_aind_behavior\Documents\FIPSettings
01:32:52 PM:WARNING:Foraging:Foraging.py:_GetSettings:line 1249:Missing setting (bonsai_config_path), using default: C:\Users\svc_aind_behavior\Documents\GitHub\dynamic-foraging-task\bonsai\Bonsai.config
01:32:52 PM:WARNING:Foraging:Foraging.py:_GetSettings:line 1249:Missing setting (metadata_dialog_folder), using default: C:\Users\svc_aind_behavior\Documents\ForagingSettings\metadata_dialog\
01:32:52 PM:WARNING:Foraging:Foraging.py:_GetSettings:line 1249:Missing setting (rig_metadata_folder), using default: C:\Users\svc_aind_behavior\Documents\ForagingSettings\rig_metadata\
01:32:52 PM:WARNING:Foraging:Foraging.py:_GetSettings:line 1249:Missing setting (project_info_file), using default: C:\Users\svc_aind_behavior\Documents\ForagingSettings\Project Name and Funding Source v2.csv
01:32:52 PM:WARNING:Foraging:Foraging.py:_GetSettings:line 1249:Missing setting (schedule_path), using default: Z:\dynamic_foraging\DynamicForagingSchedule.csv
01:32:52 PM:WARNING:Foraging:Foraging.py:_GetSettings:line 1249:Missing setting (go_cue_decibel_box1), using default: 60
01:32:52 PM:WARNING:Foraging:Foraging.py:_GetSettings:line 1249:Missing setting (go_cue_decibel_box2), using default: 60
01:32:52 PM:WARNING:Foraging:Foraging.py:_GetSettings:line 1249:Missing setting (go_cue_decibel_box3), using default: 60
01:32:52 PM:WARNING:Foraging:Foraging.py:_GetSettings:line 1249:Missing setting (lick_spout_distance_box1), using default: 5000
01:32:52 PM:WARNING:Foraging:Foraging.py:_GetSettings:line 1249:Missing setting (lick_spout_distance_box2), using default: 5000
01:32:52 PM:WARNING:Foraging:Foraging.py:_GetSettings:line 1249:Missing setting (lick_spout_distance_box3), using default: 5000
01:32:52 PM:WARNING:Foraging:Foraging.py:_GetSettings:line 1249:Missing setting (lick_spout_distance_box4), using default: 5000
01:32:52 PM:WARNING:Foraging:Foraging.py:_GetSettings:line 1249:Missing setting (name_mapper_file), using default: C:\Users\svc_aind_behavior\Documents\ForagingSettings\name_mapper.json
01:32:52 PM:WARNING:Foraging:Foraging.py:_GetSettings:line 1249:Missing setting (create_rig_metadata), using default: True
01:32:53 PM:WARNING:Foraging:Foraging.py:_GetSettings:line 1249:Missing setting (AutomaticUpload), using default: True
01:32:53 PM:WARNING:Foraging:Foraging.py:_GetSettings:line 1249:Missing setting (manifest_flag_dir), using default: C:\Users\svc_aind_behavior\Documents\aind_watchdog_service\manifest
01:32:53 PM:WARNING:Foraging:Foraging.py:_GetSettings:line 1249:Missing setting (auto_engage), using default: True
01:32:53 PM:WARNING:Foraging:Foraging.py:_GetSettings:line 1249:Missing setting (clear_figure_after_save), using default: True
01:32:53 PM:WARNING:Foraging:Foraging.py:_GetSettings:line 1249:Missing setting (add_default_project_name), using default: True
01:32:53 PM:INFO:Foraging:Foraging.py:_LoadSchedule:line 1137:Loaded behavior schedule
01:32:53 PM:INFO:Foraging:Foraging.py:_GetWaterCalibration:line 1101:Loaded Water Calibration
01:32:53 PM:INFO:Foraging:Foraging.py:_load_most_recent_rig_json:line 1572:Found existing rig.json: rig_446-8-D_2024-12-17_14_12_12.json
01:32:53 PM:INFO:RigJsonBuilder:RigJsonBuilder.py:build_rig_json_core:line 60:building rig json
01:32:53 PM:INFO:RigJsonBuilder:RigJsonBuilder.py:build_rig_json_core:line 624:finished building rig json
01:32:53 PM:INFO:RigJsonBuilder:RigJsonBuilder.py:build_rig_json:line 53:Using existing rig json
01:32:53 PM:INFO:Foraging:Foraging.py:_LoadUI:line 299:Using ForagingGUI.ui interface
01:32:53 PM:INFO:Foraging:Foraging.py:__init__:line 143:Setting Window title: 446-8-D
01:32:53 PM:INFO:Foraging:Foraging.py:_InitializeBonsai:line 1409:Trying to connect to already running Bonsai
01:32:53 PM:INFO:Foraging:Foraging.py:_ConnectOSC:line 1456:connecting to GUI and Bonsai through OSC
01:32:54 PM:INFO:Foraging:Foraging.py:_InitializeBonsai:line 1413:Could not connect: timed out
01:32:54 PM:INFO:Foraging:Foraging.py:_InitializeBonsai:line 1422:Starting Bonsai
01:32:54 PM:INFO:Foraging:Foraging.py:log_subprocess_output:line 4911:BONSAI logging starting
01:32:54 PM:INFO:Foraging:Foraging.py:_ConnectOSC:line 1456:connecting to GUI and Bonsai through OSC
01:32:55 PM:INFO:Foraging:Foraging.py:_InitializeBonsai:line 1436:Could not connect, total waiting time 0.5 seconds: timed out
01:32:56 PM:INFO:Foraging:Foraging.py:_ConnectOSC:line 1456:connecting to GUI and Bonsai through OSC
01:32:57 PM:INFO:Foraging:Foraging.py:_InitializeBonsai:line 1436:Could not connect, total waiting time 1.0 seconds: timed out
01:32:57 PM:INFO:Foraging:Foraging.py:_ConnectOSC:line 1456:connecting to GUI and Bonsai through OSC
01:32:58 PM:INFO:Foraging:Foraging.py:_InitializeBonsai:line 1439:Connected to Bonsai after 1.5 seconds
01:32:58 PM:INFO:Foraging:Foraging.py:_InitializeBonsai:line 1440:Bonsai started successfully
01:32:58 PM:INFO:Foraging:Foraging.py:_ConnectSlims:line 1318:Attempting to connect to Slims
01:32:59 PM:INFO:Foraging:Foraging.py:_ConnectSlims:line 1335:Successfully connected to Slims
01:32:59 PM:WARNING:Dialogs:Dialogs.py:_LoadCalibrationParameters:line 480:could not find water calibration parameters: C:\Users\svc_aind_behavior\Documents\ForagingSettings\WaterCalibrationPar_4.json
01:32:59 PM:INFO:Foraging:Foraging.py:_InitializeMotorStage:line 912:Scanning for newscale stages
01:32:59 PM:INFO:Foraging:Foraging.py:_InitializeMotorStage:line 922:Could not find any instances of NewScale Stage
01:32:59 PM:INFO:Foraging:Foraging.py:_insert_stage_widget:line 279:Inserting Stage Widget
01:32:59 PM:INFO:connection:connection.py:_connect:line 688:Connecting to aibspi(10.128.108.106):2181, use_ssl: False
01:32:59 PM:INFO:client:client.py:_session_callback:line 561:Zookeeper connection established, state: CONNECTED
01:32:59 PM:INFO:connection:connection.py:_connect_attempt:line 655:Closing connection to aibspi:2181
01:32:59 PM:INFO:client:client.py:_session_callback:line 567:Zookeeper session closed, state: CLOSED
01:32:59 PM:INFO:main:main.py:get_stage_widget:line 23:Getting Stage Controller Widget - 1.0.4.dev1+g5cafa8d.b163669
01:32:59 PM:INFO:stepper_motor_device:stepper_motor_device.py:__init__:line 52:Skipping COM3 - device may be being used by another program
01:32:59 PM:INFO:stepper_motor_device:stepper_motor_device.py:__init__:line 70:Connected to COM4, device id: 1130
01:32:59 PM:INFO:stepper_motor_device:stepper_motor_device.py:load_registers:line 151:Getting available registers on device
01:32:59 PM:WARNING:stepper_motor_device:stepper_motor_device.py:load_registers:line 159:Firmware version 0.5 doesn't match config version 0.7.
    Registers may be defined incorrectly
01:32:59 PM:INFO:stage_model:stage_model.py:configure_device:line 81:Configuring registers with default values (can be modified in config file)
01:32:59 PM:INFO:move_worker:move_worker.py:goto_origin:line 195:(move to origin): Moving stage to origin
01:32:59 PM:INFO:move_worker:move_worker.py:move_relative:line 337:(move relative): Moved motors by steps specified in [0, -27200, -27200, 0]
01:32:59 PM:INFO:move_worker:move_worker.py:move_relative:line 337:(move relative): Moved motors by steps specified in [-27200, 0, 0, 0]
01:32:59 PM:INFO:move_worker:move_worker.py:move_relative:line 337:(move relative): Moved motors by steps specified in [0, 0, 0, -27200]
01:32:59 PM:INFO:stage_model:stage_model.py:configure_device:line 87:Zeroed all motor positions
01:32:59 PM:INFO:stage_model:stage_model.py:configure_device:line 88:Finished configuring stepper motor device
#############################################################
01:32:59 PM:INFO:Foraging:Foraging.py:keyPressEvent:line 1901:processing parameter changes
01:33:00 PM:INFO:Foraging:Foraging.py:_StopPhotometry:line 3522:Checking that photometry is not running
01:33:00 PM:INFO:Foraging:Foraging.py:_StopPhotometry:line 3532:Photometry excitation stopped
01:33:00 PM:INFO:Foraging:Foraging.py:_load_most_recent_rig_json:line 1572:Found existing rig.json: rig_446-8-D_2024-12-17_14_12_12.json
01:33:00 PM:INFO:Foraging:Foraging.py:_ReconnectBonsai:line 1008:attempting to close bonsai connection
01:33:00 PM:INFO:Foraging:Foraging.py:_ReconnectBonsai:line 1016:bonsai connection closed
01:33:00 PM:INFO:Foraging:Foraging.py:_ReconnectBonsai:line 1018:attempting to restart bonsai
01:33:00 PM:INFO:Foraging:Foraging.py:_InitializeBonsai:line 1409:Trying to connect to already running Bonsai
01:33:00 PM:INFO:Foraging:Foraging.py:_ConnectOSC:line 1456:connecting to GUI and Bonsai through OSC
01:33:00 PM:INFO:Foraging:Foraging.py:_InitializeBonsai:line 1416:Connected to already running Bonsai
01:33:00 PM:INFO:Foraging:Foraging.py:_InitializeBonsai:line 1417:Bonsai started successfully
01:33:00 PM:INFO:Foraging:Foraging.py:__init__:line 243:Start up complete
01:33:02 PM:INFO:aws_util:aws_util.py:import_df_from_s3:line 115:Dataframe imported from s3://aind-behavior-data/foraging_nwb_bonsai_processed/df_sessions.pkl, len(df) = 12699
01:33:02 PM:INFO:aws_util:aws_util.py:import_df_from_s3:line 115:Dataframe imported from s3://aind-behavior-data/foraging_auto_training/df_manager_447_demo.pkl, len(df) = 4740
01:33:03 PM:INFO:aws_util:aws_util.py:download_dir_from_s3:line 140:134 objects downloaded from s3://aind-behavior-data/foraging_auto_training/saved_curriculums/ to C:\Users\svc_aind_behavior/capsule/scratch/saved_curriculums/
01:33:03 PM:INFO:curriculum_manager:curriculum_manager.py:download_curriculums:line 162:Found 26 curriculums in C:\Users\svc_aind_behavior/capsule/scratch/saved_curriculums/
01:33:03 PM:INFO:aws_util:aws_util.py:download_dir_from_s3:line 140:134 objects downloaded from s3://aind-behavior-data/foraging_auto_training/saved_curriculums/ to C:\Users\svc_aind_behavior/.aind_auto_train/curriculum_manager/
01:33:03 PM:INFO:curriculum_manager:curriculum_manager.py:download_curriculums:line 162:Found 26 curriculums in C:\Users\svc_aind_behavior/.aind_auto_train/curriculum_manager/
01:33:03 PM:INFO:Dialogs:Dialogs.py:update_auto_train_fields:line 2292:No entry found in df_training_manager for subject_id: 0
01:33:03 PM:INFO:Dialogs:Dialogs.py:_override_curriculum_clicked:line 2640:Override stage clicked: state=2
01:33:03 PM:INFO:Dialogs:Dialogs.py:_update_stage_to_apply:line 2666:Current stage to apply: unknown training stage @unknown curriculum
01:34:06 PM:INFO:Dialogs:Dialogs.py:_start_preview:line 1213:Camera is on
01:34:06 PM:ERROR:Foraging:Foraging.py:log_subprocess_output:line 4915:BONSAI: System.InvalidOperationException: Spinnaker camera with serial number 23347803 was not found.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
medium priority - auto-generated autogenerated issues that have occurred more than once in a month
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@alexpiet @XX-Yin @ellahiltonvano