Telescope Array (TA) cosmic ray observatory fluorescence detector (FD) sites have passed 10 years of operation. In order to select nights for further analysis, clear nights should be distinguished from cloudy or noisy nights in the FD data. Weather observations during the night are recorded every hour while the FDs are collecting data by on-site operators at the Middle Drum site. However a more robust and uniform weather classification method is desired for flagging bad weather in the FD data. A series of snapshots of the night sky was created using the detector’s photomultiplier tubes (PMTs) pedestals. We classified the night’s weather using the PMTs pedestal snapshots using a Recurrent Convolution Neural Network (RCNN).