Mgiyuk

HDF5 reading and fit_generator multiprocessing error I'm trying to multiprocess the fit_generator. These are the problems that I face. trainable_model.fit_generator(load_random_cached_bottlenecks(BATCH_SIZE, label_map, training_addr_label_map, train_npy_dir, 'h5py', h5py_file_train),epochs = EPOCHS, steps_per_epoch=iterations_per_epoch_t, validation_data = load_random_cached_bottlenecks(BATCH_SIZE, label_map, validation_addr_label_map, val_npy_dir, 'h5py', h5py_file_val), validation_steps=iterations_per_epoch_v, workers = 1, callbacks = callback_list, use_multiprocessing = True, max_queue_size = 32) The main arguments that are causing problem: workers and use_multiprocessing . workers use_multiprocessing When worker=1 , use_multiprocessing=True/False runs with no problem. worker=1 use_multiprocessing=True/False If workers=5 , use_multiprocessing=True its throwing errors. The weird thing is its running, but at some random iteration I'm getting errors like work...