trw.callbacks.callback_reporting_dataset_summary

Module Contents

Classes

CallbackReportingDatasetSummary

Summarizes the data (min value, max value, number of batches, shapes) for each split of each dataset

Functions

_data_summary(datasets, max_nb_samples=None)

param datasets

the datasets

Attributes

logger

trw.callbacks.callback_reporting_dataset_summary.logger
trw.callbacks.callback_reporting_dataset_summary._data_summary(datasets, max_nb_samples=None)
Parameters

  • datasets – the datasets

  • max_nb_samples – if None, go through all the batches of a sequence, else only consider max_nb_samples to generate the statistics

Returns

dict to be interpreted as a table with columns (dataset, split, shape, max, min, mean, std, nb_batches)

class trw.callbacks.callback_reporting_dataset_summary.CallbackReportingDatasetSummary(max_nb_samples=None, table_name='data_summary')

Bases: trw.callbacks.callback.Callback

Summarizes the data (min value, max value, number of batches, shapes) for each split of each dataset

first_epoch(self, options)
__call__(self, options, history, model, losses, outputs, datasets, datasets_infos, callbacks_per_batch, **kwargs)