trw.hparams.params_optimizer_hyperband

Module Contents

Classes

HyperParametersOptimizerHyperband

Implementation of Hyperband: a novel bandit based approach to hyper-parameter optimization

Functions

log_hyperband(msg)

Attributes

logger

trw.hparams.params_optimizer_hyperband.logger
trw.hparams.params_optimizer_hyperband.log_hyperband(msg)
class trw.hparams.params_optimizer_hyperband.HyperParametersOptimizerHyperband(evaluate_hparams_fn, result_prefix='', max_iter=81, eta=3, repeat=100, log_string=log_hyperband, always_include_default_hparams_in_each_cycle=True)

Implementation of Hyperband: a novel bandit based approach to hyper-parameter optimization https://arxiv.org/abs/1603.06560

def evaluate_hparams(hparams, nb_epochs):

# evaluate an hyper-parameter configuration and return a loss value and some additional information # e.g., result report return 0.0, {}

_repeat_one(self, result_path, hyper_parameters, repeat_id, nb_runs)

Run full Hyperband search :param result_path: :return: the last round of configurations

optimize(self, result_path)

Optimize the hyper parameters using Hyperband

Parameters

result_path – where to save the information of each run. Can be None, in this case nothing is exported.

Returns

the results of all the runs