- Joined
- 9/13/23
- Messages
- 3
- Points
- 3
Fellow neural network enthusiasts
What’s the difference between ReLU and Leaky ReLU? Between binary cross-entropy, Huber loss and Poisson NLL? Between a learning rate of 0.01 and 0.001?
Does it really matter so long as you pick the right ones for your model?
I’m excited to put up this Python code aimed at simplifying this process of iterating through your desired hyperparameters. Modify the config.py file and the system manages the comprehensive search through potential configurations—either exhaustively via grid search or more selectively through random search; its multithreading functionality reduces compute time.
The repository includes sample stock data and optimizes towards precision p-value, critical for investing.
Code on GitHub
What’s the difference between ReLU and Leaky ReLU? Between binary cross-entropy, Huber loss and Poisson NLL? Between a learning rate of 0.01 and 0.001?
Does it really matter so long as you pick the right ones for your model?
I’m excited to put up this Python code aimed at simplifying this process of iterating through your desired hyperparameters. Modify the config.py file and the system manages the comprehensive search through potential configurations—either exhaustively via grid search or more selectively through random search; its multithreading functionality reduces compute time.
The repository includes sample stock data and optimizes towards precision p-value, critical for investing.
Code on GitHub