verne.freenode.net changed the topic of #mlpack to: http://www.mlpack.org/ -- We don't respond instantly... but we will respond. Give it a few minutes. Or hours. -- Channel logs: http://www.mlpack.org/irc/
< nishu>
I'm new to this platform and want to contribute in whatever way I can
< nishu>
I read about your company and would like to comtribute something in it
nate23 has joined #mlpack
nate23 has quit [Ping timeout: 260 seconds]
nishu has quit [Quit: Page closed]
kris has joined #mlpack
< kris>
i was implementing a new initialization method for weights of a ann namely sqrt(6/fanin + fanout)
< kris>
how should i get the fanin and fanout values.
nish21 has joined #mlpack
mikeling has quit [Quit: Connection closed for inactivity]
vivekp has quit [Ping timeout: 260 seconds]
vivekp has joined #mlpack
< zoq>
kris: I guess fanin is the number of units in the lower layer and fanout is the number of units in the upper layer. So the initialization method needs to know the model structure. I think one way would be to call the method with the model to be initialized.
< zoq>
kris: Something like this: initializeRule.Initialize(parameter, parameter.n_elem, 1, network); and in the initialization method: void Initialize(arma::Mat<eT>& W, const size_t rows, const size_t cols, std::vector<LayerTypes>& network)
< zoq>
To get the input and output size you could use the ParametersVisitor class:
< nish21>
zoq: i was thinking about implementing some more optimizers, we already have rmsprop, adam etc. What do you think about adding FTRL?
< zoq>
nish21: Hello, I haven't really looked into FTRL but I remember it's like the online gradient descent method, not sure that's right. If you like to implement the optimizer I'm happy to take a look over the PR.
< nish21>
zoq: okay, i'll work on it and open a pr soon.
< zoq>
nish21: Sounds good.
< kris>
Thanks zoq. Right now implementing the gaussian initialization for weights which has not implemented yet after that i would look into Xavier initialization method.
< zoq>
kris: Nice, let me know if you need any help.
ftuesca has joined #mlpack
ftuesca has quit [Client Quit]
mikeling has joined #mlpack
nish21 has quit [Ping timeout: 260 seconds]
< rcurtin>
zoq: I like that one too, it's very satisfying to watch :)
< rcurtin>
do you have any more comments about the decision tree PR, or should I go ahead and merge that one?
< zoq>
rcurtin: Looks good for me, btw. really nice test suite.
< rcurtin>
yeah, I built the tests as I made each piece, so it was easy to put it all together in the end and know it worked
travis-ci has joined #mlpack
< travis-ci>
mlpack/mlpack#1828 (master - 3e74746 : Ryan Curtin): The build was broken.