mlpack IRC logs, 2018-02-06

Logs for the day 2018-02-06 (starts at 0:00 UTC) are shown below.

>
February 2018
Sun
Mon
Tue
Wed
Thu
Fri
Sat
 
 
 
 
1
2
3
4
5
6
7
8
9
17
18
19
20
21
22
23
24
25
26
27
28
--- Log opened Tue Feb 06 00:00:00 2018
00:59 -!- govg [~govg@unaffiliated/govg] has quit [Ping timeout: 260 seconds]
03:57 -!- govg [~govg@unaffiliated/govg] has joined #mlpack
05:47 -!- daivik [7d10a738@gateway/web/cgi-irc/kiwiirc.com/ip.125.16.167.56] has joined #mlpack
06:30 -!- daivik [7d10a738@gateway/web/cgi-irc/kiwiirc.com/ip.125.16.167.56] has quit [Quit: http://www.kiwiirc.com/ - A hand crafted IRC client]
06:37 -!- daivik [7d10a738@gateway/web/cgi-irc/kiwiirc.com/ip.125.16.167.56] has joined #mlpack
08:14 -!- daivik [7d10a738@gateway/web/cgi-irc/kiwiirc.com/ip.125.16.167.56] has quit [Quit: http://www.kiwiirc.com/ - A hand crafted IRC client]
08:43 -!- daivik [7d10a738@gateway/web/cgi-irc/kiwiirc.com/ip.125.16.167.56] has joined #mlpack
10:42 -!- daivik [7d10a738@gateway/web/cgi-irc/kiwiirc.com/ip.125.16.167.56] has quit [Quit: http://www.kiwiirc.com/ - A hand crafted IRC client]
10:44 -!- daivik [7d10a738@gateway/web/cgi-irc/kiwiirc.com/ip.125.16.167.56] has joined #mlpack
11:01 -!- govg [~govg@unaffiliated/govg] has quit [Ping timeout: 256 seconds]
11:03 -!- govg [~govg@unaffiliated/govg] has joined #mlpack
11:13 -!- daivik [7d10a738@gateway/web/cgi-irc/kiwiirc.com/ip.125.16.167.56] has quit [Quit: http://www.kiwiirc.com/ - A hand crafted IRC client]
11:29 -!- daivik [7d10a738@gateway/web/cgi-irc/kiwiirc.com/ip.125.16.167.56] has joined #mlpack
13:29 -!- govg [~govg@unaffiliated/govg] has quit [Ping timeout: 268 seconds]
13:31 -!- govg [~govg@202.3.77.204] has joined #mlpack
13:31 -!- govg is now known as Guest74213
13:35 -!- Guest74213 [~govg@202.3.77.204] has quit [Ping timeout: 240 seconds]
14:33 -!- K4k [elw@unaffiliated/k4k] has joined #mlpack
14:48 -!- alsc [~alsc@151.82.63.181] has joined #mlpack
14:51 < alsc> zoq: I am writing a tiny decoder in vanilla C for models trained with mlpack ANN: I don't understand the negativeloglikelihood_impl file... shouldn't it be -log() of the input columns?
15:02 < zoq> alsc: It is expected that the input contains log-probabilities.
15:02 < alsc> ok..true sorry.. needs LogSoftMax first
15:03 < zoq> alsc: Right or you can now use The CrossEntropy function.
15:04 < zoq> https://github.com/mlpack/mlpack/blob/master/src/mlpack/methods/ann/layer/cross_entropy_error.hpp
15:08 < alsc> zoq: i trained with softmax, will keep it that way for now
15:09 < alsc> I have a half ready code generator that takes a FNN model and writes header files with the topology and coefficients, with no dependencies, just raw pointers
15:09 < zoq> alsc: Okay, that should work just fine, just if you don't like to introduce an extra layer you could switch to cross entropy
15:09 < alsc> kind of a portable tiny decoder maybe I'll upload it somewhere
15:10 -!- govg [~govg@unaffiliated/govg] has joined #mlpack
15:13 < zoq> also, do you like me to open a PR for the layer modifcation or do you refork the repo?
15:14 < zoq> alsc: Would be cool to see the results :)
15:15 < alsc> zoq: yeah for the PRs, I have forked and waiting to hae a second to port the changes from the code you saw to this new fork so I can submit a PR from there.... give it some days...
15:15 < zoq> alsc: Okay sounds good, let me know if you encounter any issues.
15:16 < alsc> sure
15:26 -!- daivik [7d10a738@gateway/web/cgi-irc/kiwiirc.com/ip.125.16.167.56] has quit [Quit: http://www.kiwiirc.com/ - A hand crafted IRC client]
15:35 < alsc> zoq: can you give me a little help to replicate that softmax function?
15:36 < alsc> I imagine having the activations, say 10, of the last layer, with the number of classes double activations[] = {0.123,0.213,0.151,0.153,0.21}
15:36 < alsc> I dn't understand what tanh has to do with the softmax, I'd expect just exp() in there
15:42 -!- lozhnikov [sid160380@gateway/web/irccloud.com/x-vcjjrcwjjoezxbbf] has quit []
15:42 -!- lozhnikov [sid160380@gateway/web/irccloud.com/x-holiulhsyktvuvka] has joined #mlpack
15:47 -!- ImQ009 [~ImQ009@unaffiliated/imq009] has joined #mlpack
15:52 < alsc> anyay, from the algorithm, I'd say I'll have max_activation = 0.213; then normalize activations subtracting the max, then it looks like it's doing tanh of that, then other stuff..
15:52 < alsc> 😬
15:53 < alsc> zoq: so it's doing tanh first, then softmax
16:30 -!- manish7294 [~androirc@2405:205:a169:af8b:f58f:2046:ff84:470e] has joined #mlpack
17:05 < manish7294> @rcurtin: Currently we are not building MVU and there is also a comment that it's not working. Could you give me some points as why it's not working. I couldn't get it seeing #189. And sorry for disturbing frequently, It must be hard managing so many things.
17:25 < rcurtin> manish7294: the issue is now #183 on github (#189 was the old number on trac)
17:25 < rcurtin> see also the MVU project for GSoC
17:42 < manish7294> rcurtin: Thanks for suggesting that. Do you think diving into MVU for some time will help getting more acquainted to LMNN ?
17:43 < rcurtin> at least being familiar with it might help, but in my view fixing MVU is a far harder task than LMNN+LRSDP
17:46 -!- alsc [~alsc@151.82.63.181] has quit [Ping timeout: 240 seconds]
17:46 < manish7294> rcurtin: ya, I understand you have already mentioned "It's not for faint of heart" :-) . I just want to get familiar with SDP's.
17:50 < rcurtin> no worries, maybe the Vandenberghe and Boyd paper/tutorial is a good place to start?
17:50 < rcurtin> not sure I got the name right... at lunch now
17:52 -!- alsc [~alsc@host107-36-dynamic.20-79-r.retail.telecomitalia.it] has joined #mlpack
18:11 -!- alsc [~alsc@host107-36-dynamic.20-79-r.retail.telecomitalia.it] has quit [Quit: alsc]
18:42 -!- alsc [~alsc@host107-36-dynamic.20-79-r.retail.telecomitalia.it] has joined #mlpack
20:06 -!- alsc [~alsc@host107-36-dynamic.20-79-r.retail.telecomitalia.it] has quit [Quit: alsc]
20:34 -!- manish7294 [~androirc@2405:205:a169:af8b:f58f:2046:ff84:470e] has quit [Remote host closed the connection]
21:15 < zoq> alsc: Sorry for the slow response, the comment is wrong, it's the exp approximation.
21:21 < zoq> alsc: Fixed with 4f664d208 thanks for the hint.
22:19 -!- ImQ009 [~ImQ009@unaffiliated/imq009] has quit [Quit: Leaving]
23:15 < rcurtin> zoq: I guess a quick fix for the static analysis is just to remove the -Werror from the cflags for pvs-studio, what do you think?
23:15 < rcurtin> if you think that's fine I'll go ahead and make the change on masterblaster
23:15 < zoq> or checkout the previous version?
23:15 < zoq> since it's a git repo
23:17 < rcurtin> ah, yeah, honestly that is the easier thing
23:18 < zoq> Are you going to make the adjustment?
23:18 < rcurtin> sure, I will do it
23:19 < zoq> okay
23:20 < rcurtin> I need to do a reboot test of masterblaster also; I think I will do it either later tonight or tomorrow morning unless there are any objections
23:20 < rcurtin> I'll basically just wait until no active jobs are running, then apt-get update && apt-get upgrade && apt-get dist-upgrade && reboot
23:21 < zoq> ah, yeah, no objections from my side
--- Log closed Wed Feb 07 00:00:01 2018