mlpack IRC logs, 2018-03-05

Logs for the day 2018-03-05 (starts at 0:00 UTC) are shown below.

March 2018
Sun
Mon
Tue
Wed
Thu
Fri
Sat
 
 
 
 
1
2
3
4
5
6
7
8
9
31
--- Log opened Mon Mar 05 00:00:39 2018
03:55 -!- govg [~govg@unaffiliated/govg] has joined #mlpack
06:30 -!- vpal [~vivek@unaffiliated/vivekp] has joined #mlpack
06:31 -!- vivekp [~vivek@unaffiliated/vivekp] has quit [Ping timeout: 268 seconds]
06:31 -!- vpal is now known as vivekp
08:05 -!- robertohueso [~root@217.216.127.162.dyn.user.ono.com] has joined #mlpack
09:16 -!- robertohueso [~root@217.216.127.162.dyn.user.ono.com] has quit [Quit: leaving]
09:19 -!- nikhilweee [~nikhilwee@128.199.66.195] has quit [Quit: Ping timeout (120 seconds)]
10:55 -!- sumedhghaisas2 [~yaaic@148.252.129.82] has joined #mlpack
10:57 -!- sumedhghaisas [~yaaic@host-92-24-109-143.ppp.as43234.net] has quit [Ping timeout: 268 seconds]
11:09 -!- sumedhghaisas2 [~yaaic@148.252.129.82] has quit [Ping timeout: 260 seconds]
11:10 -!- sumedhghaisas [~yaaic@148.252.129.82] has joined #mlpack
11:16 -!- sumedhghaisas [~yaaic@148.252.129.82] has quit [Read error: Connection reset by peer]
11:16 -!- sumedhghaisas2 [~yaaic@2a00:79e0:d:fd00:a04b:bceb:4e26:b53f] has joined #mlpack
11:18 -!- sumedhghaisas [~yaaic@2a00:79e0:d:fd00:a04b:bceb:4e26:b53f] has joined #mlpack
11:20 -!- sumedhghaisas2 [~yaaic@2a00:79e0:d:fd00:a04b:bceb:4e26:b53f] has quit [Ping timeout: 240 seconds]
11:30 -!- sumedhghaisas [~yaaic@2a00:79e0:d:fd00:a04b:bceb:4e26:b53f] has quit [Read error: Connection reset by peer]
11:31 -!- sumedhghaisas [~yaaic@2a00:79e0:d:fd00:a04b:bceb:4e26:b53f] has joined #mlpack
11:31 -!- Atharva [3b5fb376@gateway/web/freenode/ip.59.95.179.118] has joined #mlpack
11:33 < Atharva> sumedhghaisas: Hi Sumedh, how do you think I should proceed in order to get ready for the VAE project proposal?
11:33 -!- viraj [cb6ef210@gateway/web/freenode/ip.203.110.242.16] has joined #mlpack
11:33 < Atharva> I have already solved some issues and have started to get comfortable with the codebase.
11:34 -!- viraj [cb6ef210@gateway/web/freenode/ip.203.110.242.16] has quit [Client Quit]
11:35 -!- viraj [cb6ef210@gateway/web/freenode/ip.203.110.242.16] has joined #mlpack
11:35 < Atharva> Do you think it will help if I implement a convnet using mlpack or should I experiment with generative models?
11:36 -!- Atharva [3b5fb376@gateway/web/freenode/ip.59.95.179.118] has quit [Client Quit]
11:36 -!- Atharva [3b5fb376@gateway/web/freenode/ip.59.95.179.118] has joined #mlpack
11:45 < sumedhghaisas> Atharva: Hi Atharva.
11:46 < sumedhghaisas> I think the project should focus first on working implementation of VAE
11:46 < sumedhghaisas> for this using feedforward network is enough as far as MNIST is concerned
11:49 < sumedhghaisas> training of VAEs is not difficult, the architecture must support sampling
11:50 < Atharva> I understand, so for now I guess I should get as familiar with the ANN codebase as possible.
11:50 < sumedhghaisas> best thing I would suggest is coming up with tentative API of the module
11:51 < sumedhghaisas> the API should support the basic necessities, like sampling from the latent posterior or prior
11:53 < Atharva> Okay, I will do all the research required and come up with a tentative API.
11:58 < Atharva> Also, will it help if I implement a neural network with mlpack and include the link in the proposal, or should I just focus on researching about VAE and working on the API?
12:03 -!- Atharva [3b5fb376@gateway/web/freenode/ip.59.95.179.118] has quit [Quit: Page closed]
12:04 -!- Atharva [3b5fb376@gateway/web/freenode/ip.59.95.179.118] has joined #mlpack
12:09 < sumedhghaisas> Atharva: working ANN code will show that you are familiar with the ANN module and how to use it. That would be helpful. But also designing a robust API will also involve knowledge of how the current architecture works and how to use it efficiently...
12:10 < sumedhghaisas> a robust API will show your familiarity with whole MLPack
12:13 < Atharva> Thanks Sumedh! I will get back with updates about my progress.
12:13 < Atharva> Can you tell me when are you generally active on irc?
12:15 < Atharva> Can you share your email or should I just contact you on irc if I need to?
12:37 -!- viraj [cb6ef210@gateway/web/freenode/ip.203.110.242.16] has quit [Quit: Page closed]
13:12 < sumedhghaisas> Atharva: Sorry for the late response. Stuck in the meeting.
13:13 < sumedhghaisas> my email is sumedhghaisas@gmail.com
13:13 < sumedhghaisas> please free free to msg me on IRC also... I will try to respond as quickly as I can
13:15 < Atharva> Thanks for the help, I will keep all this in mind. :)
13:36 -!- Atharva [3b5fb376@gateway/web/freenode/ip.59.95.179.118] has quit [Quit: Page closed]
13:47 -!- rajeshdm9 [0e8b9b18@gateway/web/freenode/ip.14.139.155.24] has joined #mlpack
14:44 < zoq> Atharva: We like to keep project discussions public, that way more people can jump in and provide feedback.
14:56 -!- aman____ [uid212746@gateway/web/irccloud.com/x-hqiuejzpgiatggot] has joined #mlpack
14:57 -!- aman_ [uid212746@gateway/web/irccloud.com/x-kvaxtvnullaqdbwa] has quit [Ping timeout: 276 seconds]
15:03 -!- robertohueso [~root@217.216.127.162.dyn.user.ono.com] has joined #mlpack
15:04 < robertohueso> Is it defined anywhere what methods,etc. a "RuleType" has to have?
15:11 -!- Atharva [3b5fb376@gateway/web/freenode/ip.59.95.179.118] has joined #mlpack
15:12 < rcurtin> robertohueso: I thought that it was documented in one of the tutorials, but it should basically be BaseCase() and Score()
15:12 < rcurtin> you can take a look at one of the other existing RuleTypes to get an idea, or you can see the DualTreeTraverser classes and SingleTreeTraverser classes in src/mlpack/core/tree/ to see what methods they are expecting the RuleTypes to have
15:12 < Atharva> zoq: Okay, I understand. I will try to keep all the discussions public.
15:17 -!- rajeshdm9 [0e8b9b18@gateway/web/freenode/ip.14.139.155.24] has quit [Ping timeout: 260 seconds]
15:18 < robertohueso> rcurtin: Thanks :)
15:23 < rcurtin> sure, hope it helps---and if you find the documentation lacking, please feel free to make a note of it or improve it
15:23 < rcurtin> it's hard to predict what information is useful or needed for a new user or contributor sometimes :)
15:24 < dk97[m]> zoq: I have made a loss_functions folder inside the ann folder
15:25 < dk97[m]> It contains KL Divergence loss as of now.
15:25 < dk97[m]> I saw that the MSE and cross entropy loss are already implemented in the ann_layers folder...
15:25 < dk97[m]> Should I shift them to loss_functions folder?
15:26 < dk97[m]> Also, I think there are mistakes in the MSE function implemented in mlpack.
15:31 < zoq> dk97[m] Yes, let's move them, will take a look at the PR.
15:31 < zoq> dk97[m]: Abotu the issue, are you talking about the backward function?
15:32 < dk97[m]> yeah...
15:32 < dk97[m]> it should be the mean
15:33 < zoq> dk97[m]: I see, will have a look and fix it.
15:33 < dk97[m]> okay!
15:35 -!- sumedhghaisas [~yaaic@2a00:79e0:d:fd00:a04b:bceb:4e26:b53f] has quit [Read error: Connection reset by peer]
15:35 -!- sumedhghaisas2 [~yaaic@2a00:79e0:d:fd00:a04b:bceb:4e26:b53f] has joined #mlpack
15:37 -!- Atharva [3b5fb376@gateway/web/freenode/ip.59.95.179.118] has quit [Quit: Page closed]
15:47 -!- ImQ009 [~ImQ009@unaffiliated/imq009] has joined #mlpack
15:54 -!- satyam_2401 [uid282868@gateway/web/irccloud.com/x-agpancgwumhnxbbk] has joined #mlpack
16:01 -!- sumedhghaisas [~yaaic@2a00:79e0:d:fd00:f059:44a5:463f:2db9] has joined #mlpack
16:03 -!- sumedhghaisas2 [~yaaic@2a00:79e0:d:fd00:a04b:bceb:4e26:b53f] has quit [Ping timeout: 256 seconds]
16:09 -!- vivekp [~vivek@unaffiliated/vivekp] has quit [Ping timeout: 256 seconds]
16:11 -!- moksh [0e8b9bd6@gateway/web/freenode/ip.14.139.155.214] has joined #mlpack
16:12 < moksh> @zoq sorry, I did not see that SARSA has been implemented in the documentation and might've missed it in the code. Really sorry about that. Could you suggest a RL algorithm that would be a good addition to the library?
16:21 -!- vivekp [~vivek@unaffiliated/vivekp] has joined #mlpack
16:28 < zoq> moksh: One idea is to take a look at the Simple Nearest Neighbor Policy; perhaps that is an option?
16:29 < moksh> @zoq Thanks a lot, I'll take a look and get back to you :)
16:30 < dk97[m]> zoq: did you have a read of the quantized fully connected layers?
16:30 < dk97[m]> If it is okay, I can implement the layer.
16:30 < dk97[m]> Here is the paper - https://arxiv.org/pdf/1512.06473.pdf
16:33 < moksh> @zoq are you talking about this https://openreview.net/forum?id=ByL48G-AW ?
16:51 -!- sumedhghaisas [~yaaic@2a00:79e0:d:fd00:f059:44a5:463f:2db9] has quit [Read error: Connection reset by peer]
16:51 -!- sumedhghaisas [~yaaic@2a00:79e0:d:fd00:f059:44a5:463f:2db9] has joined #mlpack
16:56 -!- moksh [0e8b9bd6@gateway/web/freenode/ip.14.139.155.214] has quit [Ping timeout: 260 seconds]
17:47 < zoq> dk97[m]: Sounds like an interesting idea, so if you like to give this a shot please feel free.
17:48 < zoq> moksh: Yes, it's not as straightforward as e.g. policy gradients.
17:52 < zoq> moksh: So don't feel obligated, I think another great way to get familiar with the codebase is to do something similar as Eugene has done here: https://github.com/mlpack/models/pull/5
17:58 -!- moksh [daf82e6b@gateway/web/freenode/ip.218.248.46.107] has joined #mlpack
18:01 < moksh> @zoq: Okay. So you suggest I make a model using mlpack?
18:04 < moksh> Also, I recently came across this paper https://openreview.net/forum?id=SJJySbbAZ, which describes optimistic mirror descent for adam optimizer. Having tried it I can say it really improves the GAN training quite a lot. Would it be a good idea to implement this?
18:04 -!- satyam_2401 [uid282868@gateway/web/irccloud.com/x-agpancgwumhnxbbk] has quit [Quit: Connection closed for inactivity]
18:14 < dk97[m]> zoq: okay, thanks!
18:23 -!- ShikharJ [0e8bc218@gateway/web/freenode/ip.14.139.194.24] has joined #mlpack
18:25 < ShikharJ> zoq: Can I please have a review of the Bilinear Interpolation PR? I'd like to get that merged as soon as possible.
18:32 -!- ShikharJ [0e8bc218@gateway/web/freenode/ip.14.139.194.24] has quit [Quit: Page closed]
18:46 -!- K4k [elw@unaffiliated/k4k] has joined #mlpack
18:50 -!- sumedhghaisas2 [~yaaic@148.252.129.51] has joined #mlpack
18:53 -!- sumedhghaisas [~yaaic@2a00:79e0:d:fd00:f059:44a5:463f:2db9] has quit [Ping timeout: 240 seconds]
18:54 -!- sumedhghaisas2 [~yaaic@148.252.129.51] has quit [Ping timeout: 240 seconds]
18:57 -!- sumedhghaisas [~yaaic@148.252.129.51] has joined #mlpack
18:57 -!- moksh [daf82e6b@gateway/web/freenode/ip.218.248.46.107] has quit [Ping timeout: 260 seconds]
18:59 -!- sumedhghaisas2 [~yaaic@2a00:79e0:d:fd00:f059:44a5:463f:2db9] has joined #mlpack
18:59 -!- sumedhghaisas [~yaaic@148.252.129.51] has quit [Read error: Connection reset by peer]
19:02 < zoq> moksh: Regarding the model yes, regarding mirror descent, agree the paper is really interesting, so if you like to work on that instead, please feel free.
19:13 -!- sumedhghaisas [~yaaic@148.252.129.51] has joined #mlpack
19:13 -!- sumedhghaisas2 [~yaaic@2a00:79e0:d:fd00:f059:44a5:463f:2db9] has quit [Read error: Connection reset by peer]
19:15 -!- sumedhghaisas3 [~yaaic@2a00:79e0:d:fd00:f059:44a5:463f:2db9] has joined #mlpack
19:15 -!- sumedhghaisas [~yaaic@148.252.129.51] has quit [Read error: Connection reset by peer]
19:17 -!- sumedhghaisas [~yaaic@148.252.129.51] has joined #mlpack
19:18 -!- sumedhghaisas3 [~yaaic@2a00:79e0:d:fd00:f059:44a5:463f:2db9] has quit [Read error: Connection reset by peer]
19:18 -!- sumedhghaisas [~yaaic@148.252.129.51] has quit [Read error: Connection reset by peer]
19:18 -!- sumedhghaisas [~yaaic@2a00:79e0:d:fd00:f059:44a5:463f:2db9] has joined #mlpack
19:20 -!- sumedhghaisas2 [~yaaic@2a00:79e0:d:fd00:f059:44a5:463f:2db9] has joined #mlpack
19:20 -!- sumedhghaisas [~yaaic@2a00:79e0:d:fd00:f059:44a5:463f:2db9] has quit [Read error: Connection reset by peer]
19:29 -!- sumedhghaisas [~yaaic@2a00:79e0:d:fd00:f059:44a5:463f:2db9] has joined #mlpack
19:29 -!- sumedhghaisas2 [~yaaic@2a00:79e0:d:fd00:f059:44a5:463f:2db9] has quit [Read error: Connection reset by peer]
19:39 -!- robertohueso [~root@217.216.127.162.dyn.user.ono.com] has quit [Quit: leaving]
20:19 -!- govg [~govg@unaffiliated/govg] has quit [Ping timeout: 265 seconds]
20:22 -!- govg [~govg@unaffiliated/govg] has joined #mlpack
20:27 -!- govg [~govg@unaffiliated/govg] has quit [Ping timeout: 276 seconds]
20:34 -!- sumedhghaisas2 [~yaaic@2a00:79e0:d:fd00:f059:44a5:463f:2db9] has joined #mlpack
20:34 -!- sumedhghaisas [~yaaic@2a00:79e0:d:fd00:f059:44a5:463f:2db9] has quit [Read error: Connection reset by peer]
20:42 -!- travis-ci [~travis-ci@ec2-54-224-140-82.compute-1.amazonaws.com] has joined #mlpack
20:42 < travis-ci> ShikharJ/mlpack#92 (ResizeLayer - 2ad123d : Shikhar Jaiswal): The build has errored.
20:42 < travis-ci> Change view : https://github.com/ShikharJ/mlpack/compare/a946d183e829...2ad123dc0ffc
20:42 < travis-ci> Build details : https://travis-ci.org/ShikharJ/mlpack/builds/349474967
20:42 -!- travis-ci [~travis-ci@ec2-54-224-140-82.compute-1.amazonaws.com] has left #mlpack []
20:43 -!- sumedhghaisas2 [~yaaic@2a00:79e0:d:fd00:f059:44a5:463f:2db9] has quit [Ping timeout: 256 seconds]
20:43 -!- sumedhghaisas [~yaaic@2a00:79e0:d:fd00:f059:44a5:463f:2db9] has joined #mlpack
20:48 -!- sumedhghaisas2 [~yaaic@148.252.129.88] has joined #mlpack
20:50 -!- sumedhghaisas [~yaaic@2a00:79e0:d:fd00:f059:44a5:463f:2db9] has quit [Ping timeout: 260 seconds]
20:57 -!- sumedhghaisas2 [~yaaic@148.252.129.88] has quit [Ping timeout: 268 seconds]
20:58 -!- sumedhghaisas [~yaaic@148.252.129.88] has joined #mlpack
21:09 -!- sumedhghaisas [~yaaic@148.252.129.88] has quit [Read error: Connection reset by peer]
21:09 -!- sumedhghaisas [~yaaic@host-92-24-110-9.ppp.as43234.net] has joined #mlpack
21:29 -!- ImQ009 [~ImQ009@unaffiliated/imq009] has quit [Quit: Leaving]
22:46 -!- ShikharJ [0e8bc218@gateway/web/freenode/ip.14.139.194.24] has joined #mlpack
22:47 < ShikharJ> zoq: Thanks for the review. I wanted to talk a bit more on my GAN proposal. Do you have some time?
22:48 < zoq> ShikharJ: Can we do that tomorrow? Or if you like post the questions here and we will responde as soon as possible.
22:52 < ShikharJ> Cool. In my proposal I was planning on implementing StackGAN (provided enough time was left). But I am not sure which version of the paper would be of interest. The original publication just mentions about two GANs stacked upon one another, whereas the updated paper talks of setting up a tree-like network of GANs for high-resolution imagery generation. Do you think one should go for the latest technique, or otherwise?
23:10 < zoq> ShikharJ: StackGAN-v1 and StackGAN-v2 share the same main building blocks, however for me, it looks like StackGAN-v1 is somewhat easier to implement, and it might be helpful to start with StackGAN-v1; in case there is time left we could build StackGAN-v2 based on that experience. On the other side, I guess nobody is going to use StackGAN-v1 if StackGAN-v2 is implemented, but in my opinion, that's not an issue.
23:17 < ShikharJ> Hmm, thanks for your thoughts.
23:18 < zoq> At the end it's your decision, if you like v2, please feel free to go for it straightaway.
23:19 < zoq> I guess since it's a side project ("if there is time left") it's not super important if we miss the goal here.
23:21 < ShikharJ> Actually,it is one of those goals than I thought could be extended beyong the GSoC period, and that's why think StackGAN-v2 should be something we invest time in altogether.
23:35 < zoq> I think we shouldn't include something that is too ambitious, let's focus on the main goals; At the end, we have to pass/fail someone based on the work done during the summer.
23:35 < zoq> If you like the StackGAN-v2 idea, shift the focus on that part.
23:41 < ShikharJ> Sure, my main goals include implementing DCGAN and WGAN, but I'm also keeping a considerable amount of time as buffer because I'm not sure how long would the tuning and testing would take. Hence the additional goals, should the need for buffer time not arise in the first place.
23:53 -!- vivekp [~vivek@unaffiliated/vivekp] has quit [Ping timeout: 255 seconds]
23:57 -!- ShikharJ [0e8bc218@gateway/web/freenode/ip.14.139.194.24] has quit [Quit: Page closed]
--- Log closed Tue Mar 06 00:00:40 2018