[mlpack] GSOC 2018 [Essential Deep Learning Modules]

[Marcus Edel]

Hello Ayush,

> I had a talk with Shikhar yesterday and he told me that he is almost done with
> all the GAN implementation and would not require any help from my side. So, I
> would like to start working on Stacked GAN and Capsule Network for now if
> possible. Can you please let me know what should be my steps regarding this.

We should start about thinking how the interface should look like, that depends
on the idea. So in case of Capsule Networks, what code could be reused, what do
we have to extend or add. Also, do we write another class that looks like the
existing FFN class or can we write the Capsule Networks as a layer and use the
FFN class and just add the Capsule Network as a layer.

For the Stacked GAN project, can we reuse parts of the GAN code Shikhar is
working on, or should we write a new class, if the second case is the better
way, how should this class look like.

So, before we start with the actual implementation we should start a discussion
either here on the mailing list or Github.

I hope this is helpful, let me know if I should clarify anything.

Thanks,
Marcus

> On 15. Feb 2018, at 23:40, bansa031 University of Minnesota <bansa031 at umn.edu> wrote:
> 
> Hey Ryan,
> 
> I had a talk with Shikhar yesterday and he told me that he is almost done with all the GAN implementation and would not require any help from my side. So, I would like to start working on Stacked GAN and Capsule Network for now if possible. Can you please let me know what should be my steps regarding this.
> 
> As for now I have got a local copy of the code for MLPack library and have started going through it.
> 
> 
> Thank You
> 
> On Wed, Feb 14, 2018 at 9:23 AM, Ryan Curtin <ryan at ratml.org <mailto:ryan at ratml.org>> wrote:
> On Wed, Feb 14, 2018 at 05:29:39AM -0600, bansa031 University of Minnesota wrote:
> > Hi,
> >
> > I am Ayush Bansal, a second-year master's student at University of
> > Minnesota, USA. I have a keen interest in the field of Deep Learning and
> > Machine Learning. I have been using and exploring various deep learning
> > models and techniques and am very interested in working on Generative
> > Adversarial Networks. I have worked on them for my project last semester
> > especially in the framework of Capsule Networks. If possible I would like
> > to work on the proposed idea of either Stacked Generative Adversarial
> > Networks or Improved Techniques for Training GANs. I would love to increase
> > my knowledge in the field of GANs and possibly other models in Deep
> > Learning.
> >
> > If allowed I would also like to implement Capsule Networks in MLPack. All
> > in all, I would like you to consider my ideas and give me guidance on this
> > project.
> 
> Hi Ayush,
> 
> Thanks for getting in touch.  I think capsule networks could be a nice
> addition to mlpack, but a thing to keep in mind is that your proposal
> should be pretty clear on the API that will be provided to users and how
> users will use it.  For capsule networks, I know that training can also
> be very slow, so we should focus on a good implementation that is as
> fast as we can make it.
> 
> For the GANs, we had a student (Kris Singh) work on implementing them
> last year but the project was not fully completed.  I would suggest that
> you take a look at the PRs that are currently open.  Shikhar Jaiswal has
> been working on finishing the various parts of the components, so it
> might be worthwhile to talk to him to see where he is and if there is
> anything you can help with.  Stacked GANs or improved GAN training
> techniques are a nice idea; a proposal for this should definitely take
> account of the current GAN implementation status and figure out what
> needs to be done there.
> 
> I hope you are enjoying Minneapolis... I was there a while ago and liked
> the city.  I wanted to jump into the Mississippi River but it was cold
> and probably that is not a good idea in general... :)
> 
> Thanks,
> 
> Ryan
> 
> --
> Ryan Curtin    | "It is very cold... in space."
> ryan at ratml.org <mailto:ryan at ratml.org> |   - Khan
> 
> 
> 
> -- 
> Ayush Bansal
> University of Minnesota - Twin Cities - Class of 2018
> Financial Mathematics Major
> Mobile : 612-245-7925
> bansa031 at umn.edu <mailto:bansa031 at umn.edu> | ayushb666 at gmail.com <mailto:ayushb666 at gmail.com>
> 
> _______________________________________________
> mlpack mailing list
> mlpack at lists.mlpack.org <mailto:mlpack at lists.mlpack.org>
> http://knife.lugatgt.org/cgi-bin/mailman/listinfo/mlpack <http://knife.lugatgt.org/cgi-bin/mailman/listinfo/mlpack>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://knife.lugatgt.org/pipermail/mlpack/attachments/20180216/8aa0d3a1/attachment-0001.html>