[mlpack] [GSoC 17] Boltzmann Machine

[Marcus Edel]

Hello Skand,

(cc mlpack list, please use the public mailing list)

> Yes I couldn't find an mlpack RBM implementation. I guess (if I am not wrong),
> we have to start from scratch. In the previous few days I had gone through the
> paper on spike and slab RBM (and also revised rbm). So can you guide me how to
> start the method rbm? I would first like to implement the RBM class and then
> extend to various modifications of it. What do you think?

Starting with the RBM and adding the improvements described in the "Spike and
slab restricted boltzmann machine" paper sounds reasonable. However, we should
think about the necessaries for additional features, so that we can add features
without redesigning the classes.

So I propose that we first brainstorm about the API, before implementing the
model, does that sound reasonable?

Thanks,
Marcus

> On 14 Mar 2017, at 10:12, Skand Vishwanath Peri <pvskand at gmail.com> wrote:
> 
> Hey Marcus, 
>     
> 
> Do you mean you couldn't find an mlpack RBM implementation?
> 
> Yes I couldn't find an mlpack RBM implementation. I guess (if I am not wrong), we have to start from scratch. In the previous few days I had gone through the paper on spike and slab RBM (and also revised rbm). So can you guide me how to start the method rbm? I would first like to implement the RBM class and then extend to various modifications of it. What do you think?
> 
> Regards
> Skand Vishwanath Peri
> ᐧ
> 
> On Mon, Mar 6, 2017 at 8:23 PM, Marcus Edel <marcus.edel at fu-berlin.de <mailto:marcus.edel at fu-berlin.de>> wrote:
> Hello Skand,
> 
> thanks for getting in touch.
> 
>> Among the topics given on the wiki page, I am interested in implemening spike
>> and slab RBM. I have done a course in Advance Machine Learning and am familiar
>> with the basics of Boltzmann Machine and RBM.  I wanted to ask you from where
>> should I start.
> 
> My recommendation is to start with the references given in the project
> description, each paper also has some useful references that are really helpful.
> In fact, to be successful at this project, you should have a good knowledge of
> deep learning; i.e., you should be familiar with the way deep neural networks
> are typically built and trained, and certainly you should be familiar with the
> individual components that you plan to implement.
> 
>> I don't seem to find any previous implementation of RBM (Correct me if I am
>> wrong. I did search through but didn't find it.)
> 
> Do you mean you couldn't find an mlpack RBM implementation?
> 
>> I have previously worked in Convolutional Neural Networks by doing a project on
>> detecting Distracted Driver and was successfully able to implement it.
> 
> Sounds interesting based on images/video? I wonder what dataset you used to
> train the network, would be interesting to hear more about the project.
> 
>> I am currently going through the slab and spike rbm. It would be of great help
>> if you can guide me to start.
> 
> A good place to start is by working through the mlpack tutorials and making sure
> you can get mlpack to compile and understand how to use it. If everything works
> we can discuss some ideas how to improve the project or add new features.
> 
> Is that helpful? If you have any questions, feel free to ask.
> 
> Thanks,
> Marcus
> 
>> On 6 Mar 2017, at 13:23, Skand Vishwanath Peri <pvskand at gmail.com <mailto:pvskand at gmail.com>> wrote:
>> 
>> Hello, 
>>        I am Skand Vishwanath Peri from India. I am currently in my pre - final year of Undergraduate studies. I am interested in participating in GSoC 17 with mlpack.
>> 
>> Among the topics given on the wiki page, I am interested in implemening spike and slab RBM. I have done a course in Advance Machine Learning and am familiar with the basics of Boltzmann Machine and RBM. 
>> I wanted to ask you from where should I start. I don't seem to find any previous implementation of RBM (Correct me if I am wrong. I did search through but didn't find it.) 
>> 
>> I have previously worked in Convolutional Neural Networks by doing a project on detecting Distracted Driver <https://github.com/pvskand/DriverDetection> and was successfully able to implement it.
>> 
>> I am currently going through the slab and spike rbm. It would be of great help if you can guide me to start.
>> 
>> Regards
>> Skand Vishwanath Peri
>> ᐧ
>> _______________________________________________
>> mlpack mailing list
>> mlpack at lists.mlpack.org <mailto:mlpack at lists.mlpack.org>
>> http://knife.lugatgt.org/cgi-bin/mailman/listinfo/mlpack <http://knife.lugatgt.org/cgi-bin/mailman/listinfo/mlpack>
> 

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://knife.lugatgt.org/pipermail/mlpack/attachments/20170315/8eb72ecc/attachment-0001.html>