Saikat Kanjilal
2016-09-10 17:24:54 UTC
Here's the intended functionality:
For each type of algorithm in mahout
run a set of perf tests with different data sets and different hyperparameters
connect results to zeppelin for visual verification/comparison of results
End
As I mentioned earlier ideally this becomes part of any build that gets kicked out during the release process, , I will take the spray and akka functionality out, that was there to make this a rest based service that one could call if necessary. I can also replace the csv library, what are the suggestions for the different libraries here? Also any thoughts about the general approach, if not I will start incorporating into zeppelin as well as hooking it into the other algorithms. Currently I am launching this as a separate module within mahout, is this workable for folks, the module will live parallel to math/samsara etc. One last thing, are there a preferred set of algorithms that this should be hooked to first (trying to figure out if we could prioritize certain algorithms over others?).
I will also add the preamble comment about licensing to files and attach a pull request for your review.
Thanks
________________________________
From: Andrew Musselman <***@github.com>
Sent: Friday, September 9, 2016 6:35 PM
To: apache/mahout
Cc: skanjila; Author
Subject: Re: [apache/mahout] Mahout 1869 (#245)
Looks like a lot of extras in here; what is the intended functionality of this, running some perf tests and writing out to CSV?
The akka/spray additions seem out of scope if so, and there is a lot of extra stuff in the pom that could be inherited from the parent. Also, the CSV library from a github repo will have to be justified, otherwise there are existing libraries that would be preferable.
Please follow the convention from existing files regarding preamble comment containing licensing.
Thanks!
-
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub<https://github.com/apache/mahout/pull/245#issuecomment-246079844>, or mute the thread<https://github.com/notifications/unsubscribe-auth/AApKRt5e4YCwrZfhcWJmnJaLU4eXHQ03ks5qogllgaJpZM4JGuuF>.
For each type of algorithm in mahout
run a set of perf tests with different data sets and different hyperparameters
connect results to zeppelin for visual verification/comparison of results
End
As I mentioned earlier ideally this becomes part of any build that gets kicked out during the release process, , I will take the spray and akka functionality out, that was there to make this a rest based service that one could call if necessary. I can also replace the csv library, what are the suggestions for the different libraries here? Also any thoughts about the general approach, if not I will start incorporating into zeppelin as well as hooking it into the other algorithms. Currently I am launching this as a separate module within mahout, is this workable for folks, the module will live parallel to math/samsara etc. One last thing, are there a preferred set of algorithms that this should be hooked to first (trying to figure out if we could prioritize certain algorithms over others?).
I will also add the preamble comment about licensing to files and attach a pull request for your review.
Thanks
________________________________
From: Andrew Musselman <***@github.com>
Sent: Friday, September 9, 2016 6:35 PM
To: apache/mahout
Cc: skanjila; Author
Subject: Re: [apache/mahout] Mahout 1869 (#245)
Looks like a lot of extras in here; what is the intended functionality of this, running some perf tests and writing out to CSV?
The akka/spray additions seem out of scope if so, and there is a lot of extra stuff in the pom that could be inherited from the parent. Also, the CSV library from a github repo will have to be justified, otherwise there are existing libraries that would be preferable.
Please follow the convention from existing files regarding preamble comment containing licensing.
Thanks!
-
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub<https://github.com/apache/mahout/pull/245#issuecomment-246079844>, or mute the thread<https://github.com/notifications/unsubscribe-auth/AApKRt5e4YCwrZfhcWJmnJaLU4eXHQ03ks5qogllgaJpZM4JGuuF>.