[jira] [Created] (MAHOUT-1838) Provide and plotting capabilities for Mahout mtrices and DRMs

Discussion:

Andrew Palumbo (JIRA)

2016-04-29 04:20:12 UTC

Andrew Palumbo created MAHOUT-1838:
--------------------------------------

Summary: Provide and plotting capabilities for Mahout mtrices and DRMs
Key: MAHOUT-1838
URL: https://issues.apache.org/jira/browse/MAHOUT-1838
Project: Mahout
Issue Type: New Feature
Components: visiualization
Affects Versions: 0.12
Reporter: Andrew Palumbo
Assignee: Andrew Palumbo
Fix For: 0.13

Add basic 2d and 3d plotting capabilities to Mahout using the Smile library: https://github.com/haifengl/smile

I've prototyped an {{mplot2d}} class here to sample a certain percentage of a DRM's data using {{drmSampleKRows()}} and to create a 2d plot from the resulting x,y coordinate matrix, and tested from the spark-shell as a POC.

Extending to 3d should be trivial:
The Smile-Plot library has some very nice plotting features, all of which can easily integrated into mahout:

http://haifengl.github.io/smile/index.html#gallery
http://haifengl.github.io/smile/index.html#visualization

--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Andrew Palumbo (JIRA)

2016-04-29 04:21:12 UTC

Permalink

Post by Andrew Palumbo (JIRA)
Provide and plotting capabilities for Mahout mtrices and DRMs
--------------------------------------------------------------
Key: MAHOUT-1838
URL: https://issues.apache.org/jira/browse/MAHOUT-1838
Project: Mahout
Issue Type: New Feature
Components: visiualization
Affects Versions: 0.12
Reporter: Andrew Palumbo
Fix For: 0.13
Add basic 2d and 3d plotting capabilities to Mahout using the Smile library: https://github.com/haifengl/smile
I've prototyped an {{mplot2d}} class here to sample a certain percentage of a DRM's data using {{drmSampleKRows()}} and to create a 2d plot from the resulting x,y coordinate matrix, and tested from the spark-shell as a POC.
http://haifengl.github.io/smile/index.html#gallery
http://haifengl.github.io/smile/index.html#visualization

--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Andrew Palumbo (JIRA)

2016-04-29 04:25:12 UTC

Permalink

Post by Andrew Palumbo (JIRA)
Provide and plotting capabilities for Mahout mtrices and DRMs
--------------------------------------------------------------
Key: MAHOUT-1838
URL: https://issues.apache.org/jira/browse/MAHOUT-1838
Project: Mahout
Issue Type: New Feature
Components: visiualization
Affects Versions: 0.12
Reporter: Andrew Palumbo
Fix For: 0.13
Attachments: drmSamplePlot2d.png
Add basic 2d and 3d plotting capabilities to Mahout using the Smile library: https://github.com/haifengl/smile
I've prototyped an {{mplot2d}} class here to sample a certain percentage of a DRM's data using {{drmSampleKRows()}} and to create a 2d plot from the resulting x,y coordinate matrix, and tested from the spark-shell as a POC.
http://haifengl.github.io/smile/index.html#gallery
http://haifengl.github.io/smile/index.html#visualization

--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Andrew Palumbo (JIRA)

2016-04-29 17:10:13 UTC

Permalink

[ https://issues.apache.org/jira/browse/MAHOUT-1838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Andrew Palumbo reassigned MAHOUT-1838:
--------------------------------------

Assignee: Andrew Palumbo

Post by Andrew Palumbo (JIRA)
Provide and plotting capabilities for Mahout mtrices and DRMs
--------------------------------------------------------------
Key: MAHOUT-1838
URL: https://issues.apache.org/jira/browse/MAHOUT-1838
Project: Mahout
Issue Type: New Feature
Components: visiualization
Affects Versions: 0.12
Reporter: Andrew Palumbo
Assignee: Andrew Palumbo
Fix For: 0.13
Attachments: drmSamplePlot2d.png
Add basic 2d and 3d plotting capabilities to Mahout using the Smile library: https://github.com/haifengl/smile
I've prototyped an {{mplot2d}} class here to sample a certain percentage of a DRM's data using {{drmSampleKRows()}} and to create a 2d plot from the resulting x,y coordinate matrix, and tested from the spark-shell as a POC.
http://haifengl.github.io/smile/index.html#gallery
http://haifengl.github.io/smile/index.html#visualization

--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

ASF GitHub Bot (JIRA)

2016-04-29 20:08:12 UTC

Permalink

[ https://issues.apache.org/jira/browse/MAHOUT-1838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15264651#comment-15264651 ]

ASF GitHub Bot commented on MAHOUT-1838:
----------------------------------------

GitHub user andrewpalumbo opened a pull request:

https://github.com/apache/mahout/pull/229

MAHOUT-1838: Simple 2d plotting of a sampled DRM

This is a bare-bones beginning to some mahout plots. Takes a `DRM` and creates a scatter plot of a sample of the first two columns.

Tested in the shell and works when the sample size is hard coded. But am currently having some problems with the simple calculation of the sample percent- simple fix I'm sure..

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/andrewpalumbo/mahout visiualization

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/mahout/pull/229.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #229

----
commit bf0a461abf32178b476a107b9752facafcb3575b
Author: Andrew Palumbo <***@apache.org>
Date: 2016-04-27T22:35:46Z

initial commit

commit 09418724f5c2fadbf288900dba6e4ec259847677
Author: Andrew Palumbo <***@apache.org>
Date: 2016-04-28T04:19:28Z

crashing in shell

commit 80198df57b3ee690b04caa77a14136a0b89d2b37
Author: Andrew Palumbo <***@apache.org>
Date: 2016-04-28T04:45:36Z

crashing in shell: error: bad symbolic reference. A signature in mplot2d.class refers to term smile

commit 09859df4047bfa092980bc4f755fb3a865b10f39
Author: Andrew Palumbo <***@apache.org>
Date: 2016-04-29T03:31:05Z

working plot

commit 51f6fd97c7cfcca846d37fabf866916a60d9a8db
Author: Andrew Palumbo <***@apache.org>
Date: 2016-04-29T04:38:43Z

operational plotting

commit f8fc304529ce0036e9ffbff5367cc1e30542018a
Author: Andrew Palumbo <***@apache.org>
Date: 2016-04-29T19:18:09Z

remove unnecessary deps. refactoring (spelling), licsense, etc

commit fa614825269be070f7202a4b921f1fea1c4a2b52
Author: Andrew Palumbo <***@apache.org>
Date: 2016-04-29T20:01:02Z

add default kryo serilizer mb to the spark-shell. problem calculating sample percent in mplot2d- getting 0 back

----

Post by Andrew Palumbo (JIRA)
Provide and plotting capabilities for Mahout mtrices and DRMs
--------------------------------------------------------------
Key: MAHOUT-1838
URL: https://issues.apache.org/jira/browse/MAHOUT-1838
Project: Mahout
Issue Type: New Feature
Components: visiualization
Affects Versions: 0.12
Reporter: Andrew Palumbo
Assignee: Andrew Palumbo
Fix For: 0.13
Attachments: drmSamplePlot2d.png
Add basic 2d and 3d plotting capabilities to Mahout using the Smile library: https://github.com/haifengl/smile
I've prototyped an {{mplot2d}} class here to sample a certain percentage of a DRM's data using {{drmSampleKRows()}} and to create a 2d plot from the resulting x,y coordinate matrix, and tested from the spark-shell as a POC.
http://haifengl.github.io/smile/index.html#gallery
http://haifengl.github.io/smile/index.html#visualization

--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

ASF GitHub Bot (JIRA)

2016-04-29 20:09:12 UTC

Permalink

[ https://issues.apache.org/jira/browse/MAHOUT-1838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15264654#comment-15264654 ]

ASF GitHub Bot commented on MAHOUT-1838:
----------------------------------------

Github user andrewpalumbo commented on a diff in the pull request:

https://github.com/apache/mahout/pull/229#discussion_r61637550

--- Diff: math-scala/pom.xml ---
@@ -140,6 +140,13 @@
<version>3.3.0</version>
</dependency>

+
+ <dependency>
+ <groupId>com.github.haifengl</groupId>
+ <artifactId>smile-plot</artifactId>
+ <version>1.1.0</version>
+ </dependency>
+
--- End diff --

@pferrel this simple integration only requires the single smile-plot artifact.

Post by Andrew Palumbo (JIRA)
Provide and plotting capabilities for Mahout mtrices and DRMs
--------------------------------------------------------------
Key: MAHOUT-1838
URL: https://issues.apache.org/jira/browse/MAHOUT-1838
Project: Mahout
Issue Type: New Feature
Components: visiualization
Affects Versions: 0.12
Reporter: Andrew Palumbo
Assignee: Andrew Palumbo
Fix For: 0.13
Attachments: drmSamplePlot2d.png
Add basic 2d and 3d plotting capabilities to Mahout using the Smile library: https://github.com/haifengl/smile
I've prototyped an {{mplot2d}} class here to sample a certain percentage of a DRM's data using {{drmSampleKRows()}} and to create a 2d plot from the resulting x,y coordinate matrix, and tested from the spark-shell as a POC.
http://haifengl.github.io/smile/index.html#gallery
http://haifengl.github.io/smile/index.html#visualization

--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

ASF GitHub Bot (JIRA)

2016-04-29 20:16:13 UTC

Permalink

[ https://issues.apache.org/jira/browse/MAHOUT-1838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15264666#comment-15264666 ]

ASF GitHub Bot commented on MAHOUT-1838:
----------------------------------------

Github user smarthi commented on a diff in the pull request:

https://github.com/apache/mahout/pull/229#discussion_r61638348

--- Diff: examples/bin/spark-shell-plot.mscala ---
@@ -0,0 +1,19 @@
+import org.apache.mahout.visualization.mplot2d
+
+val mxRnd = Matrices.symmetricUniformView(5000000, 2, 1234)
+val drmRand = drmParallelize(mxRnd)
+
+val drmSin = drmRand.mapBlock() {case (keys, block) =>
+ val blockB = block.like()
+ for (i <- 0 until block.nrow) {
+ blockB(i, 0) = block(i, 0)
+ blockB(i, 1) = Math.sin((block(i, 0) * 8))
+ }
+ keys -> blockB
+}
+
+new mplot2d(drmRand, samplePercent = 10)
--- End diff --

make the samplePercent user defined ??

Post by Andrew Palumbo (JIRA)
Provide and plotting capabilities for Mahout mtrices and DRMs
--------------------------------------------------------------
Key: MAHOUT-1838
URL: https://issues.apache.org/jira/browse/MAHOUT-1838
Project: Mahout
Issue Type: New Feature
Components: visiualization
Affects Versions: 0.12
Reporter: Andrew Palumbo
Assignee: Andrew Palumbo
Fix For: 0.13
Attachments: drmSamplePlot2d.png
Add basic 2d and 3d plotting capabilities to Mahout using the Smile library: https://github.com/haifengl/smile
I've prototyped an {{mplot2d}} class here to sample a certain percentage of a DRM's data using {{drmSampleKRows()}} and to create a 2d plot from the resulting x,y coordinate matrix, and tested from the spark-shell as a POC.
http://haifengl.github.io/smile/index.html#gallery
http://haifengl.github.io/smile/index.html#visualization

--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

ASF GitHub Bot (JIRA)

2016-04-29 20:24:12 UTC

Permalink

[ https://issues.apache.org/jira/browse/MAHOUT-1838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15264677#comment-15264677 ]

ASF GitHub Bot commented on MAHOUT-1838:
----------------------------------------

Github user andrewpalumbo commented on a diff in the pull request:

https://github.com/apache/mahout/pull/229#discussion_r61639396

--- Diff: math-scala/src/main/scala/org/apache/mahout/visualization/mplot2d.scala ---
@@ -0,0 +1,69 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.mahout.visualization
+
+import java.awt.{BorderLayout, Color}
+import java.io.File
+import javax.swing.JFrame
+
+import org.apache.mahout.math._
+import scalabindings._
+import RLikeOps._
+import drm._
+import smile.plot._
+
+import scala.collection.JavaConversions._
+
+
+/**
+ * Create a s scatter plot of a DRM by sampling a given percentage
+ * and plotting corresponding points of (drmXY(::,0),drmXY(::,2))
+ *
+ * @param drmXY a m x 2 Drm drm to plot
+ * @param samplePercent the percentage the drm to sample
+ * @tparam K
+ */
+class mplot2d[K](drmXY: DrmLike[K], samplePercent: Int = 10, setVisible: Boolean = true) {
+ val drmSize = drmXY.checkpoint().numRows()
--- End diff --

@smarthi sample percent is user defined here.

Post by Andrew Palumbo (JIRA)
Provide and plotting capabilities for Mahout mtrices and DRMs
--------------------------------------------------------------
Key: MAHOUT-1838
URL: https://issues.apache.org/jira/browse/MAHOUT-1838
Project: Mahout
Issue Type: New Feature
Components: visiualization
Affects Versions: 0.12
Reporter: Andrew Palumbo
Assignee: Andrew Palumbo
Fix For: 0.13
Attachments: drmSamplePlot2d.png
Add basic 2d and 3d plotting capabilities to Mahout using the Smile library: https://github.com/haifengl/smile
I've prototyped an {{mplot2d}} class here to sample a certain percentage of a DRM's data using {{drmSampleKRows()}} and to create a 2d plot from the resulting x,y coordinate matrix, and tested from the spark-shell as a POC.
http://haifengl.github.io/smile/index.html#gallery
http://haifengl.github.io/smile/index.html#visualization

--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

ASF GitHub Bot (JIRA)

2016-04-29 20:29:12 UTC

Permalink

[ https://issues.apache.org/jira/browse/MAHOUT-1838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15264684#comment-15264684 ]

ASF GitHub Bot commented on MAHOUT-1838:
----------------------------------------

Github user andrewpalumbo commented on a diff in the pull request:

https://github.com/apache/mahout/pull/229#discussion_r61640032

--- Diff: examples/bin/spark-shell-plot.mscala ---
@@ -0,0 +1,19 @@
+import org.apache.mahout.visualization.mplot2d
+
+val mxRnd = Matrices.symmetricUniformView(5000000, 2, 1234)
+val drmRand = drmParallelize(mxRnd)
+
+val drmSin = drmRand.mapBlock() {case (keys, block) =>
+ val blockB = block.like()
+ for (i <- 0 until block.nrow) {
+ blockB(i, 0) = block(i, 0)
+ blockB(i, 1) = Math.sin((block(i, 0) * 8))
+ }
+ keys -> blockB
+}
+
+new mplot2d(drmRand, samplePercent = 10)
--- End diff --

that is just for illistrituve purposes, the default is also 10% but the user can override it to be 1 to 100 %

Post by Andrew Palumbo (JIRA)
Provide and plotting capabilities for Mahout mtrices and DRMs
--------------------------------------------------------------
Key: MAHOUT-1838
URL: https://issues.apache.org/jira/browse/MAHOUT-1838
Project: Mahout
Issue Type: New Feature
Components: visiualization
Affects Versions: 0.12
Reporter: Andrew Palumbo
Assignee: Andrew Palumbo
Fix For: 0.13
Attachments: drmSamplePlot2d.png
Add basic 2d and 3d plotting capabilities to Mahout using the Smile library: https://github.com/haifengl/smile
I've prototyped an {{mplot2d}} class here to sample a certain percentage of a DRM's data using {{drmSampleKRows()}} and to create a 2d plot from the resulting x,y coordinate matrix, and tested from the spark-shell as a POC.
http://haifengl.github.io/smile/index.html#gallery
http://haifengl.github.io/smile/index.html#visualization

--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

ASF GitHub Bot (JIRA)

2016-04-29 20:44:13 UTC

Permalink

[ https://issues.apache.org/jira/browse/MAHOUT-1838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15264701#comment-15264701 ]

ASF GitHub Bot commented on MAHOUT-1838:
----------------------------------------

Github user andrewpalumbo commented on a diff in the pull request:

https://github.com/apache/mahout/pull/229#discussion_r61641870

--- Diff: examples/bin/spark-shell-plot.mscala ---
@@ -0,0 +1,19 @@
+import org.apache.mahout.visualization.mplot2d
+
+val mxRnd = Matrices.symmetricUniformView(5000000, 2, 1234)
+val drmRand = drmParallelize(mxRnd)
+
+val drmSin = drmRand.mapBlock() {case (keys, block) =>
+ val blockB = block.like()
+ for (i <- 0 until block.nrow) {
+ blockB(i, 0) = block(i, 0)
+ blockB(i, 1) = Math.sin((block(i, 0) * 8))
+ }
+ keys -> blockB
+}
+
+new mplot2d(drmRand, samplePercent = 10)
--- End diff --

changed the default sample size to 1%

Post by Andrew Palumbo (JIRA)
Provide and plotting capabilities for Mahout mtrices and DRMs
--------------------------------------------------------------
Key: MAHOUT-1838
URL: https://issues.apache.org/jira/browse/MAHOUT-1838
Project: Mahout
Issue Type: New Feature
Components: visiualization
Affects Versions: 0.12
Reporter: Andrew Palumbo
Assignee: Andrew Palumbo
Fix For: 0.13
Attachments: drmSamplePlot2d.png
Add basic 2d and 3d plotting capabilities to Mahout using the Smile library: https://github.com/haifengl/smile
I've prototyped an {{mplot2d}} class here to sample a certain percentage of a DRM's data using {{drmSampleKRows()}} and to create a 2d plot from the resulting x,y coordinate matrix, and tested from the spark-shell as a POC.
http://haifengl.github.io/smile/index.html#gallery
http://haifengl.github.io/smile/index.html#visualization

--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

ASF GitHub Bot (JIRA)

2016-04-29 20:46:12 UTC

Permalink

[ https://issues.apache.org/jira/browse/MAHOUT-1838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15264706#comment-15264706 ]

ASF GitHub Bot commented on MAHOUT-1838:
----------------------------------------

Github user andrewpalumbo commented on the pull request:

https://github.com/apache/mahout/pull/229#issuecomment-215877245

This should be pretty much good to go as a beginning as is. As I said it is very bare-bones, No titles, single plots, etc, but it is a starting point.

Post by Andrew Palumbo (JIRA)
Provide and plotting capabilities for Mahout mtrices and DRMs
--------------------------------------------------------------
Key: MAHOUT-1838
URL: https://issues.apache.org/jira/browse/MAHOUT-1838
Project: Mahout
Issue Type: New Feature
Components: visiualization
Affects Versions: 0.12
Reporter: Andrew Palumbo
Assignee: Andrew Palumbo
Fix For: 0.13
Attachments: drmSamplePlot2d.png
Add basic 2d and 3d plotting capabilities to Mahout using the Smile library: https://github.com/haifengl/smile
I've prototyped an {{mplot2d}} class here to sample a certain percentage of a DRM's data using {{drmSampleKRows()}} and to create a 2d plot from the resulting x,y coordinate matrix, and tested from the spark-shell as a POC.
http://haifengl.github.io/smile/index.html#gallery
http://haifengl.github.io/smile/index.html#visualization

--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

ASF GitHub Bot (JIRA)

2016-04-29 21:54:13 UTC

Permalink

[ https://issues.apache.org/jira/browse/MAHOUT-1838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15264840#comment-15264840 ]

ASF GitHub Bot commented on MAHOUT-1838:
----------------------------------------

Github user smarthi commented on the pull request:

https://github.com/apache/mahout/pull/229#issuecomment-215891522

+1 to merge

Sent from my iPhone

This should be pretty much good to go as a beginning as is. As I said it is very bare-bones, No titles, single plots, etc, but it is a starting point.
—
You are receiving this because you were mentioned.
Reply to this email directly or view it on GitHub
Provide and plotting capabilities for Mahout mtrices and DRMs
--------------------------------------------------------------
Key: MAHOUT-1838
URL: https://issues.apache.org/jira/browse/MAHOUT-1838
Project: Mahout
Issue Type: New Feature
Components: visiualization
Affects Versions: 0.12
Reporter: Andrew Palumbo
Assignee: Andrew Palumbo
Fix For: 0.13
Attachments: drmSamplePlot2d.png
Add basic 2d and 3d plotting capabilities to Mahout using the Smile library: https://github.com/haifengl/smile
I've prototyped an {{mplot2d}} class here to sample a certain percentage of a DRM's data using {{drmSampleKRows()}} and to create a 2d plot from the resulting x,y coordinate matrix, and tested from the spark-shell as a POC.
http://haifengl.github.io/smile/index.html#gallery
http://haifengl.github.io/smile/index.html#visualization

--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Hudson (JIRA)

2016-04-29 22:34:12 UTC

Permalink

[ https://issues.apache.org/jira/browse/MAHOUT-1838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15264901#comment-15264901 ]

Hudson commented on MAHOUT-1838:
--------------------------------

FAILURE: Integrated in Mahout-Quality #3347 (See [https://builds.apache.org/job/Mahout-Quality/3347/])
MAHOUT-1838: Simple 2d plotting of a sampled DRM closes apache/mahout (apalumbo: rev 4105063d87178c93fd216c8eaeac85b83f506e73)
* spark/pom.xml
* math-scala/src/main/scala/org/apache/mahout/visualization/mplot2d.scala
* spark/src/main/assembly/dependency-reduced.xml
* LICENSE.txt
* spark-shell/src/main/scala/org/apache/mahout/sparkbindings/shell/MahoutSparkILoop.scala
* math-scala/pom.xml
* examples/bin/spark-shell-plot.mscala
* spark-shell/pom.xml
* math-scala/src/main/scala/org/apache/mahout/visualization/mplot3d.scala
* math-scala/src/main/scala/org/apache/mahout/visualization/mlpot.scala

Post by Andrew Palumbo (JIRA)
Provide and plotting capabilities for Mahout mtrices and DRMs
--------------------------------------------------------------
Key: MAHOUT-1838
URL: https://issues.apache.org/jira/browse/MAHOUT-1838
Project: Mahout
Issue Type: New Feature
Components: visiualization
Affects Versions: 0.12
Reporter: Andrew Palumbo
Assignee: Andrew Palumbo
Fix For: 0.13
Attachments: drmSamplePlot2d.png
Add basic 2d and 3d plotting capabilities to Mahout using the Smile library: https://github.com/haifengl/smile
I've prototyped an {{mplot2d}} class here to sample a certain percentage of a DRM's data using {{drmSampleKRows()}} and to create a 2d plot from the resulting x,y coordinate matrix, and tested from the spark-shell as a POC.
http://haifengl.github.io/smile/index.html#gallery
http://haifengl.github.io/smile/index.html#visualization

--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Andrew Palumbo (JIRA)

2016-04-30 04:03:12 UTC

Permalink

Post by Andrew Palumbo (JIRA)
Provide and plotting capabilities for Mahout mtrices and DRMs
--------------------------------------------------------------
Key: MAHOUT-1838
URL: https://issues.apache.org/jira/browse/MAHOUT-1838
Project: Mahout
Issue Type: New Feature
Components: visiualization
Affects Versions: 0.12
Reporter: Andrew Palumbo
Assignee: Andrew Palumbo
Fix For: 0.13
Attachments: drmSamplePlot2d.png, plot3d.png, plot3dRotated.png
Add basic 2d and 3d plotting capabilities to Mahout using the Smile library: https://github.com/haifengl/smile
I've prototyped an {{mplot2d}} class here to sample a certain percentage of a DRM's data using {{drmSampleKRows()}} and to create a 2d plot from the resulting x,y coordinate matrix, and tested from the spark-shell as a POC.
http://haifengl.github.io/smile/index.html#gallery
http://haifengl.github.io/smile/index.html#visualization

--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Andrew Palumbo (JIRA)

2016-04-30 04:03:12 UTC

Permalink

Post by Andrew Palumbo (JIRA)
Provide and plotting capabilities for Mahout mtrices and DRMs
--------------------------------------------------------------
Key: MAHOUT-1838
URL: https://issues.apache.org/jira/browse/MAHOUT-1838
Project: Mahout
Issue Type: New Feature
Components: visiualization
Affects Versions: 0.12
Reporter: Andrew Palumbo
Assignee: Andrew Palumbo
Fix For: 0.13
Attachments: drmSamplePlot2d.png, plot3d.png, plot3dRotated.png
Add basic 2d and 3d plotting capabilities to Mahout using the Smile library: https://github.com/haifengl/smile
I've prototyped an {{mplot2d}} class here to sample a certain percentage of a DRM's data using {{drmSampleKRows()}} and to create a 2d plot from the resulting x,y coordinate matrix, and tested from the spark-shell as a POC.
http://haifengl.github.io/smile/index.html#gallery
http://haifengl.github.io/smile/index.html#visualization

--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

ASF GitHub Bot (JIRA)

2016-04-30 04:50:12 UTC

Permalink

[ https://issues.apache.org/jira/browse/MAHOUT-1838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15265153#comment-15265153 ]

ASF GitHub Bot commented on MAHOUT-1838:
----------------------------------------

Github user andrewpalumbo closed the pull request at:

https://github.com/apache/mahout/pull/229

Post by Andrew Palumbo (JIRA)
Provide and plotting capabilities for Mahout mtrices and DRMs
--------------------------------------------------------------
Key: MAHOUT-1838
URL: https://issues.apache.org/jira/browse/MAHOUT-1838
Project: Mahout
Issue Type: New Feature
Components: visiualization
Affects Versions: 0.12
Reporter: Andrew Palumbo
Assignee: Andrew Palumbo
Fix For: 0.13
Attachments: drmSamplePlot2d.png, plot3d.png, plot3dRotated.png
Add basic 2d and 3d plotting capabilities to Mahout using the Smile library: https://github.com/haifengl/smile
I've prototyped an {{mplot2d}} class here to sample a certain percentage of a DRM's data using {{drmSampleKRows()}} and to create a 2d plot from the resulting x,y coordinate matrix, and tested from the spark-shell as a POC.
http://haifengl.github.io/smile/index.html#gallery
http://haifengl.github.io/smile/index.html#visualization

--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Andrew Palumbo (JIRA)

2016-04-30 04:52:12 UTC

Permalink

[ https://issues.apache.org/jira/browse/MAHOUT-1838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Andrew Palumbo updated MAHOUT-1838:
-----------------------------------
Summary: Provide plotting capabilities for Mahout matrices and DRMs (was: Provide and plotting capabilities for Mahout mtrices and DRMs )

Provide plotting capabilities for Mahout matrices and DRMs
-----------------------------------------------------------
Key: MAHOUT-1838
URL: https://issues.apache.org/jira/browse/MAHOUT-1838
Project: Mahout
Issue Type: New Feature
Components: visiualization
Affects Versions: 0.12
Reporter: Andrew Palumbo
Assignee: Andrew Palumbo
Fix For: 0.13
Attachments: drmSamplePlot2d.png, plot3d.png, plot3dRotated.png
Add basic 2d and 3d plotting capabilities to Mahout using the Smile library: https://github.com/haifengl/smile
I've prototyped an {{mplot2d}} class here to sample a certain percentage of a DRM's data using {{drmSampleKRows()}} and to create a 2d plot from the resulting x,y coordinate matrix, and tested from the spark-shell as a POC.
http://haifengl.github.io/smile/index.html#gallery
http://haifengl.github.io/smile/index.html#visualization

--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

ASF GitHub Bot (JIRA)

2016-05-01 04:53:12 UTC

Permalink

[ https://issues.apache.org/jira/browse/MAHOUT-1838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15265607#comment-15265607 ]

ASF GitHub Bot commented on MAHOUT-1838:
----------------------------------------

Github user andrewpalumbo commented on the pull request:

https://github.com/apache/mahout/pull/230#issuecomment-216016151

For the most part this is good to go. Still bare-bones and functionality needs to be built in (eg. adding titles, plotting multiple datasets, plotting decision boundaries, etc). Much will depend on the direction we take this in.

The 3d surface and mesh functions need some work.

This PR ended up covering 5 or so subtasks of MAHOUT-1838.

If there are no Objections I'll probably push it tomorrow.

Post by Andrew Palumbo (JIRA)
Provide plotting capabilities for Mahout matrices and DRMs
-----------------------------------------------------------
Key: MAHOUT-1838
URL: https://issues.apache.org/jira/browse/MAHOUT-1838
Project: Mahout
Issue Type: New Feature
Components: visiualization
Affects Versions: 0.12
Reporter: Andrew Palumbo
Assignee: Andrew Palumbo
Fix For: 0.13
Attachments: drmSamplePlot2d.png, plot3d.png, plot3dRotated.png
Add basic 2d and 3d plotting capabilities to Mahout using the Smile library: https://github.com/haifengl/smile
I've prototyped an {{mplot2d}} class here to sample a certain percentage of a DRM's data using {{drmSampleKRows()}} and to create a 2d plot from the resulting x,y coordinate matrix, and tested from the spark-shell as a POC.
http://haifengl.github.io/smile/index.html#gallery
http://haifengl.github.io/smile/index.html#visualization

--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

ASF GitHub Bot (JIRA)

2016-05-01 21:52:12 UTC

Permalink

[ https://issues.apache.org/jira/browse/MAHOUT-1838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15265963#comment-15265963 ]

ASF GitHub Bot commented on MAHOUT-1838:
----------------------------------------

Github user asfgit closed the pull request at:

https://github.com/apache/mahout/pull/230

--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Hudson (JIRA)

2016-05-01 22:35:12 UTC

Permalink

[ https://issues.apache.org/jira/browse/MAHOUT-1838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15265982#comment-15265982 ]

Hudson commented on MAHOUT-1838:
--------------------------------

SUCCESS: Integrated in Mahout-Quality #3349 (See [https://builds.apache.org/job/Mahout-Quality/3349/])
MAHOUT-1838: Simple 2d and 3d plots of sampled drm points. closes (apalumbo: rev b0cede1e2725c16b039c18c4eb0ee4aa324d7389)
* math-scala/src/main/scala/org/apache/mahout/visualization/mplot2d.scala
* math-scala/src/main/scala/org/apache/mahout/visualization/mlpot.scala
* math-scala/src/main/scala/org/apache/mahout/visualization/MPlot3d.scala
* math-scala/src/main/scala/org/apache/mahout/visualization/MGrid.scala
* math-scala/src/main/scala/org/apache/mahout/visualization/package.scala
* math-scala/src/main/scala/org/apache/mahout/visualization/MHisto.scala
* math-scala/src/main/scala/org/apache/mahout/visualization/MHisto3d.scala
* math-scala/src/main/scala/org/apache/mahout/visualization/MahoutPlot.scala
* math-scala/src/main/scala/org/apache/mahout/visualization/mplot3d.scala
* math-scala/src/main/scala/org/apache/mahout/visualization/MSurf.scala
* math-scala/src/main/scala/org/apache/mahout/visualization/MPlot2d.scala
* examples/bin/spark-shell-plot.mscala

--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Hudson (JIRA)

2016-05-02 01:35:12 UTC

Permalink

[ https://issues.apache.org/jira/browse/MAHOUT-1838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15266039#comment-15266039 ]

Hudson commented on MAHOUT-1838:
--------------------------------

SUCCESS: Integrated in Mahout-Quality #3351 (See [https://builds.apache.org/job/Mahout-Quality/3351/])
MAHOUT-1838: add Matlab peaks example (apalumbo: rev 616b87c07e3889609f10f08423c0e8992f8d6a43)
* examples/bin/spark-shell-plot.mscala

--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Andrew Palumbo (JIRA)

2016-05-03 18:30:13 UTC

Permalink

Post by Andrew Palumbo (JIRA)
Provide plotting capabilities for Mahout matrices and DRMs
-----------------------------------------------------------
Key: MAHOUT-1838
URL: https://issues.apache.org/jira/browse/MAHOUT-1838
Project: Mahout
Issue Type: New Feature
Components: visiualization
Reporter: Andrew Palumbo
Assignee: Andrew Palumbo
Fix For: 0.13
Attachments: 2dhisto_21Buckets_100pct_gaussian.png, 3d_histo.png, drmSamplePlot2d.png, plot3d.png, plot3dRotated.png
Add basic 2d and 3d plotting capabilities to Mahout using the Smile library: https://github.com/haifengl/smile
I've prototyped an {{mplot2d}} class here to sample a certain percentage of a DRM's data using {{drmSampleKRows()}} and to create a 2d plot from the resulting x,y coordinate matrix, and tested from the spark-shell as a POC.
http://haifengl.github.io/smile/index.html#gallery
http://haifengl.github.io/smile/index.html#visualization

--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Andrew Palumbo (JIRA)

2016-05-03 18:30:13 UTC

Permalink

Post by Andrew Palumbo (JIRA)
Provide plotting capabilities for Mahout matrices and DRMs
-----------------------------------------------------------
Key: MAHOUT-1838
URL: https://issues.apache.org/jira/browse/MAHOUT-1838
Project: Mahout
Issue Type: New Feature
Components: visiualization
Reporter: Andrew Palumbo
Assignee: Andrew Palumbo
Fix For: 0.13
Attachments: 2dhisto_21Buckets_100pct_gaussian.png, 3d_histo.png, drmSamplePlot2d.png, plot3d.png, plot3dRotated.png
Add basic 2d and 3d plotting capabilities to Mahout using the Smile library: https://github.com/haifengl/smile
I've prototyped an {{mplot2d}} class here to sample a certain percentage of a DRM's data using {{drmSampleKRows()}} and to create a 2d plot from the resulting x,y coordinate matrix, and tested from the spark-shell as a POC.
http://haifengl.github.io/smile/index.html#gallery
http://haifengl.github.io/smile/index.html#visualization

--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Andrew Palumbo (JIRA)

2016-05-25 23:46:12 UTC

Permalink

[ https://issues.apache.org/jira/browse/MAHOUT-1838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Andrew Palumbo resolved MAHOUT-1838.
------------------------------------
Resolution: Incomplete

On hold in; superseded by Zeppelin Integration.

Post by Andrew Palumbo (JIRA)
Provide plotting capabilities for Mahout matrices and DRMs
-----------------------------------------------------------
Key: MAHOUT-1838
URL: https://issues.apache.org/jira/browse/MAHOUT-1838
Project: Mahout
Issue Type: New Feature
Components: visiualization
Reporter: Andrew Palumbo
Assignee: Andrew Palumbo
Fix For: 0.13.0
Attachments: 2dhisto_21Buckets_100pct_gaussian.png, 3d_histo.png, drmSamplePlot2d.png, plot3d.png, plot3dRotated.png
Add basic 2d and 3d plotting capabilities to Mahout using the Smile library: https://github.com/haifengl/smile
I've prototyped an {{mplot2d}} class here to sample a certain percentage of a DRM's data using {{drmSampleKRows()}} and to create a 2d plot from the resulting x,y coordinate matrix, and tested from the spark-shell as a POC.
http://haifengl.github.io/smile/index.html#gallery
http://haifengl.github.io/smile/index.html#visualization

--
This message was sent by Atlassian JIRA
(v6.3.4#6332)